About this role.
This is a Director-level individual contributor role in the Data Science and Assessments team within People, Purpose & Brand at a major company. The role focuses on GenAI enablement, including building evaluation frameworks, pipelines, and monitoring for AI systems. It also involves vendor AI/ML risk management and broader data science support. The ideal candidate has deep technical expertise in GenAI, strong Python and SQL skills, and a collaborative mindset. The position offers the opportunity to shape AI adoption and drive enterprise-wide outcomes.
Role DNA
A quick view of the complexity, pace, ownership and collaboration implied by the job description.
Job Complexity
5/5Pace & Pressure
4/5Autonomy Level
5/5Communication Load
5/5Salary analysis
Estimated compensation compared with the broader US market for similar roles.
Core skills
Skills and capabilities most closely associated with this opportunity.
Cover letter sample
Dear Hiring Team,
I am writing to express my interest in the Director I, Data Science position within People, Purpose & Brand. With over 8 years of experience in data science and a Ph.D. in Statistics, I have a strong foundation in AI/ML and a proven track record of leading GenAI initiatives. My expertise includes building scalable evaluation frameworks, managing vendor AI risk, and delivering high-impact solutions across organizations.
I am particularly drawn to this role because it combines hands-on technical leadership with strategic influence. At my previous role, I architected evaluation pipelines for LLMs that improved model safety by 30% and reduced deployment time by 50%. I am eager to bring my skills in GenAI, Python, and cross-functional collaboration to your team.
Thank you for considering my application. I look forward to the opportunity to discuss how I can contribute to your Data Science and Assessments team.
Sincerely,
Your Name
Sample interview questions
I have built automated and human-in-the-loop evaluation pipelines for LLMs. Metrics included accuracy, fluency, toxicity, and alignment with business rules. I implemented monitoring dashboards and ran A/B tests to compare models.
I would define criteria based on business needs, technical capability, and risk. Then run benchmarks, pilot tests, and gather stakeholder feedback. I synthesize results into a recommendation matrix and present trade-offs.
I would establish governance frameworks, conduct bias audits, and provide training. Collaboration with legal and compliance is key. I also advocate for transparent model cards and documentation.
I once presented a comparison of two model architectures to marketing leaders. I used analogies and visualizations to explain performance vs. cost trade-offs, and tied it to business KPIs.
I follow ArXiv, attend conferences, and belong to AI communities. I prioritize based on impact, maturity, and alignment with company goals, and run small experiments before scaling.
Description
The Data Science and Assessments (DS&A) team within People, Purpose, & Brand (PP&B) is hiring a Director I, Data Scientist (STP) to serve as a hands-on technical leader for GenAI evaluation, enablement, and responsible AI adoption. PP&B develops programs across talent acquisition, workforce planning, performance & rewards, employer branding, and wellbeing to build a diverse, future-ready workforce.
In this role, you will shape how DS&A generates, evaluates, and scales ML and GenAI-based programs and tooling to improve productivity, decision-making, and employee experience across PP&B. Core responsibilities span three areas:
- GenAI Enablement: Design, build, and maintain evaluation frameworks and pipelines that accelerate the creation, iteration, and safe expansion of GenAI capabilities, including agentic workflows, data readiness, and post-deployment monitoring.
- Vendor & AI/ML Risk Management: Define and execute a vendor-AI evaluation vision enabling repeatable vendor selection, value validation, quality monitoring, and responsible model risk management.
- Broader Data Science: Support classic ML, automation, and technical consulting to empower PP&B colleagues and drive enterprise-wide outcomes.
This individual contributor role reports through the Office of Data & Data Science. The ideal candidate is proactive, highly technical, and collaborative; able to translate complex tradeoffs into clear, actionable recommendations that drive meaningful impact.
Key Responsibilities
- Architect, develop, and maintain tooling and pipelines to support GenAI model development, evaluation, deployment, and monitoring across PP&B programs.
- Design and operationalize scalable evaluation frameworks and metrics for GenAI systems (including automated and human-in-the-loop evaluations) to ensure quality, safety, and organizational alignment.
- Lead the vendor AI evaluation program: define criteria, run benchmarks and pilots, synthesize results, and provide clear recommendations for vendor selection and integration.
- Build reusable components leveraging APIs and templates that enable rapid iteration and reliable deployment of GenAI features.
- Partner with stakeholders across PP&B to translate business needs into technical designs, evaluation plans, and implementation roadmaps.
- Promote strong engineering hygiene across projects (CI/CD, version control, testing, documentation, reproducible pipelines).
- Provide informal mentorship for data science and analytics colleagues on tools and evaluation processes.
Qualifications
- Strong foundation in Data Science principles (Probability, Statistics, AI/ML).
- Experience with LLMs, embeddings, and generative/agentic systems.
- Proficient in Python; comfortable writing production-quality code.
- Strong SQL skills for querying, validation, and data exploration.
- Experience with APIs and integrating external model or vendor services.
- Familiarity with cloud computing concepts and services.
- Experience evaluating models for fairness, bias, privacy, explainability, or responsible AI.
- Comfortable with Git-based version control and collaborative code review.
- Competencies typically acquired through a Ph.D. degree (in Statistics, Mathematics, Economics, Actuarial Science or other scientific field of study) and a minimum of 3 years of relevant experience, a Master`s degree and a minimum of 6 years of relevant experience or may be acquired through a Bachelor`s degree and a minimum of 8 years of relevant experience.
What We Value
- A collaborative, customer-focused mindset oriented toward pragmatic, high-impact solutions and enabling others.
- Strong project management skills: building clear plans, coordinating across stakeholders, and driving accountability.
- Clear communication of technical tradeoffs, evaluation results, and recommendations to both technical and non-technical audiences.
- Product-minded engineering: building systems that are maintainable, scalable, and easy to adopt.
- A bias toward action combined with rigorous attention to evaluation and safety.
Work Arrangement & Travel
- Telecommuting up to 60% when near an office; 100% remote supported otherwise.
- Travel up to 10% for team meetings, planning sessions, or stakeholder engagements.
About Us
Pay Philosophy: The typical starting salary range for this role is determined by a number of factors including skills, experience, education, certifications and location. The full salary range for this role reflects the competitive labor market value for all employees in these positions across the national market and provides an opportunity to progress as employees grow and develop within the role. Some roles at Liberty Mutual have a corresponding compensation plan which may include commission and/or bonus earnings at rates that vary based on multiple factors set forth in the compensation plan for the role.
At Liberty Mutual, our goal is to create a workplace where everyone feels valued, supported, and can thrive. We build an environment that welcomes a wide range of perspectives and experiences, with inclusion embedded in every aspect of our culture and reflected in everyday interactions. This comes to life through comprehensive benefits, workplace flexibility, professional development opportunities, and a host of opportunities provided through our Employee Resource Groups. Each employee plays a role in creating our inclusive culture, which supports every individual to do their best work. Together, we cultivate a community where everyone can make a meaningful impact for our business, our customers, and the communities we serve.
We value your hard work, integrity and commitment to make things better, and we put people first by offering you benefits that support your life and well-being. To learn more about our benefit offerings please visit: https://www.libertymutualgroup.com/about-lm/careers/benefits
Liberty Mutual is an equal opportunity employer. We will not tolerate discrimination on the basis of race, color, national origin, sex, sexual orientation, gender identity, religion, age, disability, veteran’s status, pregnancy, genetic information or on any basis prohibited by federal, state or local law.
Fair Chance Notices
Annual salary information is not provided for this position. Explore salary ranges for similar roles in our Salary Directory ›
Upload your resume now
- To unlock remote work opportunities and be discovered by global employers.
This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.
