L

Lincoln Financial

Insurance, retirement, and financial services provider

Lead Data Scientist

Applied Machine LearningUpdated on Nov 14
Full-time

About the Job

Requirements

  • Three to eight years of experience in data science, applied machine learning, or a related analytical role.
  • Hands-on experience building and evaluating machine-learning models; experience with agentic AI systems, including large language model agents, tool use, or multi-step reasoning, is strongly preferred.
  • Experience designing and analyzing experiments, such as A/B testing or causal inference.
  • Proficiency in Python, SQL, and standard machine-learning and data-science tooling.
  • Ability to communicate technical findings to non-technical stakeholders.
  • Bachelor's or Master's degree in Data Science, Statistics, Computer Science, or a related field.

Responsibilities

  • Analyze usage, performance, and outcome data to identify actionable insights about how agentic AI features are used and where they fall short.
  • Translate findings into clear, actionable recommendations for product, engineering, and business stakeholders.
  • Build and maintain dashboards and reporting that track agent performance and business impact.
  • Design, build, and validate models and agentic workflows.
  • Evaluate model and agent architecture choices, balancing accuracy, latency, cost, and risk.
  • Collaborate with engineering to productionize models and agents and monitor them after launch.
  • Design and run experiments, including A/B tests, offline evaluations, and holdouts, to test agent behavior, prompt or model changes, and feature variants.
  • Define hypotheses, success metrics, and sample-size or power requirements, and ensure statistical rigor.
  • Interpret results and translate them into clear go/no-go recommendations.
  • Define and track metrics connecting agentic AI features to business value, including efficiency gains, cost savings, revenue, and customer or employee experience.
  • Build measurement frameworks that isolate AI-driven impact from other contributing factors.
  • Report on return on investment and value realization to product and business leadership.
  • Design and maintain evaluation suites and benchmarks covering task success, reasoning quality, tool-use correctness, safety, and failure modes.
  • Build regression frameworks and test-case libraries to catch performance degradation across model or prompt updates.
  • Partner with product owners on human-in-the-loop review processes and use evaluation findings to guide model and agent improvements.

Desired Qualifications

  • Experience building or evaluating large-language-model-based agents or multi-agent systems.
  • Familiarity with evaluation frameworks and observability tools such as LangSmith, Weights & Biases, and Ragas.
  • Experience with large language model APIs or enterprise AI platforms such as Azure OpenAI, AWS Bedrock, Anthropic Claude, or Google Vertex AI.
  • Advanced degree (Master's or Ph.D.) in a quantitative field.
  • Domain experience in life insurance, annuities, retirement planning, or employee benefits.

About the Company

Lincoln Financial

Insurance, retirement, and financial services provider

Lincoln Financial Group offers life insurance, annuities, and retirement income products through its network of affiliated companies, and also provides securities and investment advisory services via affiliated broker-dealers. Its products combine insurance coverage or retirement-focused contracts with investment options, where customers fund premiums, choose subaccounts or riders, and receive benefits such as death benefits, living benefits, or guaranteed income in retirement. The company differentiates itself with a family of affiliated brands and distributors that coordinate life, annuity, and advisory products under one umbrella. Its goal is to help individuals and families protect loved ones, plan for retirement, and achieve financial security through integrated protection and investment solutions.

Company size
Not listed
Company stage
Not listed
Total funding
$128.8M
Headquarters
Radnor Township, Pennsylvania
Founded
1905

Recently Posted Jobs

Explore more opportunities at Lincoln Financial

See more jobs