Associate Director - Commercial AI Product Owner

At Bristol Myers Squibb, our employees often ask, “Who are you working for?”—a question that fuels collaboration, accountability, and urgency in our work. Our purpose-driven culture inspires us to discover, develop, and deliver innovative medicines to prevail over serious diseases. We offer uniquely interesting and meaningful work, opportunities for growth, and a supportive environment that values inclusion, wellbeing, flexibility, and comprehensive benefits. This is work that transforms the lives of patients, and the careers of those who do it.

Summary:

As Associate Director, Commercial AI Product, you will lead the transformation of commercial business processes into forms that AI can understand and act on. This role ensures that the way brands and commercial teams work feeds into BMS's enterprise AI solutions. By owning the unstructured content and its relationships in the next-generation knowledge and context layer, a new generation of machine-readable business information, you will make AI more grounded, accurate and context-aware in supporting commercial decision-making.

Building on this foundation, you will work closely with brand, IT and commercial analytics teams to make AI smarter, moving it beyond descriptive to diagnostic, predictive and prescriptive by using context and machine learning-driven solutions. With a strong understanding of context engineering and ML operations, the right candidate acts as a cross-functional team player who helps boost the AI product to a new level of intelligence.

You will translate BMS Commercial AI, Analytics & Insights product team’s vision and roadmap into business technical requirements, actionable tasks, milestones, and clear outcomes.

Responsibilities:

Roadmap Execution & Context Engineering

• Roadmap Execution: Translate the Commercial AI, Analytics & Insights product team's vision and roadmap into business technical requirements, actionable tasks, milestones and clear outcomes.
• Knowledge & Context Engineering: Translate business knowledge into the context layer through context design: generate and connect to unstructured content as knowledge assets, build its relationships, use a graph database, and perform lifecycle management for enterprise knowledge assets. Make sure skills have the right guidance to connect to the knowledge graph, and that the knowledge graph is used in our key AI products across brands.
• Brand & Stakeholder Interface: Work directly with the brand teams on the initial development of the knowledge graph in the context layer, brand by brand. After
• initial deployment, work with the brand pods and enablement team to continually improve the knowledge layer in the back end of the AI product.

ML Operations & AI Performance Optimization

• ML Operation: Implement the right ML framework in the AI product to use ML capability and push AI beyond descriptive analysis. Work closely with the IT team to monitor ML performance, and work with CAAI analytics leads to improve ML performance as needed.
• AI Performance Optimization (Golden Q&A): Design, build and maintain a golden Q&A evaluation framework for continuous AI performance monitoring. The golden Q&A set is a curated, business-validated collection of representative questions with reference answers. Use a held-out (out-of-training) test set to prevent data leakage and enable unbiased benchmarking. Evaluate both structured and unstructured outputs against defined metrics and thresholds, such as accuracy, groundedness, faithfulness and relevance.
• Business Acceptance & UAT: Define test scope and context test cases for UAT, drawing on the golden Q&A set, and resolve context-layer defects.
• Performance Metrics: Track context-layer usage and quality signals and provide them as performance metrics.

Collaboration, Governance & Trust

• Offshore Team Collaboration: Work with the Offshore Sr. Manager and AOI Ops on validation of the knowledge and context layer and the feedback loop from the Ops roles.
• Responsible AI & Governance: Partner with Data Governance, Legal and Privacy on privacy, explainability and human-in-the-loop checks for knowledge and context content. Support the AI product team in keeping the governance forums and technical controls.

Expected Outcomes

• Releases meet business acceptance criteria and fit brand workflows, and the roadmap is delivered as working context-layer capabilities.
• Context content supports a consistent experience across brands.
• The knowledge and context layer is used in CAAI AI products and improves from business feedback.
• Context-layer usage and quality are measurable, and the frameworks are reusable across enterprise solutions.
• A clear context-engineering backlog built from brand team feedback and aligned with the CAAI product team roadmap and guidance.
• A well-architected ML model catalog, with standardized metadata, versioning, lineage and performance documentation, that the AI product can discover and invoke programmatically.
• Measurable improvement in AI output quality, benchmarked on the golden Q&A held-out set for accuracy, groundedness, faithfulness and relevance, and tracked release over release.

Qualifications:

• Advanced degree (MS/PhD preferred) in Computer Science, Software Engineering, Information Science, Artificial Intelligence, Data Science, Life Sciences, or a related quantitative or business field.
• Minimum 5 years of hands-on experience in pharma commercial analytics/decision science or software development.
• 2 years building or supporting an analytics or AI product or platform.
• Hands-on experience with graph databases, such as Neo4j and Amazon Neptune.
• Hands-on experience designing and maintaining enterprise knowledge graphs, semantic models, ontologies, taxonomies, business vocabulary and metadata services.
• Hands-on experience with AI product development topics such as LLMs, RAG, semantic and context layers, prompt or agent configuration and sub-agent orchestration.
• Experience developing end-to-end ML and simulation-type advanced analytics algorithms, such as tree-based models and marketing mix modeling (MMM).
• Experience designing and operating AI output evaluation frameworks, such as golden Q&A sets with held-out test data, metric-based scoring (accuracy, groundedness, faithfulness, relevance), LLM-as-judge methods, and regression testing across releases.
• Strong foundation in AI governance (risk management, security, privacy, model monitoring, human-in-the-loop) in regulated environments, with an understanding of HIPAA, GDPR/CCPA and related regulatory standards.
• Ability to translate unstructured business and domain knowledge, such as documents, playbooks, brand content and expert know-how, into reusable semantic models (ontologies, taxonomies and knowledge graphs) that AI can ground on. Partners effectively with cross-functional teams.
• Strong stakeholder management and communication; able to lead without direct authority.

Preferred Qualifications (nice to have)

• Knowledge of pharmaceutical data: claims, APLD, specialty pharmacy, digital signals and promotional data.
• Familiarity with commercial tools and methods: Veeva, omnichannel metrics, multi-touch attribution and next-best-action frameworks.
• UX research or design experience for analytics or digital products.
• Experience working with offshore or vendor teams and agile tools such as Jira.

We hire for skills and capabilities, not just credentials – if this role excites you, but doesn’t perfectly match your resume, we encourage you to apply anyway.

Princeton - NJ - US: $167,540 - $203,013 


The starting pay range(s) listed above is for full-time employees (FTE). You may also be eligible for additional discretionary incentive cash and stock opportunities. We determine starting pay thoughtfully – carefully considering the nature of the role, required skills, work location, schedule and the knowledge and experience you bring. Final compensation is guided by pay equity principles and applicable employment laws. Compensation programs are reviewed on an ongoing basis and may be adjusted over time to reflect evolving market factors, and individual, team or Company performance.

Benefits:

Subject to the terms and conditions of the applicable plans then in effect, you may be eligible to participate in our comprehensive benefit plans – including wellbeing support, retirement and financial protection benefits, and insurance offerings (medical, dental, vision, life and disability).

U.S.-based exempt employees are eligible for Flexible Time Off (FTO), which provides paid time off without a set accrual limit, subject to manager approval, along with 11 paid company holidays each year.

Non-exempt employees, RayzeBio employees, and employees located in Puerto Rico receive 160 hours of paid vacation annually for new hires (subject to manager approval), 11 paid company holidays, and 3 optional holidays.

Depending on eligibility, employees may also have access to additional time-off benefits, including paid sick leave, up to two paid volunteer days per year, summer hours flexibility, and leaves of absence for medical, personal, parental, caregiver, bereavement, or military needs. Eligible employees also enjoy an annual Global Shutdown between Christmas Day and New Year's Day.

U.S.-based job seekers can explore full benefit offerings athttps://careers.bms.com/benefits

How We Work

Where you work matters – because collaboration, innovation and patient impact happen in many settings. Our roles are structured across four work models: site-essential, site-by-design, field-based and remote-by-design. The model assigned to this role is based on its core responsibilities. Learn more at https://careers.bms.com/ways-of-working.

Supporting People with Disabilities

BMS is dedicated to ensuring that people with disabilities can excel through a transparent recruitment process, reasonable workplace accommodations/adjustments and ongoing support in their roles. Applicants can request a reasonable workplace accommodation/adjustment prior to accepting a job offer. If you require reasonable accommodations/adjustments in completing this application, or in any part of the recruitment process, direct your inquiries to [email protected]. Visit careers.bms.com/eeo-accessibility to access our complete Equal Employment Opportunity statement.

Candidate Rights

BMS will consider qualified applicants with arrest and conviction records, pursuant to applicable laws in your area.

For roles based in Los Angeles County only:  If you live in or expect to work from Los Angeles County if hired for this position, please visit this page for important additional information: https://careers.bms.com/california-residents/

For roles based in Washington State only: If you live in or expect to work from Washington State if hired for this position, please visit this page for important information about the Washington Fair Chance Act.

Data Protection

We will never request payments, financial information, or social security numbers during our application or recruitment process. Learn more about protecting yourself at https://careers.bms.com/fraud-protection.

Any data processed in connection with role applications will be treated in accordance with applicable data privacy policies and regulations.

If this posting is missing required information required by local law or incorrect, contact BMS at [email protected]with the Job Title and Requisition number. Do not send application-related inquiries to this email. To check your application status, please login to your Candidate Home Account.

R1608143 : Associate Director, Commercial AI Product Owner