B

Boston Consulting Group

Global strategy and transformation consulting firm

Senior Manager GenAI Engineering

Engineering LeadershipConfirmed live in the last 24 hours
Full-timeGurugram, Haryana, IndiaNo salary listed

About the Job

Requirements

  • At least 10 years of experience in software engineering, machine learning/artificial intelligence engineering, or data science, including significant experience designing and delivering production-grade generative AI/artificial intelligence products and leading engineering teams.
  • Hands-on engineering development expertise to build and deploy production-grade digital products.
  • Demonstrated ability to lead delivery teams and grow into broader leadership responsibilities.
  • Proven experience leading teams of data scientists, machine learning engineers, or generative AI engineers delivering enterprise AI or digital products for internal or commercial products.
  • Experience owning timelines, dependencies, and outcomes.
  • Experience engaging product owners, functional leaders, and senior stakeholders.
  • Strong hands-on experience with Python, applied AI, machine learning, and generative AI in production environments.
  • Experience with cloud-based development and deployment environments.
  • Experience with data pipelines and production-grade systems.
  • Ability to identify the right technical approach to solve business problems and guide teams accordingly.

Responsibilities

  • Partner with product owners, functional leaders, and stakeholders within the People function to define requirements, shape backlog items, and translate business problems into technical solutions.
  • Work with global and local market teams during rollouts to understand adoption, identify gaps, and continuously improve the solution.
  • Partner with enterprise teams across architecture, security, and Responsible AI to seek approvals for AI solutions during deployments and rollouts.
  • Ensure generative AI solutions are designed and delivered in accordance with Responsible AI, security, privacy, data governance, and regulatory requirements.
  • Establish appropriate AI guardrails for prompt injection, data leakage, unauthorized tool access, unsafe outputs, and inappropriate model behaviour.
  • Partner with Responsible AI, Security, Privacy, Legal, Risk, and Enterprise Architecture teams to obtain necessary approvals and establish production-readiness standards.
  • Document AI system architecture, model usage, data flows, risks, evaluations, and operational controls.
  • Embed responsible AI and security considerations throughout the product lifecycle.
  • Define the technical vision, architecture, and engineering strategy for enterprise generative AI products.
  • Design and guide implementation of large language model-powered applications, retrieval-augmented generation architectures, agentic workflows, large language model orchestration, tool/function calling, and AI-powered decision-support solutions.
  • Evaluate and select foundation models, embedding models, AI platforms, retrieval technologies, orchestration frameworks, and cloud services based on business and technical requirements.
  • Establish reusable generative AI architecture patterns, reference architectures, engineering standards, and technical accelerators across the AI Center of Excellence.
  • Make build-versus-buy, model-selection, and platform decisions considering quality, scalability, security, latency, and cost.
  • Conduct architecture and design reviews and provide technical direction across multiple engineering teams and workstreams.
  • Define evaluation frameworks for generative AI applications covering accuracy, relevance, groundedness, hallucination, safety, robustness, latency, and cost.
  • Establish automated evaluation and regression-testing strategies for models, prompts, retrieval-augmented generation pipelines, and agentic workflows.
  • Partner with Product and business stakeholders to define AI quality and product success metrics.
  • Establish production-grade large language model operations and machine learning operations practices for model and prompt versioning, deployment, monitoring, observability, and continuous improvement.
  • Define operational metrics for AI quality, latency, reliability, usage, and cost.
  • Establish continuous integration/continuous delivery and automated testing practices for generative AI applications, prompts, retrieval-augmented generation pipelines, and agentic workflows.
  • Design AI systems for scalability, availability, reliability, latency, and cost efficiency.
  • Lead and coach a team of generative AI/machine learning engineers and data scientists delivering enterprise AI solutions end to end, from problem definition and design through development, deployment, and rollout.
  • Own execution and delivery, including planning, prioritization, agile ceremonies, timelines, and quality of outcomes.
  • Provide technical direction, unblock teams, and ensure pragmatic, scalable solutions aligned with business needs.
  • Remain hands-on in full-stack development, solution design, code reviews, and technical architecture.
  • Guide development of production-grade generative AI-enabled applications across frontend, backend, AI/machine learning, and data layers.
  • Design and develop scalable backend services, REST APIs, microservices, and integrations required to support AI-powered products.
  • Guide development of modern frontend applications and user experiences that integrate generative AI capabilities into enterprise workflows.
  • Work across frontend technologies such as React/TypeScript or equivalent frameworks, and backend technologies such as Python/Java or equivalent technologies.
  • Guide integration of large language models, AI agents, enterprise APIs, business systems, and data platforms into end-to-end product experiences.
  • Remain hands-on in Python-based generative AI/machine learning development while providing technical direction across the broader application stack.
  • Work with modern cloud-native development stacks, including GitHub-based workflows, containers/Kubernetes, Airflow, continuous integration/continuous delivery, observability, and data pipelines.
  • Promote modern software engineering practices across full-stack, AI, and machine learning development.
  • Remain hands-on in Python-based development, code reviews, and solution design.
  • Guide development of generative AI-enabled features and applied machine learning solutions in a product context.
  • Work with modern cloud-native development stacks, including GitHub-based workflows, Airflow, containerized/Kubernetes-based deployments, and data pipelines.
  • Promote modern software engineering practices across AI/machine learning development.
  • Work closely with the People function and AI Center of Excellence leadership, the Team Builder Product Owner, the Tech Owner, AI engineers, data scientists, and stakeholders across the People function.
  • Partner with product, functional, and technical teams to ensure successful delivery and global adoption of AI solutions.
  • Generally work from a BCG office or in person with clients around 50% of working time, depending on business needs and local policies.

About the Company

Boston Consulting Group

Global strategy and transformation consulting firm

BCG provides global management consulting, advising leaders in strategy and transformation across industries, with expertise in M&A, operations, pricing, sustainability, and AI. BCG X builds AI solutions, digital products, and new ventures by combining engineers, data scientists, designers, and venture builders for clients. Specialist units Inverto, Platinion, and Quantis support procurement, IT architecture, and sustainability, while the BCG Henderson Institute supplies research. The goal is to help clients achieve lasting performance improvements and durable value through strategic advisory plus hands-on technology execution.

Company size
10,001+
Company stage
Not listed
Total funding
Not listed
Headquarters
Boston, MA
Founded
1963

Recently Posted Jobs

Explore more opportunities at Boston Consulting Group

See more jobs