E

Ernst & Young

Provides consulting, assurance, and tax services

Service Delivery Center - AI & Data, AI Developer, Manager

AI Application EngineeringUpdated on Nov 14
Full-time$76.2k - $197.9kIn-person

About the Job

Requirements

  • A bachelor's or master's degree is required.
  • At least 6 years of applied engineering experience, including significant experience in AI/ML engineering roles.
  • Ability to explain complex AI system behavior and trade-offs to technical and non-technical stakeholders, including risk and compliance.
  • Ownership and accountability for AI systems from design through production and issue resolution.
  • Ability to work cross-functionally with engineering, product, risk, legal, and audit teams.
  • Ability to understand complex technical challenges across banking, capital markets, insurance, and asset management and translate them into LLM-powered solutions that deliver measurable business value.
  • Practical experience leading and managing multidisciplinary teams through the full AI product lifecycle, including requirements, architecture, build, evaluation, and production handoff.
  • Experience managing and mentoring teams of AI engineers and data scientists through specific business use cases, ensuring technical quality and delivery consistency across engagements.
  • Advanced hands-on software engineering proficiency in Python, with the ability to guide implementation decisions and architecture across delivery teams.
  • Experience delivering production-grade LLM applications, including retrieval-augmented systems, agentic orchestration layers, and structured output pipelines at enterprise scale, using tools such as LlamaIndex, LangChain, Azure OpenAI, or AWS Bedrock.
  • Knowledge of embedding models, vector search, semantic retrieval, and NLP similarity systems used in enterprise RAG and knowledge AI architectures, including OpenAI Embeddings, Cohere Embed, Azure AI Search, and FAISS.
  • Expertise in LLM operations practices, including model lifecycle management, versioning, continuous integration and continuous deployment for AI systems, deployment governance, and production improvement loops, using tools such as MLflow, Azure ML, GitHub Actions, or Kubeflow.
  • Experience with agentic system architecture, including multi-agent orchestration, tool-use patterns, memory design, and human-in-the-loop workflows for production environments, using tools such as LangGraph, AutoGen, Semantic Kernel, CrewAI, or NVIDIA NIM.
  • Experience governing agent behavior in production, including audit trail design, cost and latency controls, and reliability management across multi-agent pipelines.
  • Experience defining and governing LLM evaluation frameworks across teams and engagements to measure output quality, safety, and alignment with business requirements, using tools such as RAGAS, DeepEval, Arize, or Weights & Biases.
  • Ability to improve performance, resilience, maintainability, and cost efficiency in deployed LLM and agentic systems, including post-deployment optimization and operational tuning.
  • Knowledge of MLOps practices for continuous integration and continuous deployment of AI systems in cloud environments, including containerization and orchestration for scalable and secure LLM deployment, using tools such as Azure DevOps, GitHub Actions, Kubeflow, or MLflow.
  • Experience governing API design standards for LLM and agentic systems, including contract design, versioning, error handling, retry semantics, and decoupling AI service consumers from internal model and workflow topology.
  • System design capability across service boundaries, asynchronous workflows, data contracts, cloud-native patterns, and secure deployment models for AI-enabled applications.
  • Proficiency in containerization and orchestration for deploying and managing scalable LLM applications in production cloud environments, using tools such as Docker, Kubernetes, Azure Container Apps, or AWS ECS.
  • Ability to collaborate with data engineers, ML engineers, and business stakeholders to align LLM solution design with enterprise data and technology constraints.

Responsibilities

  • Manage design, development, testing, deployment, and support for production-grade AI/ML, generative AI, and intelligent automation solutions.
  • Manage complex technical problems through coding, debugging, testing, troubleshooting, and structured design remediation.
  • Manage the build and integration of LLM, RAG, and agentic solution components into enterprise applications and platforms.
  • Contribute to system design across service boundaries, orchestration layers, data flows, security controls, and external integrations.
  • Lead workstreams or project delivery through planning, coordination, execution oversight, issue management, and stakeholder communication.
  • Drive engineering quality through coding standards, CI/CD practices, automated testing, observability, and documentation.
  • Partner with Development, Engineering, Product, Data, Architecture, and engagement leadership teams to deliver AI capabilities.
  • Improve the performance, resilience, maintainability, and cost efficiency of deployed AI systems.
  • Participate in architecture and design reviews, providing trade-off analysis and implementation guidance.
  • Use modern AI-assisted software engineering tools such as Claude Code, Codex, or equivalent agentic coding platforms in delivery leadership and engineering execution.

Desired Qualifications

  • Advise clients on AI platform and infrastructure strategy, including model access layer selection, build-versus-buy decisions, and integration with existing data and technology infrastructure, using platforms such as Azure OpenAI, AWS Bedrock, Google Vertex AI, NVIDIA AI Enterprise, or Hugging Face.
  • Quantify business improvements resulting from LLM solutions through evaluation metrics, performance benchmarks, and client-facing reporting.
  • Design and govern model observability and monitoring strategies across engagements, covering output quality, behavioral drift, and multi-step agentic workflow tracing, using tools such as LangSmith, Arize, Datadog, or Azure Monitor.
  • Understand LLM fine-tuning methodologies and advise clients on their use, including data preparation, training approaches, and post-training evaluation, using methods and tools such as LoRA, QLoRA, PEFT, or NeMo Framework.
  • Lead controlled model rollout programs, including shadow deployment, A/B testing, canary releases, stakeholder sign-off, and defined rollback criteria.
  • Understand LLM-specific AI security risks, including prompt injection, data poisoning, and model extraction, and advise on mitigation and audit trail requirements.
  • Understand bias, fairness, and explainability approaches and their application in financial services AI systems.
  • Understand system design principles for AI, including scalability, fault tolerance, and distributed architecture for production AI workloads.
  • Understand data pipeline architecture for enterprise AI workloads, including ingestion, transformation, and governance.
  • Understand data security and privacy best practices in cloud environments as applied to LLM application development and deployment.
  • Be familiar with AI-assisted software engineering tools such as Claude Code, GitHub Copilot, or Codex as part of delivery leadership and engineering execution.
  • Be familiar with GPU-accelerated AI workloads and cloud AI services for model inference and deployment at scale, including NVIDIA GPU platforms, Azure ML, or AWS SageMaker.
  • Be familiar with agile and modern engineering delivery methodologies as applied to AI/ML initiatives.

About the Company

Ernst & Young

Provides consulting, assurance, and tax services

EY (Ernst & Young) is a global professional services firm that provides consulting, assurance, tax, and transaction advisory services across industries such as energy, healthcare, financial services, and real estate. Its work centers on helping clients solve critical business challenges by offering high-value advisory support in areas like supply chain, cybersecurity, sustainability, and digital transformation; revenue comes from fees for consulting, audit, and advisory services. What sets EY apart is its breadth of services across multiple disciplines, deep industry knowledge, and emphasis on thought leadership and research to inform clients’ strategic decisions. The firm aims to help organizations improve operational efficiency, navigate regulatory environments, and stay ahead of market trends by delivering practical, evidence-based guidance and execution support.

Company size
10,001+
Company stage
Not listed
Total funding
Not listed
Headquarters
Boston, MA
Founded
1991

Recently Posted Jobs

Explore more opportunities at Ernst & Young

See more jobs