C

Capital One

Issues credit cards and runs a consumer bank

Staff AI Engineer

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • A Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 8 years of experience developing AI and machine learning algorithms or technologies; or a Master's degree in those fields, plus at least 6 years of that experience.
  • At least 8 years of programming experience with Python, Go, Scala, CUDA, or Java.
  • Experience designing AI systems and making tradeoff decisions involving cost, latency, throughput, and accuracy.
  • Eight or more years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
  • Experience developing AI and machine learning algorithms or technologies, such as large language model inference, similarity search, vector databases, guardrails, and memory, using Python, C++, C#, Java, CUDA, or Golang.
  • Experience developing and applying state-of-the-art techniques to optimize training and inference software for hardware utilization, latency, throughput, and cost.
  • Experience building agentic AI systems and agentic workflows.
  • Experience defining and operationalizing enterprise AI architecture standards, including data pipeline governance, observability, and evaluation frameworks.
  • Experience leading federated or multi-cloud AI strategies to maximize resilience, compliance, and compute efficiency.
  • Experience influencing research-to-production promotion processes, including guiding model handoff, evaluation, and productization.
  • Experience defining north-star metrics for AI systems that balance business value, innovation velocity, cost, and ethical responsibility.
  • Experience right-sizing models, instance counts, and hardware types based on requirements such as context length, token inputs, and token outputs.

Responsibilities

  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
  • Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
  • Invent and introduce foundation-model optimization techniques that improve the scalability, cost, latency, and throughput of large-scale production AI systems.
  • Contribute to the technical vision and long-term roadmap for foundational AI systems.
  • Set technical direction for enterprise-wide AI architecture, unifying tooling, observability, and deployment standards across teams.
  • Own the design and integration of model routing, caching, and orchestration systems supporting hybrid and multi-model workloads.
  • Champion responsible AI principles in system design, embedding transparency, reproducibility, and fairness by design.
  • Drive internal education, mentorship, and dissemination of best practices through architecture councils and AI guilds.

Desired Qualifications

  • Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the vice president level.
  • Passion for staying current with AI research and AI systems, and applying novel techniques in production.
  • Ability to articulate complex AI concepts to peers through communication and presentations.

About the Company

Capital One

Issues credit cards and runs a consumer bank

Capital One runs a consumer and commercial bank that issues credit cards, takes deposits, and finances cars and businesses. Its Venture travel cards and Quicksilver cash-back cards let customers earn rewards on everyday spending, while its online banking tools manage payments and savings. Customers use checking and savings accounts through an app, branches, and cash machines, and commercial clients use treasury tools to manage company cash. The bank earns interest on loans and fees from banking and card transactions, with customer deposits helping fund its lending operations. Capital One was founded in 1994 and has its headquarters in McLean, Virginia.

Company size
10,001+
Company stage
IPO
Headquarters
McLean, VA
Founded
1994

Recently Posted Jobs

Explore more opportunities at Capital One

See more jobs