C

Capital One

Issues credit cards and runs a consumer bank

AI Engineer 4

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeIn-person

About the Job

Requirements

  • A Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 4 years of experience developing AI and machine-learning algorithms or technologies, or a Master's degree in one of those fields plus at least 2 years of such experience.
  • At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how associates work and how customers interact with the company.
  • Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Use open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
  • Invent and introduce foundation-model optimization techniques to improve the scalability, cost, latency, and throughput of large-scale production AI systems.
  • Contribute to the technical vision and long-term roadmap of foundational AI systems.
  • Own end-to-end architecture for complex AI systems, ensuring maintainability, observability, and ethical alignment.
  • Define and maintain service-level objectives for AI reliability, including latency, uptime, and model-performance drift.
  • Collaborate with infrastructure engineering to optimize GPU and TPU utilization and accelerate model-inference pipelines.
  • Lead cross-functional technical reviews for new AI-system deployments, ensuring security, data governance, and compliance standards are met.
  • Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.

Desired Qualifications

  • Experience leading development of AI systems with trade-off decisions around cost, latency, throughput, and accuracy.
  • At least 6 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • Experience designing, developing, delivering, and supporting AI services.
  • Experience developing AI and machine-learning algorithms or technologies, such as large language model inference, similarity search and vector databases, guardrails, and memory, using Python, C++, C#, Java, CUDA, or Golang.
  • Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
  • Experience building agentic AI systems and workflows.
  • Passion for staying abreast of the latest AI research and AI systems, and applying novel techniques in production.
  • Proficiency in designing distributed systems for model training, evaluation, and online inference at petabyte scale.
  • Experience defining AI model-governance processes, including producibility, lineage tracking, and automated retraining schedules.
  • Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms.

About the Company

Capital One

Issues credit cards and runs a consumer bank

Capital One runs a consumer and commercial bank that issues credit cards, takes deposits, and finances cars and businesses. Its Venture travel cards and Quicksilver cash-back cards let customers earn rewards on everyday spending, while its online banking tools manage payments and savings. Customers use checking and savings accounts through an app, branches, and cash machines, and commercial clients use treasury tools to manage company cash. The bank earns interest on loans and fees from banking and card transactions, with customer deposits helping fund its lending operations. Capital One was founded in 1994 and has its headquarters in McLean, Virginia.

Company size
10,001+
Company stage
IPO
Headquarters
McLean, VA
Founded
1994

Recently Posted Jobs

Explore more opportunities at Capital One

See more jobs