C

Capital One

Issues credit cards and runs a consumer bank

Applied Researcher 4 - AI Foundations, LLM Core and Agentic AI

AI Research +1Confirmed live in the last 24 hours
Full-timeIn-person

About the Job

Requirements

  • Currently has or is in the process of obtaining a PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or a related field; the degree may be obtained on or before the scheduled start date. Alternatively, a Master's degree in one of these fields plus two years of applied research experience is required.
  • Has a deep understanding of the foundations of AI methodologies.
  • Has experience building large deep learning models for language, images, events, or graphs, and expertise in one or more of training optimization, self-supervised learning, robustness, explainability, or reinforcement learning from human feedback.
  • Has a track record of delivering models at scale in terms of both training data and inference volumes.
  • Has experience delivering libraries, platform-level code, or solution-level code to existing products.
  • Has a track record of high-quality ideas or improvements in machine learning, demonstrated by accomplishments such as first-author publications or projects.
  • Can own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out long-running projects.
  • Can reproduce and extend peer-reviewed AI research using modern open-source frameworks.
  • Has experience designing controlled experiments and documenting reproducibility results for internal or public research.

Responsibilities

  • Partners with data scientists, software engineers, machine learning engineers, and product managers to deliver AI-powered products that change how customers interact with their money.
  • Uses technologies including PyTorch, AWS Ultraclusters, Hugging Face, and Lightning to uncover insights in large volumes of numeric and textual data.
  • Builds AI foundation models through design, training, evaluation, validation, and implementation.
  • Conducts applied research to translate emerging AI developments into new customer experiences.
  • Translates the complexity of the work into tangible business goals.
  • Collaborates with senior researchers to prepare internal technical reports or conference submissions summarizing novel methods or findings.

Desired Qualifications

  • PhD in Computer Science, Machine Learning, Computer Engineering, Applied Mathematics, Electrical Engineering, or a related field.
  • For LLM research: PhD focus on natural language processing, or a Master's degree with five years of industrial natural language processing research experience.
  • Multiple publications on large language model pre-training, such as technical reports on pre-trained LLMs, self-supervised learning techniques, or model pre-training optimization.
  • Membership on a team that trained a large language model from scratch with 10 billion or more parameters and 500 billion or more tokens.
  • Publications in deep learning theory or at ACL, NAACL, EMNLP, NeurIPS, ICML, or ICLR.
  • For training and inference optimization: PhD focus on optimizing training of very large deep learning models.
  • Multiple years of experience and/or publications in model sparsification, quantization, training parallelism or partitioning design, gradient checkpointing, or model compression.
  • Experience optimizing training for a model with 10 billion or more parameters.
  • Deep knowledge of deep learning algorithmic or optimizer design.
  • Experience with compiler design.
  • For fine-tuning: PhD focus on guiding LLMs with further tasks, including supervised fine-tuning, instruction-tuning, dialogue fine-tuning, or parameter tuning.
  • Knowledge of transfer learning, model adaptation, and model guidance principles.
  • Experience deploying a fine-tuned large language model.
  • Publications studying tokenization, data quality, dataset curation, or labeling.
  • Contribution to a major open-source corpus.
  • Contribution to open-source libraries for data quality, dataset curation, or labeling.

About the Company

Capital One

Issues credit cards and runs a consumer bank

Capital One runs a consumer and commercial bank that issues credit cards, takes deposits, and finances cars and businesses. Its Venture travel cards and Quicksilver cash-back cards let customers earn rewards on everyday spending, while its online banking tools manage payments and savings. Customers use checking and savings accounts through an app, branches, and cash machines, and commercial clients use treasury tools to manage company cash. The bank earns interest on loans and fees from banking and card transactions, with customer deposits helping fund its lending operations. Capital One was founded in 1994 and has its headquarters in McLean, Virginia.

Company size
10,001+
Company stage
IPO
Headquarters
McLean, VA
Founded
1994

Recently Posted Jobs

Explore more opportunities at Capital One

See more jobs