C

Capital One

Issues credit cards and runs a consumer bank

Applied Researcher 5

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeIn-person

About the Job

Requirements

  • Currently have or be in the process of obtaining a PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or a related field, plus two years of experience in Applied Research; alternatively, have an MS in those fields plus four years of experience in Applied Research.
  • Have hands-on experience developing AI foundation models and solutions using open-source tools and cloud computing platforms.
  • Have a deep understanding of the foundations of AI methodologies.
  • Have experience building large deep learning models in language, images, events, or graphs, and expertise in one or more of training optimization, self-supervised learning, robustness, explainability, or reinforcement learning from human feedback.
  • Have a track record of delivering models at scale in terms of training data and inference volumes.
  • Have experience delivering libraries, platform-level code, or solution-level code to existing products.
  • Have a track record of producing high-quality ideas or improving existing ideas in machine learning, demonstrated through accomplishments such as first-author publications or projects.
  • Be able to own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out long-running projects.

Responsibilities

  • Partner with data scientists, software engineers, machine learning engineers, and product managers to deliver AI-powered products that change how customers interact with their money.
  • Use technologies including PyTorch, AWS Ultraclusters, Hugging Face, and Lightning to uncover insights in large volumes of numeric and textual data.
  • Build AI foundation models through design, training, evaluation, validation, and implementation.
  • Conduct applied research to advance AI developments into new customer experiences.
  • Translate complex research into tangible business goals.
  • Lead cross-functional research threads connecting prototype model development and deployment with machine learning engineering partners, ensuring research insights have production impact.

Desired Qualifications

  • Continually research and evaluate emerging technologies, stay current on published state-of-the-art methods, technologies, and applications, and identify opportunities to apply them.
  • Proven ability to design and lead small-scale research initiatives, guiding junior researchers or engineers through experimental design and evaluation.
  • For large language model research: PhD focus on natural language processing, or a Master's degree with five years of industrial natural language processing research experience.
  • Multiple publications on large language model pre-training, such as technical reports on pretrained large language models, self-supervised learning techniques, or model pre-training optimization.
  • Membership on a team that trained a large language model from scratch with 10 billion or more parameters and 500 billion or more tokens.
  • Publications in deep learning theory or at ACL, NAACL, EMNLP, NeurIPS, ICML, or ICLR.
  • For training and inference optimization: PhD focus on optimizing the training of very large deep learning models.
  • Multiple years of experience or publications in model sparsification, quantization, training parallelism or partitioning design, gradient checkpointing, or model compression.
  • Experience optimizing training for a model with 10 billion or more parameters.
  • Deep knowledge of deep learning algorithmic or optimizer design.
  • Experience with compiler design.
  • For fine-tuning: PhD focus on guiding large language models with further tasks, including supervised fine-tuning, instruction tuning, dialogue fine-tuning, or parameter tuning.
  • Demonstrated knowledge of transfer learning, model adaptation, and model guidance.
  • Experience deploying a fine-tuned large language model.

About the Company

Capital One

Issues credit cards and runs a consumer bank

Capital One runs a consumer and commercial bank that issues credit cards, takes deposits, and finances cars and businesses. Its Venture travel cards and Quicksilver cash-back cards let customers earn rewards on everyday spending, while its online banking tools manage payments and savings. Customers use checking and savings accounts through an app, branches, and cash machines, and commercial clients use treasury tools to manage company cash. The bank earns interest on loans and fees from banking and card transactions, with customer deposits helping fund its lending operations. Capital One was founded in 1994 and has its headquarters in McLean, Virginia.

Company size
10,001+
Company stage
IPO
Headquarters
McLean, VA
Founded
1994

Recently Posted Jobs

Explore more opportunities at Capital One

See more jobs