C

Capital One

Issues credit cards and runs a consumer bank

Applied Researcher 5

Natural Language Processing & LLMsPosted on Nov 10
Full-time

About the Job

Requirements

  • Currently have or be in the process of obtaining a PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or a related field, plus 2 years of Applied Research experience; alternatively, have an MS in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or a related field, plus 4 years of Applied Research experience.
  • Have hands-on experience developing AI foundation models and solutions using open-source tools and cloud computing platforms.
  • Have a deep understanding of the foundations of AI methodologies.
  • Have experience building large deep learning models for language, images, events, or graphs, and expertise in at least one of training optimization, self-supervised learning, robustness, explainability, or RLHF.
  • Demonstrate an engineering mindset through a track record of delivering models at scale in training data and inference volumes.
  • Have experience delivering libraries, platform-level code, or solution-level code to existing products.
  • Have a track record of originating or improving high-quality machine learning ideas, demonstrated by accomplishments such as first-author publications or projects.
  • Be able to own and pursue a research agenda, including selecting impactful research problems and independently carrying out long-running projects.
  • Have a PhD focused on Generative AI (LLMs, diffusion models, or related approaches), or a master's degree with 5 years of industrial research experience in deep learning-based techniques.
  • Have multiple publications at top-tier venues such as KDD, SIGIR, RecSys, NeurIPS, or ICLR on generative recommendation, retrieval-augmented generation, LLM-based agents, or large-scale semantic search.
  • Have been a member of a team that trained a large language model from scratch with 10B+ parameters and 500B+ tokens.
  • Have a PhD focused on geometric deep learning topics such as Graph Neural Networks, Sequential Models, or Multivariate Time Series.
  • Have multiple papers at KDD, ICML, NeurIPS, or ICLR on training models on graph and sequential data structures.
  • Have experience training foundation models from scratch or significantly adapting large-scale models with 10B+ parameters for complex financial data, transactional sequences, or user behavior graphs.
  • Have scaled graph models to more than 50 million nodes and operated in high-velocity, real-time streaming data environments.
  • Have contributed to open-source frameworks such as PyTorch Geometric or DGL.
  • Have proposed new methods for inference or representation learning on graphs or sequences.
  • Have worked with datasets containing more than 100 million users.
  • Have multiple years of experience or publications focused on model sparsification, quantization, training parallelism or partitioning design, or gradient checkpointing for models with 10B+ parameters.
  • Have hands-on experience with large-scale orchestration systems such as Kubernetes or KubeRay, and contributions to common open-source machine learning frameworks such as PyTorch Geometric, DGL, or Hugging Face.
  • Have experience building and deploying deep learning-based recommender systems at scale with 100 million or more users or items, ideally in travel, personalization, or e-commerce contexts.
  • Have a PhD focused on aligning Large Language Models for recommendation and search through Supervised Fine-Tuning, Reinforcement Learning from Human Feedback, or Direct Preference Optimization.
  • Have experience deploying a fine-tuned large language model optimized for serving performance.
  • Have proven ability to design and lead small-scale research initiatives, guiding junior researchers or engineers through experimental design and evaluation.

Responsibilities

  • Partner with data scientists, software engineers, machine learning engineers, and product managers to deliver AI-powered products that change how customers interact with their money.
  • Use technologies including PyTorch, AWS Ultraclusters, Hugging Face, and Lightning to analyze large volumes of numeric and textual data.
  • Build AI foundation models through design, training, evaluation, validation, and implementation.
  • Conduct applied research to apply the latest AI developments to future customer experiences.
  • Translate complex research into tangible business goals.
  • Lead cross-functional research threads connecting prototype model development and deployment with machine learning engineering partners, ensuring research insights translate into production impact.

Desired Qualifications

  • Stay current on state-of-the-art methods, technologies, and applications, and identify opportunities to apply emerging technologies.
  • Contribute to talent development within the team and beyond.

About the Company

Capital One

Issues credit cards and runs a consumer bank

Capital One runs a consumer and commercial bank that issues credit cards, takes deposits, and finances cars and businesses. Its Venture travel cards and Quicksilver cash-back cards let customers earn rewards on everyday spending, while its online banking tools manage payments and savings. Customers use checking and savings accounts through an app, branches, and cash machines, and commercial clients use treasury tools to manage company cash. The bank earns interest on loans and fees from banking and card transactions, with customer deposits helping fund its lending operations. Capital One was founded in 1994 and has its headquarters in McLean, Virginia.

Company size
10,001+
Company stage
IPO
Headquarters
McLean, VA
Founded
1994

Recently Posted Jobs

Explore more opportunities at Capital One

See more jobs