A

Amazon

Sells products online and rents cloud computing

Software Developer Engineer 2 - Stores Foundational AI-SFAI

Natural Language Processing & LLMsPosted on Nov 17
Full-timeIn-person

About the Job

Requirements

  • At least 3 years of non-internship professional software development experience.
  • At least 2 years of non-internship experience in the design or architecture of new and existing systems, including design patterns, reliability, and scaling.
  • Experience programming in at least one software programming language.
  • Knowledge of machine learning and large language model fundamentals, including transformer architecture, training and inference lifecycles, and optimization techniques.

Responsibilities

  • Design and implement a stable, efficient training system for model training and reinforcement learning that scales to various model sizes and architectures.
  • Collaborate with applied scientists and engineers to improve training efficiency and reliability and accelerate innovation.
  • Optimize inference to improve model latency and throughput.
  • Design and implement scalable data infrastructure to handle large-scale data ingestion, processing, and delivery across training and evaluation stages.
  • Learn and adopt state-of-the-art technologies and algorithms in generative artificial intelligence.

Desired Qualifications

  • Knowledge of machine learning frameworks, including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT.
  • Experience in embedded development using C or C++, or experience with CUDA kernels or machine learning/low-level kernels.
  • Experience with the software development lifecycle, or experience training and deploying machine learning systems to solve large-scale optimization problems.

About the Company

Amazon

Sells products online and rents cloud computing

Amazon runs the largest online store in the United States and rents cloud computing to businesses and governments through Amazon Web Services. AWS pioneered renting computing power over the internet, and Amazon built its own delivery network to get orders to customers quickly. Shoppers buy from Amazon and from independent sellers on its store, and Prime members pay a subscription for fast free shipping, streaming video and music, and other perks. AWS rents out computing power, storage, databases, and AI tools so companies can run software without owning servers, and Amazon also makes Kindle e-readers and Echo speakers with the Alexa assistant. Jeff Bezos founded Amazon in 1994, and it is based in Seattle, Washington.

Company size
10,001+
Company stage
IPO
Headquarters
Seattle, WA
Founded
1994

Recently Posted Jobs

Explore more opportunities at Amazon

See more jobs