A

Amazon

Sells products online and rents cloud computing

Software Development Engineer 1 - Inference models optimization, AWS Neuron Inference

Natural Language Processing & LLMsPosted on Nov 11
Full-timeCupertino, CA, USAIn-person

About the Job

Requirements

  • Experience with data structure implementation, basic algorithm development, and/or object-oriented design principles.
  • Currently have, or be in the process of obtaining, a Bachelor's degree or above in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Experience with a programming language such as Python, Java, or C++.

Responsibilities

  • Optimize open models to run best on Trainium, including optimizing sharding, developing NKI kernels, and ensuring accuracy.
  • Collaborate with cross-disciplinary teams that may include hardware design, firmware, compiler, runtime, and machine learning engineers to develop software that enables and optimizes custom machine learning accelerator silicon.
  • Write clean, maintainable code in C, C++, Python, or Rust following best practices for systems-level and performance-critical development.
  • Participate in code reviews, contribute to technical documentation, and help deploy agentic tools to accelerate the enablement of new models on Trainium.
  • Monitor, debug, and resolve issues across hardware-software integration boundaries, including on-call responsibilities.
  • Keep learning emerging technologies in machine learning accelerators, compiler optimization, computer architecture, and cloud-scale distributed systems.

Desired Qualifications

  • Experience from previous technical internships or demonstrated project experience.
  • Experience with one or more of compiler design or optimization, computer architecture, hardware simulation or emulation, machine learning frameworks such as PyTorch or JAX, performance profiling and analysis, Linux kernel or embedded systems, artificial intelligence tools for development productivity, cloud platforms (preferably AWS), or version control systems.
  • Ability to debug across hardware-software boundaries.
  • Ability to learn and adapt to new technologies quickly.

About the Company

Amazon

Sells products online and rents cloud computing

Amazon runs the largest online store in the United States and rents cloud computing to businesses and governments through Amazon Web Services. AWS pioneered renting computing power over the internet, and Amazon built its own delivery network to get orders to customers quickly. Shoppers buy from Amazon and from independent sellers on its store, and Prime members pay a subscription for fast free shipping, streaming video and music, and other perks. AWS rents out computing power, storage, databases, and AI tools so companies can run software without owning servers, and Amazon also makes Kindle e-readers and Echo speakers with the Alexa assistant. Jeff Bezos founded Amazon in 1994, and it is based in Seattle, Washington.

Company size
10,001+
Company stage
IPO
Headquarters
Seattle, WA
Founded
1994

Recently Posted Jobs

Explore more opportunities at Amazon

See more jobs