Senior Systems Development Engineer - Generative AI & ML Servers, Hardware Engineering

Description

Do you want to build the backbone of Generative AI cloud at AWS? Do you want to build the future of the cloud for AI training and inference? Want to do industry leading work delivering continuous price performance improvements in the cloud for AI model training for multi billion variable LLMs? Come Join us in designing, delivering and operating AWS cloud offerings that enable high performance and scalability in AI/ML and HPC workloads.

You are intrigued by the continuous release of newer AWS services and instance types that solve newer, bigger and more interesting business problems every day? Does that make you wish your talents were applied to those at cloud scale? If yes, then come join us - we are looking for builders like you.

The AWS Hardware Engineering team creates server designs for Amazon’s innovative web services. Our designs are industry-leading in frugality and operational excellence, and are critical to the success of the AWS business and millions of customers who use AWS today. Our engineers solve challenging technology problems, and build architecturally sound, high-quality components to enable AWS to realize critical business strategies. What makes this role unique is your direct impact on AI-powered innovation - you’ll be building intelligent systems that drive the debug and development of next-generation cloud technologies.

The ideal candidate for this role will be an innovative self-starter. You are knowledgeable of the full technical stack - vertically from baremetal server hardware up to the software in userland, and everything in the middle. You have tremendous interest in cloud scale and curious how systems and software decisions impact the user. You insist on highest-standards and are able to develop tactical solutions/tools to diagnose and fix issues. You are an excellent systems debugger - finding interaction issues between components on server systems. You are a leader with strong organizational, planning, and communication skills. You are a builder!

What you will do?

You will work with engineers across the company for delivering the next-generation AWS platforms. You will have a direct impact on our bottom line and the ability to deliver improvements for AWS. You will be part of a growing, fast paced, and fun team. You will have ownership for the implementation of your work. You will see direct product improvements based on the results of your work.

AWS Engineers are shaping the way people use computers and designing the future of cloud computing technology – come help us make history!

Why it matters?

Public cloud IT services represent the majority of growth in the overall IT services market and will continue to do so for several years to come. The scale of AWS, combined with an understanding of how our software and hardware is used, creates a unique opportunity for component customizations that will directly benefit our customers.

Why you will love it?

You will work with engineers across the company for delivering the next-generation AWS platforms. You will have a direct impact on our bottom line and the ability to deliver improvements for AWS. You will be part of a growing, fast paced, and fun team. You will have ownership for the implementation of your work. You will see direct product improvements based on the results of your work.

You’ll work at the fascinating intersection of AI driven automation and cloud platform development, implementing automation solutions that directly enhance the productivity of our engineers. Unlike typical roles, you’ll have the opportunity to influence both AI implementation and core architecture while collaborating with cloud technology experts.

AWS Infrastructure Services (AIS) owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain — and we’re looking for talented people who want to help.

You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you’ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.



Key job responsibilities
You will be a technical leader solving complex architectural problems which may not defined before hand. You will be owning the teams systems and work proactively in identifying deficiencies, writing tactical code to solve issues before they impact customers, and working with your team to scale the solution. You will decompose big difficult server system testability, reliability and diagnosis problems into straightforward tasks, components or features that you will lead to deliver yourself and through others in parallel. You will use combination of hardware, software, system designs, x86 architecture, processes, diagnosis and operations knowledge.

In this role you will create automation through agentic workflows. You’ll develop smart automation solutions, implement AI-driven tools and workflows and be part of AI transformation.

A day in the life
Working with a variety of job roles (SDEs, SDETs, Hardware Engineers, TPMs, Managers, Principals) and groups (AWS Hardware Engineering, EC2, other AWS services) through server conception, test, launch, and operations. Driving high quality and reliability into future/new designs for AWS Accelerated server solutions for AWS Cloud.

About the team
We are the builders of AWS backbone (server) infrastructure. The team gets involved in early NPI phase for Accelerators for AWS cloud servers, and continues through launch and thereafter. Our software, services and automation are critical in design, EC2 instance build yields, launch go/no-go decisions, and fleet health thereafter. We build process automation systems to improve efficiency across the board.

About AWS

Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

Why AWS?
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Inclusive Team Culture
Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

Mentorship & Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.

Basic Qualifications

- 4+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby experience
- 3+ years of non-internship professional software development experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- Experience with x86 architecture, as well as ARM, and GPU/ FPGA devices
- Experience with modern technology devices in storage, network, memory as well as a variety of interface standards and protocols (I2C, IPMI, SPI, PCIe)
- BS degree in Computer Science, Computer Engineering, or other technical degree, or relevant work experience

Preferred Qualifications

- 7+ years or more in software development, systems development, SRE (Site Reliability Engineering), or Resilience Engineering
- 7+ years of SysDE (Systems Development Engineer) or equivalent experience
- 7+ years of server systems debug experience; debugging and root causing complex server platforms
- 7+ years of experience contributing towards increasing durability, security, availability and scalability of systems through exploration, diagnosis and remediation
- Linux kernel and user-space drivers experience for PCIe and external devices
- System thinking - ability to diagnose interactions between discrete components of server system and drive product improvements.
- Strong focus on reliability, scale and diagnostics (including developing tactical and strategic tools using Python, Go, C/C++ or any other suitable high level language)
- Solid understanding of OS internals, including network and storage subsystem
- Master’s degree in Electrical Engineering, Computer Engineering, or related field
- Experience with modern technology devices in storage, network, memory as well as a variety of interface standards and protocols (PCIe, SATA, SAS, NVMe)
- Experience with validation of hardware, software, firmware and drivers and implementing test plans
- Experience with server validation, testing, issue root causing and coverage analysis
- Excellent knowledge diagnostics tools development with Python, Go, or C/C++ in fast paced environment
- Extensive Linux knowledge

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.