Principal Software Engineer, Infrastructure Platform

Mission: The Infrastructure Platform team’s mission is to design, develop, and deliver high-quality software that enables the provisioning and management of Groq hardware, and related support systems, at a massive scale.

The team: The infrastructure platform team builds the Datacenter Infrastructure Management, inventory management, container & inference orchestration, observability and monitoring, and datacenter operations tooling that all work together in order to support Groq’s inferencing hardware at massive scale. Your mission is to ensure the reliability, scalability, and performance of Groq’s tools and services for provisioning and managing the full lifecycle of Groq hardware and related support systems.

Responsibilities:

• Software Architecture: Design and implement scalable and maintainable systems using advanced system and application architecture patterns and technologies.
• Cloud-Native Development: Develop cloud-native software applications with an agnosticism of programming language and framework.
• API Design and Development: Design and develop APIs that provide a scalable and secure interface for interacting with Groq’s infrastructure. Implement security and authentication, developer tooling and experiences, and instrumentation and observability to make Groq’s API best-in-industry.
• Testing and Validation: Develop and implement automated testing frameworks and test suites to ensure software quality and reliability. Write tests at all levels and scopes of Groq’s systems using best practices and pragmatic, scalable testing philosophy.

Ideal candidates have:

• 10+ years of experience in software engineering
• 5+ years of experience in Kubernetes (on-prem preferred) environments
• Kubernetes-native experience maintaining and managing a Kubernetes clusters, developing custom operators and controllers
• Polyglot language skills with experience in a variety of languages such as Go, Python, Java and Typescript.
• Experience or expertise in tenets of Site Reliability
• Strong knowledge of incident management processes to resolve issues quickly and maintain system uptime.
• Excellent communication and teamwork skills with the ability to collaborate effectively across engineering teams.

Nice to Have:

• Proven DCIM experience to manage and optimize on-prem environments.
• Building datacenter provisioning systems

Attributes of a Groqster:

• Humility - Egos are checked at the door
• Collaborative & Team Savvy - We make up the smartest person in the room, together
• Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
• Curious & Innovative - Take a creative approach to projects, problems, and design
• Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking

If this sounds like you, we’d love to hear from you!

Compensation: At Groq, a competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, the base salary range is $208,800 to $420,400, determined by your skills, qualifications, experience and internal benchmarks.