Infrastructure Engineer
MatX
Infrastructure Engineer
MatX
Designs high-throughput AI hardware chips
MatX's mission is to make the world’s best AI models run as efficiently as allowed by physics, bringing the world years ahead in AI quality and availability. We build custom silicon for training and running the world's largest AI models, with hardware/software co-design across ISA, RTL, simulator, compiler, and kernels. The AI tooling team sits across that whole stack and owns the agent harnesses and shared workflows that turn general-purpose coding agents into ones maximally useful on each layer.
Every engineering team using coding agents sits somewhere between watching every command and waking up to agent-written PRs waiting for review. What moves teams along this trust curve is how far engineers can trust their agents' judgment. An agent's judgment is only as good as its context and its ability to verify its work. However, context can be spread all over (think repos, design docs, Slack threads); the builds and simulations an agent needs to check its work may only be available on machines it can’t reach. You'd build infrastructure to address these gaps, at a company small enough your work reaches every engineer.
Make agents legible, first-class users of our infrastructure. Each one gets an identity of its own, reaches exactly what its task needs and nothing else, and leaves a trail a person can later audit.
Build environments for our agents to run in, e.g. short-lived VMs that exist for one task and no-egress sandboxes for long runs.
Build our company agent knowledge base, the context agents start tasks with and the place they go to get more. Pull together information spread across our monorepo, design docs, and Slack and structure it for agent consumption.
Have run production infrastructure somewhere dynamic and know which shortcuts you’ll regret.
Use coding agents heavily and have strong opinions on what you let them do, what you don't, and how you verify their work.
Built engineering workflows (methodology, flow automation, review tooling, agent harnesses) that other engineers adopted and kept.
Notice LLM agents asserting something confidently wrong and modify their harness in response.
Have operated Bazel remote execution or a remote cache.
Are familiar with sandboxing and ephemeral compute for untrusted workloads.
The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job related skills, and relevant education and training. Career length is only a guideline for compensation.
Early Career - $160,000 - $275,000 + equity
Mid Career - $175,000 - $450,000 + equity
Senior Career - $275,000 - $600,000 + equity
What We Offer
Time off: 4 weeks PTO (accrued) + 12 company Holidays + 3 religious observance days
Health:
Medical. Company-subsidized Medical (Kaiser or Anthem) for employees & dependents
Dental + Vision. Guardian Dental and Vision insurances for employee & dependents
HSA and FSA offerings via Lively (HSA includes MatX lump sum contribution)
Concierge Care Advocates via Mishe. A white-glove service to help you navigate the maze of insurance, find providers, file (and appeal) claims
Travel medical insurance. Covers both business and personal trips
MatX Family Fund. $6k fund via Benepass to fill the gaps in traditional insurance. Covers family-building, maternity, menopause, mental health and bodywork.
Financial Wellbeing:
Retirement. Choose from Roth/ 401K (or both) retirement plans with up to 5% company contribution to 401K (even if you don't contribute).
Wealthfront Workplace Accounts. Non-401K investment, high-yield savings & brokerage. MatX pays your fees for the 1st $100K
Life, AD&D and Disability. Company-paid life insurance (up to $300K) and long-term disability insurances.
Daily Meals: MatX provides $80/day budget for onsite and remote meals, via a plethora of options including Webox, Locale, plus Ramp virtual cards.
Commute on Us: Commute on our company Uber account, or reimburse your train rides. Either way, we pay 100% for your daily commute.
WFH Support:
Home Setup. $1500 to make your home office comfortable & productive for you
Cell & Internet Reimbursement. $60/mo for cellular and $60/mo for wifi
Professional Development: $1500 Professional Development Budget (per year)
MatX E[x]tras: $50/mo to use on whatever perk you value most
Mental Wellbeing: 100% paid mental health benefit via SpringHealth and Guardian EAP
Support to Parents: Up to 20 weeks paid parental leave regardless of path to parenthood, up to 18 weeks pregnancy disability leave, and flexible return-to-work hours
As part of our dedication to the diversity of our team and our focus on creating an inviting and inclusive work experience, MatX is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, gender, gender identity, gender expression, sexual orientation, age, physical or mental disability, medical condition, marital/domestic partner status, military and veteran status, genetic information or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances.
---------
This position requires access to information that is subject to U.S. export controls. This offer of employment is contingent upon the applicant's capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.
--------
MatX does not accept unsolicited resumes from individual recruiters or third-party recruiting agencies in response to job postings. No fee will be paid to third parties who submit unsolicited candidates directly to our hiring managers or People team and any resumes submitted are deemed to be the property of MatX.
MatX builds high-throughput AI accelerators for large language models. Its main product is a dedicated chip where every transistor is optimized for running large neural networks, aiming to deliver strong performance for training and inference of LLMs. The company also develops the surrounding software stack, including compilers, to make the hardware easy to program for ML engineers (e.g., through JAX-based workflows). Unlike general-purpose processors, MatX focuses on specialization and full-stack optimization from silicon to software. Its goal is to enable organizations with substantial AI workloads to scale efficiently by providing powerful, purpose-built hardware and the compatible software tools they need to deploy and optimize large models.
Explore more opportunities at MatX