Our background
Letta is a company founded around the MemGPT project (13k+ GitHub stars). The founding team comes from the same research lab and PhD advisors at Berkeley that produced Spark (→ Databricks) and Ray (→ Anyscale). We have deep expertise in both AI and systems, are currently hiring a founding team of exceptional engineers to join us in building the next generation of LLM agent technology.
👾 You can read more about Letta on TechCrunch and our blog.
At Letta, we are building the platform for stateful agents. Letta agents are designed as services with a granular REST API enabling developers to easily integrate agents into their end applications. Letta’s OSS framework allows developers to create stateful agents with memory and reasoning, while Letta Cloud (currently in a private beta) makes it possible to deploy agent services with zero infrastructure. We believe that in the future, AI applications will be built with stateful agent services, rather than stateless LLM services.
As a platform engineer at Letta, you’ll work cross functionally both as a software engineer on backend services and infrastructure engineer maintaining configuration and deployment. You will be responsible for ensuring the stability, security, and scalability of Letta’s agent services. You will build out Letta’s cloud infrastructure. You will also work closely with enterprise customers for on-prem / BYOC deployments of Letta, and build out systems for managing monitoring and updates across deployments.
Responsibilities:
Develop Letta’s agent API services
Engineer and maintain Letta’s cloud infrastructure
Build out observability and logging for Letta services
Develop and maintain on-prem / BYOC deployments for enterprise customers
Manage CI/CD pipelines for deployment and testing
Skills:
Strong Python (or Typescript) programming skills
Experience working with and building backend services
Proficiency with cloud infrastructure (AWS, Azure, GCP) with an understanding of cloud networking, security, and cost optimization
Experience with IaC (Terraform)
Experience Kubernetes and familiarity with K8 deployment and configuration (e.g. Helm charts, configuring auto-scaling)
Familiarity with observability and monitoring tools such as Sentry, Prometheus, Grafana, or other similar technologies
Understanding of SQL databases (specifically Postgres), such as database indexing and performance tuning
You will be a strong fit for this role if:
You empathize with developers and understand the important of reliability for the services they build on top of
You know how to prioritize when there are a million things you wish you could fix, and are comfortable working with imperfect systems
You’re excited about working with agents and helping developers build the next generation of AI applications
Our hiring process
We are hiring a small, tight-knit team of exceptionally talented founding engineers. Every hire matters, so we take the hiring process very seriously.
Initial phone interview (30m video call): We want to learn more about your background, your skills, your opinions on open source AI, and why you want to work at an early stage AI startup.
Technical take-home (<1hr assessment): To get a better sense of your skillset, we’ll give you an example problem to work that’s as targeted to your potential day-to-day work as possible.
Paid workday (in-person recommended): As the final step in the interview process, we’ll simulate working together as closely as possible by giving you a real (or as close to real as possible) task to work on for a day - and paying for your time of course. If you live in the Bay Area, we highly recommend visiting our offices in-person! We’re an in-person company, so working at our office will give you a great idea of what it will be like to join as a full-time member of the team.