B

Baseten

Runs AI models for production software

Software Engineer - Infrastructure

Platform EngineeringConfirmed live in the last 24 hours
Full-timeHybrid

About the Job

Requirements

  • A bachelor's degree or higher in Computer Science or a related field is required.
  • Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus.
  • Working knowledge of Kubernetes and containerization is required.
  • A basic understanding of machine learning concepts and model serving is required.
  • Familiarity with distributed systems concepts is required.
  • Experience with basic monitoring and logging tools is required.
  • Interest in machine learning and artificial intelligence infrastructure and willingness to learn are required.
  • Strong collaboration and communication skills are required.

Responsibilities

  • Develop infrastructure components for the machine learning inference platform using Python and Go.
  • Implement and maintain Kubernetes deployments for model serving.
  • Contribute to the inference orchestration layer for model deployments.
  • Build and enhance monitoring systems for model performance metrics.
  • Implement efficient resource management solutions for machine learning workloads.
  • Support infrastructure automation to improve machine learning deployment workflows.
  • Work closely with team members to implement technical solutions.
  • Help balance performance optimization with system reliability.
  • Participate in technical discussions around infrastructure improvements.
  • Learn and apply infrastructure best practices.

Desired Qualifications

  • Go proficiency is a plus.

About the Company

Baseten

Runs AI models for production software

Baseten runs AI models for software companies that need fast, reliable responses inside their products, from text generation to speech and image processing. Its Inference Stack combines optimized model runtimes with infrastructure that deploys, serves, and monitors custom or open models in production. Teams package models with its open source Truss tool, while Model APIs let developers test ready-to-use models and Training runs jobs that adapt models to their own data. Customers pay for computing time or tokens processed, with negotiated plans for larger deployments and support needs. Baseten was founded in 2019 and is headquartered in San Francisco.

Company size
201-500
Company stage
Series F
Total funding
$2.1B
Headquarters
San Francisco, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Baseten

See more jobs