O

Otter.ai

Builds AI assistants that capture meeting notes

Engineering Director - Infrastructure

Engineering LeadershipConfirmed live in the last 24 hours
Full-timeMountain View, CA, USA$244k - $313k /yrHybrid

About the Job

Requirements

  • A bachelor's degree or higher in Computer Science or a related technical field.
  • At least 10 years of software development or engineering experience, including at least 4 years of engineering management experience.
  • Significant experience leading infrastructure, DevOps, site reliability engineering, or platform teams responsible for production systems at scale.
  • Deep experience designing and operating highly available, fault-tolerant distributed systems.
  • Strong knowledge of AWS and cloud-native infrastructure, including Kubernetes/EKS, EC2, Auto Scaling Groups, load balancing, networking, storage, IAM, monitoring, and infrastructure-as-code technologies such as Terraform.
  • Deep understanding of MySQL operations, including performance, replication, clustering, backup, and disaster recovery.
  • Strong knowledge of asynchronous architectures, including message queues, worker systems, retries, idempotency, and failure recovery.
  • Experience building strong production reliability practices, including observability, incident management, on-call operations, disaster recovery, multi-region architectures, and zero-downtime migrations.
  • A track record of materially improving cloud efficiency and infrastructure unit economics without compromising reliability or performance.
  • Experience operating latency-sensitive, high-throughput AI inference workloads in production.
  • Experience scaling infrastructure to support rapid product and customer growth, including self-serve products and enterprise customers with demanding security, reliability, and compliance requirements.
  • Ability to move effectively between architecture, operational data, financial analysis, organizational design, and executive communication, with strong cross-functional influence.
  • Ability to use AI-assisted engineering and operational tools to improve team productivity, incident response, diagnostics, and infrastructure management.
  • Familiarity with relevant application technologies such as Python, Django, FastAPI, and WebSockets.

Responsibilities

  • Own the architecture and operation of cloud, compute, networking, database, production, and AI inference infrastructure.
  • Translate business and product plans into infrastructure roadmaps, capacity requirements, staffing plans, and investment decisions.
  • Ensure production infrastructure is reliable, scalable, secure, performant, and cost-efficient.
  • Establish infrastructure metrics, engineering standards, observability, and clear accountability, proactively surfacing risks and opportunities.
  • Improve developer velocity through automation, CI/CD, and self-service tooling.
  • Strengthen incident response, disaster recovery, and business continuity practices.
  • Partner with AI/ML teams to optimize inference performance, reliability, resource utilization, and cost.
  • Embed access control, compliance, and risk management into infrastructure architecture and operations.
  • Recruit, develop, and lead a high-performing infrastructure engineering organization as a technically credible player-coach.
  • Communicate infrastructure priorities, risks, investments, and tradeoffs clearly to the executive team, and partner with Engineering and Finance on cost and capacity decisions.

Desired Qualifications

  • GPU inference optimization experience is a plus.

About the Company

Otter.ai

Builds AI assistants that capture meeting notes

Otter.ai builds AI meeting assistants for professionals, students, and teams that turn spoken conversations into searchable notes and summaries. Its meeting assistant joins calls on Zoom, Microsoft Teams, and Google Meet, capturing what people say and organizing decisions and action items for later review. Users follow live transcripts, identify speakers, and share recordings with colleagues, while mobile apps also record lectures and in-person discussions. The company sells subscriptions for individuals and business teams, with a free entry plan and enterprise contracts that add administrative controls. Otter.ai was founded in 2016 and is headquartered in Mountain View, California.

Company size
51-200
Company stage
Debt Financing
Total funding
$393M
Headquarters
Mountain View, CA
Founded
2016

Recently Posted Jobs

Explore more opportunities at Otter.ai

See more jobs