F

Firecrawl

Web-data platform for AI agents

Cloud DevOps Engineer

Cloud EngineeringUpdated on Nov 11
Full-time

About the Job

Requirements

  • At least 5 years of experience in DevOps, Platform Engineering, or Cloud Infrastructure.
  • Experience operating stateful distributed systems on Kubernetes at scale, rather than only stateless services.
  • Deep experience with a major cloud provider such as GCP, AWS, or Azure, as well as Docker and Terraform.
  • Experience running large-scale, data-heavy systems in production, such as search platforms, crawling or ingestion pipelines, or comparable systems.
  • Care about latency, cost, and reliability in equal measure.
  • Comfort owning ambiguous problems and turning them into shipped infrastructure.

Responsibilities

  • Design, build, and operate GCP and on-premises infrastructure behind Firecrawl's products.
  • Run large stateful and high-throughput workloads on Kubernetes, including search clusters, crawling fleets, queues, and databases, with zero-downtime upgrades.
  • Own CI/CD, Infrastructure as Code, automations, and containerized deployments across the platform.
  • Reduce infrastructure cost per request as traffic and data volume grow.
  • Build observability to keep latency, throughput, and reliability predictable, and define the SLIs, SLOs, and customer-facing SLAs the company commits to.
  • Build and support enterprise controls, including SSO/SAML, RBAC, audit logging, tenant isolation, private networking, and infrastructure behind SOC 2 and customer security reviews.
  • Work directly with product and search engineers to productionize new services, retrieval, and ML workloads.
  • Own the incident lifecycle with engineers, from on-call and triage processes through postmortems and resolution.

Desired Qualifications

  • MLOps or ML-serving infrastructure experience, including GPU workloads and model deployment pipelines.
  • Hands-on experience operating Vespa.
  • Experience with security and compliance infrastructure, including SSO/SAML, audit logging, network isolation, and SOC 2.

About the Company

Firecrawl

Web-data platform for AI agents

Firecrawl provides a context API for AI agents to search, crawl, scrape, and retrieve clean content from the live web and structured indexes at scale. Its platform handles crawling, rendering, parsing, and cleanup so teams don’t need to build their own extraction pipelines. The Alexandria layer unifies official data providers, custom connectors, and Firecrawl indexes with the live web, enabling agents to discover sources and pull knowledge, including paid access like Wikimedia Enterprise. The service supports scale to millions of users and funds deeper indexes, search capabilities, and knowledge-contributor payouts.

Company size
51-200
Company stage
Late Stage VC
Total funding
$89.5M
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Firecrawl

See more jobs