Y

Yaklabs

Software Engineer: Cloud Infrastructure

Cloud EngineeringUpdated on Nov 10
Full-timeRemote in USA

About the Job

Requirements

  • You have built and operated production cloud infrastructure and have been on call for systems real users depend on.
  • You treat tenant isolation as a design constraint that runs through every layer.
  • You have built metering or cost-attribution systems and keep spending visible and under control.
  • You have strong networking fundamentals and understand how local clients connect to cloud services and where that path can fail.
  • You have built operable systems and improved observability, deployment, and rollback where these were previously afterthoughts.
  • You are a technical builder with a distinctive strength in a domain such as design, systems, product, or infrastructure, and can take problems from first principles to working software.
  • You reason from first principles in a category where established best practices do not yet exist.
  • You take high-agency ownership and act independently to deliver outcomes.
  • You have deep curiosity about AI tooling, experiment with tools and agent frameworks, and form opinions about their effectiveness.
  • You are interested in building compounding leverage through skills, automations, and agent workflows.

Responsibilities

  • Build and operate cloud-deployed agent infrastructure, including running agents server-side, isolating execution, and scaling the fleet.
  • Build and operate the model gateway, including routing, rate limiting, fallback, and cost controls, as the entry point between local clients and inference providers.
  • Design and build telemetry ingestion for structured events from thousands of local clients, making them queryable, exportable, and auditable.
  • Build usage metering and billing, including per-tenant tracking, cost attribution, and accurate metering.
  • Own deployment infrastructure, including continuous integration and delivery, release pipelines, rollback, and environment management.
  • Design the multi-tenancy model, including data isolation, tenant boundaries, and access controls.
  • Build the data governance layer, including retention policies, deletion, and compliance hooks.

Desired Qualifications

  • You have built a model gateway or large language model proxy in production.
  • You have experience with enterprise compliance requirements such as SOC 2, ISO 27001, or similar.
  • You have managed large compute fleets and virtual machine infrastructure.
  • Contributions to open-source agentic harness projects are of interest.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Yaklabs

See more jobs