A

AZX

Provides bespoke AI solutions for enterprises

Senior Backend Engineer - AI Platform

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeRemote in USA

About the Job

Requirements

  • At least 5 years of deep, production async Python experience, including cancellation scopes, streaming lifecycle, and connection pooling.
  • Be comfortable reasoning about Postgres as infrastructure, including MVCC, advisory locks, and vacuum discipline; have used Redis or Dragonfly appropriately and have real distributed-systems experience.
  • Have experience shipping API surfaces other engineers build on, including versioning, idempotency, error vocabularies, migration discipline, and documentation.
  • Have depth in at least one of LLM gateway concerns (routing, metering, guardrails, or provider failover) or retrieval engineering (hybrid search, reranking, evaluation methodology, or audit-ready RAG), and credibility in the other.
  • Have a cost-accounting and evaluations-first mindset, with experience shipping a gate or harness that caught a real regression.
  • Have production depth in a modern stack and aptitude to ramp quickly on unfamiliar tools.
  • Have practical familiarity with Python 3.12 or later, including async, type-strict development, FastAPI or Starlette, and Pydantic v2; asyncpg or SQLAlchemy; Postgres including pgvector; and Redis or Dragonfly with Lua, with willingness to research the rest of the stack.
  • Have exposure to OpenTelemetry including GenAI conventions, SSE and streaming lifecycles, OpenAI or Anthropic provider APIs, job frameworks such as Celery, Dramatiq, or Prefect, rate-limit algorithms such as token bucket or GCRA, and integer-cents money handling.
  • Be currently authorized to work in the United States on a full-time basis.
  • Be willing to travel to the Seattle area for the final interview and twice yearly for company summits.

Responsibilities

  • Own the LLM gateway, including routing, metering, budgets, guardrail composition, and provider/backend adapters across hosted and self-hosted models.
  • Manage the retrieval and knowledge service, including connectors, chunking, hybrid search and reranking, grounded answers, and the MCP surface.
  • Build the evaluation harness that turns retrieval tuning into evidence, with confidence intervals and per-segment breakdowns.
  • Own the async framework, including its public API, rate-limit algorithms, and admin tooling, and lead its evolution into durable execution for agent runs.
  • Design authorization across the platform, including token hierarchies, capability grammars, and per-tenant isolation tested as a regression.
  • Own the definition of done for shipped work, including evaluations, traces, cost accounting, and a dashboard that surfaces issues.

Desired Qualifications

  • Past work in energy, real estate, utilities, climate, or related fields is a plus.
  • Experience in both startup and enterprise environments is a plus.

About the Company

AZX

Provides bespoke AI solutions for enterprises

AZX provides bespoke AI solutions for critical, asset-heavy industries such as energy, real estate, and supply chain. It embeds dedicated AI teams with client organizations to build custom models and applications that integrate into existing systems, addressing complex processes, unstructured data, and regulatory needs. Its services range from AI strategy and disruption management to deploying AI-powered agents and new applications, built on technologies from Azure, AWS, GCP, OpenAI, and Anthropic. As a Public Benefit Corporation with a climate and sustainability mandate, AZX aims to accelerate sustainability and climate adaptation by delivering tightly integrated AI solutions that help clients become more efficient and decarbonize.

Company size
11-50
Company stage
Seed
Total funding
$6M
Headquarters
Seattle, WA
Founded
2024

Recently Posted Jobs

Explore more opportunities at AZX

See more jobs