A

Acuity Analytics

Data, AI, and cloud consulting

Senior AI Engineer - Python, MSFT Foundry

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • At least 8 years of experience in software or machine learning engineering, with multiple systems shipped to production and used live; candidates should be prepared to explain what they built, what failed, and what they changed.
  • Production Python 3.12 skills, including typed, packaged, tested code, pytest, ruff, pre-commit, and clean module structure; notebook-only work is not sufficient.
  • Experience building agents on Claude, using Claude Agent SDK or Claude Code, tool use, prompt design, and structured outputs, and maintaining reliable long-running agent sessions while detecting early termination or fabricated outputs.
  • Production experience with multi-agent systems, including orchestration, parallelism, dependency ordering, independent verification, failure handling, and cost control; evidence must come from live systems, not only demos.
  • Experience testing and evaluating large language model systems, including fake or recorded backends, deterministic tests for surrounding code, and separate evaluations for model output.
  • Git and continuous integration/continuous delivery at team scale, including pull-request workflows, GitHub Actions or Azure DevOps pipelines, Docker, and versioned releases.
  • Cloud and data experience with PostgreSQL schema design, migrations and audit tables; Azure Data Lake Storage or Blob; Parquet; and pandas or pyarrow.
  • Experience building or supporting software under GxP validation, including requirements-to-test traceability, audit trails, change control, access control, and documentation.

Responsibilities

  • Own the production architecture and decide how the multi-agent system is structured, including orchestrators, parallel workers, independent checkers, and repair loops; justify architectural choices with measurements.
  • Harden the deterministic backbone around agents to take systems from prototype to live use, including step orchestration, status tracking, caching, validation gates, resumable runs, failure handling, and cost and latency control.
  • Build evaluation harnesses and test layers that score every change against reference results before release.
  • Operate delivered systems through monitoring, per-step cost and token accounting, incident handling, and release notes.
  • Move run state, metadata, and outputs to PostgreSQL and Azure Data Lake Storage, with access control and audit trails.
  • Set engineering standards for code review, continuous integration/continuous delivery, branching, pre-commit, secret scanning, reproducible environments, and validation documentation; raise engineering standards across the team.
  • Work with domain experts to turn rules written by clinical programmers and statisticians into precise, testable specifications.

Desired Qualifications

  • Knowledge of CDISC SDTM or ADaM, or experience in pharmaceutical or contract research organization analytics.
  • Ability to read SAS or R clinical programs.
  • Experience with Domino Data Lab or similar job-based compute platforms.
  • Experience with Azure Key Vault, managed identity, or Azure DevOps Test Plans.
  • Experience with MCP servers, long-document retrieval, prompt caching, agent observability, or tracing.

About the Company

Acuity Analytics

Data, AI, and cloud consulting

Acuity Analytics is a data and digital engineering consultancy. It helps organizations design and implement data platforms, analytics, artificial intelligence, cloud, software, and digital experience solutions. Its clients include enterprises and public organizations modernizing how they collect, manage, analyze, and use information. The consultancy delivers through multidisciplinary project teams that combine strategy, architecture, engineering, design, implementation, and managed support. Work spans data engineering, analytics, AI, cloud, software development, product design, consulting, and delivery management.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
Sofia, Bulgaria
Founded
2012

Recently Posted Jobs

Explore more opportunities at Acuity Analytics

See more jobs