A

AION

Decentralized GPU marketplace for AI

Senior Forward Deployed ML Engineer - Agents

Full-TimeUpdated on 10/11/2026
No salary listed
Senior
London, UK
Hybrid
Software EngineeringAI Application Engineering

About the job

Requirements
  • At least 6 years of hands-on experience building production AI/ML systems and at least 3 years deploying LLM applications to production.
  • Practical experience building multimodal AI systems, such as voice agents, vision systems, or conversational AI serving real users.
  • Hands-on experience with modern foundation models, including fine-tuning, prompt engineering, and evaluation methodologies.
  • Production experience with LangChain, LlamaIndex, or similar agent orchestration frameworks.
  • Experience building real-time conversational systems with production speech-to-text and text-to-speech integration.
  • Proficiency in Python, including production-grade code, asynchronous programming, and type hints, and JavaScript or TypeScript for full-stack development.
  • Experience building retrieval-augmented generation systems with vector databases.
  • Hands-on experience with Docker, Kubernetes, continuous integration and continuous delivery pipelines, and infrastructure as code.
  • Experience with AWS, Azure, or Google Cloud Platform for machine learning workloads and infrastructure management.
  • Familiarity with WebRTC, real-time streaming protocols, and low-latency media processing.
Responsibilities
  • Conduct discovery workshops and technical assessments at customer sites to identify high-impact AI opportunities.
  • Design and architect end-to-end multimodal agent systems combining voice, video, and text using Aion's distributed GPU infrastructure and managed services.
  • Build production-grade voice AI systems using speech-to-text and text-to-speech APIs and large language models deployed on Aion's platform.
  • Develop vision-enabled agents that process real-time video streams using computer vision pipelines on Aion's infrastructure.
  • Implement multi-agent orchestration using frameworks such as LangChain or LlamaIndex, enabling tool use, memory management, and autonomous task completion.
  • Rapidly prototype proofs of concept in 2–4 weeks, coding alongside client teams to validate concepts and iterate based on feedback.
  • Optimize real-time systems for latency below 500 milliseconds, natural conversation flow, turn detection, and interruption handling.
  • Integrate agents into customer codebases through REST, GraphQL, and WebSocket APIs and custom SDKs in Python and TypeScript.
  • Advise customers on AI strategy and guide roadmap decisions from concept through production.
  • Design data architectures with efficient processing pipelines and ingestion workflows for training and inference on Aion's platform.
  • Implement retrieval-augmented generation systems with vector databases, optimizing embedding strategies, chunk sizes, and retrieval methods.
  • Prepare and validate datasets for fine-tuning, evaluation, and synthetic data generation.
  • Work with machine learning engineers, MLOps engineers, and site reliability engineers to deploy and productionize models.
  • Implement observability and monitoring for large language models and agents, tracking token usage, latency, costs, and quality metrics across deployments.
  • Instrument applications to trace large language model calls, retrieval operations, agent actions, and data flows.
  • Build evaluation frameworks with offline benchmarks for accuracy, relevance, and safety, and online monitoring for user feedback and drift detection.
Desired Qualifications
  • Experience with voice AI platforms, retrieval-augmented generation systems, and large language model orchestration frameworks.
  • Customer-facing experience in solutions architecture, technical account management, or pre-sales engineering.
  • Computer vision experience with video processing, object detection, or vision-language models.
  • Practical experience with model fine-tuning methods such as LoRA/QLoRA, supervised fine-tuning, or reinforcement learning from human feedback workflows.
  • Experience with inference optimization tools or techniques such as vLLM, TensorRT-LLM, Triton, or model quantization.
  • Practical experience with observability tooling for large language model monitoring, tracing, and evaluation frameworks.

About the company

AION operates a decentralized compute marketplace that lets people and businesses contribute idle GPUs to a shared network and earn passive income. Through this platform, users can buy or sell compute power for AI workloads, making high-performance AI infrastructure more affordable and accessible. Unlike traditional, centralized cloud providers, AION monetizes unused computing resources via a marketplace, offering scalable capacity and democratizing access to AI. The company aims to close the AI wealth gap by enabling widespread ownership of AI compute resources, serving tech-savvy individuals and organizations looking to reduce AI development costs. Revenue comes from facilitating transactions between compute buyers and GPU providers.

Company Size

11-50

Company Stage

N/A

Total Funding

N/A

Headquarters

New York City, New York

Founded

2024

Get referred to AION

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • AION raised $25 million pre-seed in March 2026, extending runway.
  • AION’s June 2026 launch added managed cloud, showing real commercialization.
  • Hiring network engineers in Bengaluru signals active infrastructure buildout and customer readiness.

What critics are saying

  • Microsoft’s June 2026 on-device Aion 1.0 shrinks demand for external inference.
  • AION’s 11-50 person team risks platform failure against hyperscalers and entrenched GPU marketplaces.
  • If supply quality or verification breaks, buyers leave and the marketplace collapses fast.

What makes AION unique

  • AION routes distributed GPUs through verifiable compute and atomic x402 payment settlement.
  • AION’s OpenAI-compatible API reduces adoption friction for developers using verified inference.
  • AION monetizes idle GPUs, turning consumer hardware into a decentralized supply network.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Flexible Work Hours

Wellness Program

Company Equity

Paid Vacation

Growth & Insights

Headcount

6 month growth

-5%

1 year growth

-5%

2 year growth

-5%