A

AION

Decentralized GPU marketplace for AI

Senior Forward Deployed ML Engineer - Agents

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeLondon, UK

About the Job

Requirements

  • 6–8+ years of hands-on experience building production AI/ML systems, including 3–4+ years deploying LLM applications to production.
  • Practical multimodal AI experience building voice agents, vision systems, or conversational AI for real users.
  • Hands-on knowledge of modern foundation models, including fine-tuning, prompt engineering, and evaluation methodologies.
  • Production experience with LangChain, LlamaIndex, or similar agent orchestration frameworks.
  • Experience building real-time conversational systems with production speech-to-text and text-to-speech integration.
  • Proficiency in Python, including production-grade code, asynchronous programming, and type hints, and JavaScript/TypeScript for full-stack development.
  • Experience building retrieval-augmented generation systems with vector databases.
  • Hands-on experience with Docker, Kubernetes, CI/CD pipelines, and infrastructure-as-code.
  • Experience with AWS, Azure, or GCP for machine-learning workloads and infrastructure management.
  • Ability to explain complex AI concepts clearly to technical and business stakeholders.
  • Familiarity with WebRTC, real-time streaming protocols, and low-latency media processing.

Responsibilities

  • Work directly at customer sites, including factory floors and executive offices, to conduct discovery workshops and technical assessments and identify high-impact AI opportunities.
  • Design and architect end-to-end multimodal agent systems using voice, video, and text, leveraging Aion’s distributed GPU infrastructure and managed services.
  • Build production-grade voice AI systems using speech-to-text and text-to-speech APIs and large language models deployed on Aion’s platform.
  • Develop vision-enabled agents that process real-time video streams using computer vision pipelines on Aion’s infrastructure.
  • Implement multi-agent orchestration using frameworks such as LangChain or LlamaIndex, enabling tool use, memory management, and autonomous task completion.
  • Rapidly prototype proofs of concept in 2–4 weeks, coding alongside client teams to validate concepts and iterate based on feedback.
  • Optimize real-time systems for sub-500ms latency, natural conversation flow, turn detection, and interruption handling.
  • Integrate agents into customer codebases through REST, GraphQL, and WebSocket APIs and custom Python and TypeScript software development kits.
  • Advise customers on AI strategy and guide roadmap decisions from concept through production.
  • Design data architectures with efficient processing pipelines and ingestion workflows for training and inference on Aion’s platform.
  • Implement retrieval-augmented generation systems with vector databases, optimizing embedding strategies, chunk sizes, and retrieval methods.
  • Prepare and validate datasets for fine-tuning, evaluation, and synthetic data generation.
  • Work with machine-learning engineers, MLOps engineers, and site reliability engineers on model deployment and productionization.
  • Implement observability and monitoring for large language models and agents, tracking token usage, latency, costs, and quality metrics across deployments on Aion’s infrastructure.
  • Instrument applications to trace large language model calls, retrieval operations, agent actions, and data flows.
  • Build evaluation frameworks with offline benchmarks for accuracy, relevance, and safety, and online monitoring for user feedback and drift detection.

Desired Qualifications

  • Customer-facing experience in Solutions Architecture, Technical Account Management, or Pre-Sales Engineering.
  • Computer vision experience with video processing, object detection, or vision-language models.
  • Practical model fine-tuning experience with LoRA/QLoRA, supervised fine-tuning, or RLHF workflows.
  • Experience with inference optimization using vLLM, TensorRT-LLM, Triton, or model quantization techniques.
  • Practical experience with observability tooling for large language model monitoring, tracing, and evaluation frameworks.

About the Company

AION

Decentralized GPU marketplace for AI

AION operates a decentralized compute marketplace that lets people and businesses contribute idle GPUs to a shared network and earn passive income. Through this platform, users can buy or sell compute power for AI workloads, making high-performance AI infrastructure more affordable and accessible. Unlike traditional, centralized cloud providers, AION monetizes unused computing resources via a marketplace, offering scalable capacity and democratizing access to AI. The company aims to close the AI wealth gap by enabling widespread ownership of AI compute resources, serving tech-savvy individuals and organizations looking to reduce AI development costs. Revenue comes from facilitating transactions between compute buyers and GPU providers.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
New York City, New York
Founded
2024

Recently Posted Jobs

Explore more opportunities at AION

See more jobs