R

Runware

Generative AI platform with fast inference

Senior Machine Learning Engineer - ML Team

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeRemote in UK

About the Job

Requirements

  • Deep hands-on expertise in Python and PyTorch, including framework quirks and edge cases when using Python for machine learning workloads.
  • Demonstrated experience building machine learning applications and models, rather than only running or deploying existing models; serving a pre-built model via vLLM alone does not qualify.
  • Hands-on experience writing GPU kernels in CUDA/C++ or Triton.
  • Low-level experience with model internals, such as working directly with diffusion model architectures using diffusers or an equivalent, rather than only calling high-level APIs.
  • Experience with the PyTorch compiler (torch.compile) or comparable low-level PyTorch tooling.
  • Practical experience fine-tuning large models as a repeatable service using LoRA, PEFT, or adapters, designed for speed and reuse across many models rather than a single one-off training run.
  • A verifiable project history, such as GitHub repositories, demonstrating work personally authored.
  • High ownership and comfort operating in a fast-paced startup environment.

Responsibilities

  • Integrate open-source and third-party models into the inference platform.
  • Lead fine-tuning initiatives involving LoRA, adapters, PEFT, and domain adaptation.
  • Optimise inference workloads for latency, batching, memory efficiency, and throughput.
  • Benchmark model quality, cost, and performance across modalities.
  • Improve inference startup times and stability under high load.
  • Build evaluation frameworks and internal tooling for model validation.
  • Work with Infrastructure and Backend teams on scalable serving systems.
  • Monitor production performance and drive continuous optimisation.
  • Mentor engineers and help raise the machine learning engineering standard across the team.

Desired Qualifications

  • Experience optimising inference workloads in GPU environments.
  • Experience with vLLM or custom inference servers.
  • Experience with diffusion models, large language models, or multimodal architectures.
  • Experience with Kubernetes, Docker, or containerised machine learning workloads.
  • Experience building internal machine learning tooling or developer-facing APIs.
  • Experience working in high-throughput distributed systems.
  • Background in AI media generation, including image, video, or audio.

About the Company

Runware

Generative AI platform with fast inference

Runware.ai provides a fast, cost-effective platform to deploy AI-generated content through an API that hides infrastructure complexity. It runs AI workloads on custom hardware in renewable-energy data centers using the Sonic Inference Engine, with real-time WebSocket connections for low-latency, scalable performance. It differentiates itself with a proprietary engine, dedicated hardware, built-in redundancy, autoscaling, GPU allocation, and access to over 188,000 models, enabling seamless integration without ML expertise. Its goal is to democratize access to generative AI for businesses by making it easy to add AI capabilities without heavy hardware costs or specialized know-how.

Company size
51-200
Company stage
Series A
Total funding
$66M
Headquarters
London, United Kingdom
Founded
2023

Recently Posted Jobs

Explore more opportunities at Runware

See more jobs