A

Arize AI

AI model observability and evaluation platform

Senior AI Product Engineer - Backend

Backend EngineeringConfirmed live in the last 24 hours
Full-timeRemote in USA

About the Job

Requirements

  • At least 5 years of experience working with high-performance backend systems.
  • Strong experience writing Go, Python, TypeScript or Node.js, Java, or similar server programming languages.
  • Interest in the AI and large language model ecosystem, including willingness to learn emerging technologies.
  • Previous experience building and operating complex software-as-a-service platforms or systems.
  • Knowledge of public cloud platforms and container orchestration, such as AWS, GCP, Azure, and Kubernetes.

Responsibilities

  • Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
  • Build high-volume and highly available analytics systems.
  • Design and build APIs for customers’ machine learning and large language model workflows.
  • Prototype, optimize, and maintain scalable backend services that power the core platform.
  • Extend and contribute to open-source OLAP databases and distributed message queue frameworks.
  • Develop and integrate collection tools for monitoring machine learning and large language model pipelines.
  • Research and implement visualization and dimensionality reduction algorithms in a distributed environment.
  • Collaborate with product, design, and customer engineering teams to enhance and expand product offerings.
  • Contribute to building in-house AI agents.

Desired Qualifications

  • Experience with distributed stream processing, such as Kafka, Gazette, or similar technologies.
  • Experience with OLAP systems.
  • Familiarity with system observability tools such as Prometheus.
  • Working knowledge of machine learning or data science.
  • First-hand experience working with large language models or developing AI products.

About the Company

Arize AI

AI model observability and evaluation platform

Arize AI provides a platform for AI observability and LLM evaluation that helps top AI teams monitor and improve models across NLP, computer vision, and recommender systems. It works by offering analytics, LLM traces, spans, RAG analysis, and task-based evaluations to troubleshoot issues and measure performance. It differentiates itself by delivering end-to-end observability and evaluation in a single platform with embedding visualization for RAG to pinpoint missing or irrelevant context. Its goal is to help AI teams ensure their models perform optimally and continuously improve their AI systems.

Company size
201-500
Company stage
Acquired
Total funding
$131M
Headquarters
Berkeley, CA
Founded
2020

Recently Posted Jobs

Explore more opportunities at Arize AI

See more jobs