Full-Time

Forward Deployed AI Engineer

Updated on 6/10/2026

Arize AI

Arize AI

51-200 employees

AI model observability and evaluation platform

Compensation Overview

$125k - $175k/yr

+ Equity

New York, NY, USA

Remote

Must be NYC metro/EST-based; remote from NYC; optional in-person at NYC/SF offices; WFH stipend provided.

Category
AI & Machine Learning (1)
Required Skills
Kubernetes
MLOps
Microsoft Azure
Python
Java
Docker
TypeScript
AWS
Observability
Google Cloud Platform
Requirements
  • Software Development: 2-5 years of hands-on software development experience with strong technical foundations. We work extensively in Python, Java, and TypeScript, and expect candidates to be comfortable working in at least two of those languages.
  • ML/AI Engineering: Experience building MLOps pipelines and/or developing, deploying, and iterating on Generative AI applications in production environments.
  • Cloud Technologies: Experience working with public cloud platforms (e.g., AWS, GCP, Azure) as well as containerization and orchestration technologies (e.g., Docker and Kubernetes).
  • Communication: Excellent communication skills with the ability to work effectively across both technical and business audiences. You should be comfortable engaging with senior executives on business outcomes and metrics, collaborating with engineers on technical implementation details, and translating seamlessly between the two.
  • Project Management: Proven ability to manage multiple client engineering engagements simultaneously and deliver high-quality technical outcomes under demanding timelines.
  • Adaptability: Comfortable operating in fast-paced startup or consulting environments, with the ability to navigate diverse client organizations, technical stacks, and evolving priorities.
  • Passion for AI: We live and breathe AI at Arize. The strongest candidates are genuinely excited about the space and energized by staying at the forefront of rapidly evolving AI technologies.
Responsibilities
  • Partner directly with enterprise AI teams to design, implement, and scale production-grade GenAI observability and evaluation programs.
  • Lead technical discussions with customer stakeholders ranging from engineers to senior executives, translating business priorities into scalable technical solutions.
  • Build custom integrations, tooling, and workflows that extend the Arize platform to meet customer-specific requirements.
  • Manage multiple concurrent customer engagements, driving projects from scoping through delivery while maintaining a high bar for technical execution and customer experience.
  • Collaborate cross-functionally with Sales, CS, Product, and Engineering teams to shape implementation strategy, influence product direction, and expand customer impact.
  • Help define and scale best practices, technical playbooks, and delivery methodologies for the growing Forward Deployed Engineering team.

Arize AI provides a platform for AI observability and LLM evaluation that helps teams monitor, troubleshoot, and improve the performance of machine learning models, including generative models, NLP, computer vision, and recommender systems. It works by delivering analytics and workflows, tracing LLM operations (traces and spans), retrieval augmented generation (RAG), and task-based evaluations for issues like hallucinations, relevance, and citation checks. The platform distinguishes itself by offering end-to-end AI observability and LLM evaluation for top AI companies, with embedding-based RAG analysis to diagnose missing or irrelevant context. The goal is to help AI teams ensure models perform optimally and continuously improve their AI systems.

Company Size

51-200

Company Stage

Series C

Total Funding

$131M

Headquarters

Berkeley, California

Founded

2020

Simplify Jobs

Simplify's Take

What believers are saying

  • Enterprise AI adoption increases demand for monitoring hallucinations, drift, and failures.
  • Microsoft Azure collaboration opens co-sell distribution into enterprise generative AI buyers.
  • EU data residency and ISO 27001 support regulated customers buying observability software.

What critics are saying

  • OpenAI, Datadog, and LangSmith bundle observability, compressing standalone pricing power.
  • Phoenix users self-host or switch to internal tooling after instrumentation standardizes.
  • Google A2A and native cloud tracing can disintermediate Arize at the protocol layer.

What makes Arize AI unique

  • Founded in 2020, Arize unifies ML observability and LLM evaluation in one platform.
  • Phoenix open source delivers OpenTelemetry-based tracing with 2 million monthly downloads.
  • Arize supports production debugging across traces, spans, RAG, and agent workflows.

Help us improve and share your feedback! Did you find this helpful?

Your Connections

People at Arize AI who can refer or advise you

Benefits

Health Insurance

Dental Insurance

Vision Insurance

401(k) Retirement Plan

Unlimited Paid Time Off

Parental Leave

Mental Health Support

Flexible Work Hours

Growth & Insights and Company News

Headcount

6 month growth

-4%

1 year growth

-3%

2 year growth

-4%
Arize
Jul 1st, 2025
Meet Alyx: Arize's Evolving AI Agent

Arize AI, Inc is excited to introduce Alyx, the next evolution in Arize's intelligent assistant.

Arize
Apr 9th, 2025
Arize AI and the Future of Agent Interoperability: Embracing Google's A2A Protocol

Arize AI, Inc is excited to announce that Arize AI is partnering with Google as a launch partner for the Agent Interop Protocol (A2A), an open standard enabling seamless communication between AI agents across different platforms and organizational boundaries.

SiliconANGLE Media
Mar 13th, 2025
Arize AI Acquires Velvet for AI Observability

Arize AI Inc. has acquired Velvet to enhance its AI observability and evaluation capabilities. Velvet, founded in 2023, provides an AI gateway for developers to analyze and monitor AI features. The acquisition aims to meet the growing demand for AI monitoring and evaluation, with Velvet's team joining Arize to expand its offerings. Chris Hendel, Velvet's co-founder, will lead platform engineering at Arize. Financial terms of the deal were not disclosed.

Tech Company News
Feb 24th, 2025
Arize AI Raises $70M To Advance AI Observability And Fix Model Reliability Issues

With backing from major investors and deeper integration with Microsoft's Azure AI, Arize AI expands its tools to support enterprises deploying large-scale AI systems.

Arize
Feb 20th, 2025
Arize AI Raises $70M Series C to Build the Gold Standard for AI Evaluation & Observability

Learn how we're shaping the future of trustworthy LLMs & AI agents, and what's next for Arize in our Series C announcement.