Full-Time

Open Source Infrastructure Engineer

Confirmed live in the last 24 hours

Arize AI

Arize AI

51-200 employees

AI observability and model evaluation platform

Data & Analytics
AI & Machine Learning

Compensation Overview

$125k - $225kAnnually

+ Equity Package

Mid, Senior

Remote in USA

The company is fully remote, but has offices in New York City and the San Francisco Bay Area. There is a WFH monthly stipend for employees working remotely.

Category
DevOps & Infrastructure
Cloud Engineering
Required Skills
Kubernetes
Python
TypeScript
Go
Terraform

You match the following Arize AI's candidate preferences

Employers are more likely to interview you if you match these preferences:

Degree
Experience
Requirements
  • 3+ years of experience building scalable infrastructure and developer tools, ideally in an open-source context.
  • Strong understanding of the open-source development lifecycle and community dynamics.
  • Expertise in Kubernetes, Terraform, and other modern infrastructure tools.
  • Familiarity with build tools like Bazel and CI/CD systems.
  • Familiarity with Go, Python, and some TypeScript.
Responsibilities
  • Collaborate with internal teams and the open-source community to architect and scale infrastructure that supports Arize Phoenix’s growth.
  • Enable and enhance Phoenix’s SaaS capabilities by building out features such as central authentication, data retention, and capacity scaling.
  • Build out a robust set of infrastructure tools and services that alleviates the operations of Arize's product offering.
Desired Qualifications
  • Experience working with AI frameworks, LLM integrations, or observability platforms is a plus.

Arize AI provides a platform focused on AI observability and evaluating language models. The platform allows companies to monitor, troubleshoot, and assess the performance of various machine learning models, including those used for natural language processing, computer vision, and recommendations. Users can access analytics and workflows that help identify and resolve issues within their AI systems, ensuring optimal performance. Key features include task-based evaluations for aspects like hallucination and relevance, as well as tools for visualizing query and knowledge base embeddings to enhance retrieval accuracy. Unlike many competitors, Arize AI specifically targets the needs of top AI companies, offering tailored solutions for continuous improvement of their models. The goal of Arize AI is to empower these companies to enhance their AI systems' effectiveness and reliability.

Company Size

51-200

Company Stage

Series B

Total Funding

$59.3M

Headquarters

Berkeley, California

Founded

2020

Simplify Jobs

Simplify's Take

What believers are saying

  • Increased demand for AI observability tools boosts Arize AI's market potential.
  • Collaboration with Microsoft enhances Arize AI's enterprise deployment capabilities.
  • Prompt variable monitoring highlights Arize AI's commitment to LLM performance enhancement.

What critics are saying

  • Competition from tech giants like Microsoft may overshadow Arize's offerings.
  • Rapid tech advancements could render Arize's features obsolete if not updated.
  • Data privacy compliance in the EU poses challenges for Arize AI.

What makes Arize AI unique

  • Arize AI offers industry-first AI Copilot for troubleshooting AI systems.
  • The platform provides unique prompt engineering and retrieval tracing workflows.
  • Arize AI supports EU data residency, addressing regional data privacy concerns.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Dental Insurance

Vision Insurance

401(k) Retirement Plan

Unlimited Paid Time Off

Parental Leave

Mental Health Support

Flexible Work Hours

Growth & Insights and Company News

Headcount

6 month growth

1%

1 year growth

1%

2 year growth

1%
Arize AI
Nov 21st, 2024
Arize AI Is Named An Emerging Leader In the Generative AI Engineering Gartner(R) Emerging Market Quadrant

Arize AI is named an Emerging Leader in the Generative AI engineering gartner(r) Emerging Market quadrant.

PR Newswire
Nov 20th, 2024
Arize Ai Collaborates With Microsoft To Enable More Effective Enterprise Deployment Of Generative Ai

Arize AI now offers an integrated development experience on Microsoft Azure AI Foundry portal, SDK, and Command Line Interface (CLI). CHICAGO, Nov. 19, 2024 /PRNewswire/ -- Arize AI, a leader in AI observability and LLM evaluation, debuted a deeper collaboration with Microsoft and a raft of new integrations at Microsoft Ignite today. The updates come at a critical inflection point for enterprise adoption of generative AI. Despite the fact that most enterprises are planning production deployments of LLMs, over half still cite issues like data privacy and difficulty pinpointing issues (i.e. accuracy of responses) as barriers standing in the way of moving from prototype to successful real-world deployment

Arize AI
Sep 19th, 2024
Arize Release Notes: AI Search V2, Copilot Updates, and More

Arize AI, Inc is excited to announce the release of AI Search V2, packed with new features and improvements designed to enhance the user experience.

Arize AI
Aug 1st, 2024
Arize AI: Support for EU Data Residency

Arize AI recently rolled out EU data residency for all users, enabling customers to host their data within the European Union.

PR Newswire
Jul 11th, 2024
Arize Ai Introduces Ai Copilot

Industry-first AI assistant for troubleshooting AI and other new updates promise to speed development for AI engineersSAN FRANCISCO, July 11, 2024 /PRNewswire/ -- Arize AI, a pioneer and leader in AI observability and LLM evaluation, today debuted new capabilities to help AI developers evaluate and debug LLM systems. The premiere is one among many taking place at the Arize:Observe conference today, where speakers – including OpenAI, Lowe's, Mistral, Microsoft, NATO, and others – are sharing the latest research, engineering best practices, and open source frameworks.Arize Copilot – the industry's first AI assistant to troubleshoot AI systems – is a new tool that surfaces relevant information and suggests actions in the Arize platform, automating complex tasks and taking actions to help AI engineers save time and improve app performance. Examples where the AI Copilot can help out of the box include getting model insights, prompt optimization, building a custom evaluation, and AI search."Using AI to troubleshoot complex AI systems is a logical next step in the evolution of building generative AI applications, and we are proud to offer Arize Copilot to teams that want to improve the development and performance of LLM systems," said Aparna Dhinakaran, Chief Product Officer and Co-Founder of Arize.Other new workflows debuting today in the Arize platform promise to help engineers find issues with LLM apps once they are deployed. With AI search, for example, teams can select an example span and easily discover all similar issues (i.e. finding all data points where a customer is frustrated). Teams can then save those data points into a curated dataset to apply annotations, run evaluation experiments, or kick off fine-tuning workflows.Altogether, the updates make Arize a powerhouse for experimentation as well as production observability