R

Rearc

Engineering services for GenAI, data, AWS

Senior AI Engineer

AI Application EngineeringPosted on Nov 17
Full-timeNo salary listedHybrid

About the Job

Requirements

  • At least 4 years of experience building and deploying production AI/ML systems beyond demos or experimentation.
  • A track record of architecting, building, and shipping AI/ML or software solutions using modern AI-assisted workflows.
  • Strong understanding of AI system evaluation and measurement, including offline metrics, online monitoring, LLM-as-judge processes, regression testing, and cost and latency tracking.
  • Practical judgment in retrieval and agent design trade-offs, including choosing between retrieval-augmented generation (RAG), agent loops, and workflows.
  • Hands-on experience with large language model platforms such as OpenAI, Anthropic, or Google Vertex, and orchestration or harness patterns.
  • Proficiency in Python.
  • Backend engineering skills, including building and deploying APIs, working with Docker, and navigating cloud-native environments, containers, and basic infrastructure.
  • Strong software engineering fundamentals and the ability to write maintainable, production-grade code.
  • Experience with continuous integration and continuous delivery (CI/CD) pipelines, infrastructure as code, and production observability.
  • Ability to debug and optimize systems in production.
  • Ability to explain technical trade-offs to non-technical stakeholders.

Responsibilities

  • Design and implement AI agents, including RAG pipelines, orchestration workflows, and tool invocation.
  • Build evaluation frameworks to measure system accuracy, latency, cost, and reliability.
  • Implement observability and monitoring across the AI system lifecycle.
  • Integrate with multiple AI providers and develop abstraction layers for multi-model architectures.
  • Optimize AI systems for performance, cost, and scalability.
  • Build and deploy AI-powered applications integrated with real business workflows.
  • Integrate AI systems into existing enterprise platforms and APIs.
  • Debug and optimize live production systems.
  • Collaborate with client and internal engineering teams.
  • Participate in technical design discussions with a focus on implementation.

Desired Qualifications

  • Familiarity with prompt optimization or evaluation tools such as DSPy, MLflow, promptfoo, or RAGAS.
  • LLMOps/MLOps experience building robust, monitored, self-healing AI systems.
  • Experience with harness engineering, such as developing on or with Goose, Pi, Claude Code, or Codex.
  • Databricks experience.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Experience with FastAPI, Pydantic, PostgreSQL, MySQL, or DuckDB.
  • Experience using the Claude SDK or OpenAI SDK.
  • Additional programming languages beyond Python, particularly TypeScript or Go.
  • Experience mentoring or upskilling fellow engineers.

About the Company

Rearc

Engineering services for GenAI, data, AWS

Rearc provides engineering-driven services to help enterprises accelerate GenAI, data platforms, and cloud development on AWS as an Advanced Consulting Partner. It delivers bespoke LLM, AI, and MLOps solutions tailored for complex regulated industries such as financial services and healthcare. Unlike generic vendors, Rearc offers end-to-end engagements within the AWS ecosystem that emphasize governance and compliance. Its goal is to help large organizations rapidly adopt scalable, secure GenAI and cloud platforms that drive measurable business outcomes.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
New York City, New York
Founded
2016

Recently Posted Jobs

Explore more opportunities at Rearc

See more jobs