C

CarGurus

Online automotive marketplace with price comparisons

Senior Principal Software Development Engineer - Consumer AI Architect

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBoston, MA, USAHybrid

About the Job

Requirements

  • At least 10 years of experience architecting resilient, scalable systems and leading technical direction across multiple teams, including extensive experience designing, implementing, and deploying consumer-facing AI experiences in production.
  • Hands-on experience with LangChain, LangGraph, and LangFuse in Python, and with AI platform and infrastructure layers including storage, memory, load management, evaluations, and observability.
  • Broad knowledge of AI frameworks and tooling beyond Python, with the ability to evaluate and recommend approaches independent of language or ecosystem.
  • Hands-on full-stack experience building well-structured, performant applications across frontend, backend, platform, and infrastructure layers for production-grade systems, including APIs and REST services in Java and UX applications in React.
  • Experience with agentic programming and multi-agent workflows, including guiding teams through adoption.
  • Experience defining engineering patterns and standards adopted by others, and mentoring engineers on architecture and coding practices.

Responsibilities

  • Design, build, and deploy end-to-end consumer-facing experiences for 45 million monthly visitors, from data and model layers through user-facing products, while actively participating in implementation of selected initiatives.
  • Serve as an AI expert and advisor for Consumer AI projects, providing technical guidance on architecture, design, and implementation choices.
  • Guide platform and infrastructure decisions for AI deployments, including storage, memory, request handling and load, evaluation pipelines, observability, and analytics.
  • Evaluate AI frameworks and tooling across languages and ecosystems, develop proof-of-concepts to validate approaches, and explain trade-offs between technologies.
  • Build and operate production agentic and LLM-based applications using LangChain, LangGraph, and Langfuse in Python.
  • Drive adoption of fully agentic programming across the department by defining patterns, tooling, and best practices for building agentic systems.
  • Partner with engineering leadership, product, and data teams to shape phased platform guidelines and roadmaps for consumer initiatives.
  • Mentor engineers across teams on system design, evaluation methodology, and operational best practices.
  • Conduct workshops and produce documentation on AI development, deployment, monitoring, and support practices across multiple teams.
  • Document architectural decisions in Architecture Decision Records (ADRs) and share findings and best practices across teams.

Desired Qualifications

  • Experience building APIs and REST services in Java and UX applications in React is preferred.
  • Experience working within the AWS ecosystem is a plus.

About the Company

CarGurus

Online automotive marketplace with price comparisons

CarGurus is an online marketplace that connects buyers and sellers of new and used cars, with listings, price comparisons, and dealer reviews. It helps users search a catalog, compare prices, and read vehicle histories, using a ranking system that weighs price, dealer reputation, and history to show potentially better deals. The platform differentiates itself through transparent data and a user-friendly interface that makes it easier to compare options than traditional car-buying methods. Its goal is to help people buy and sell cars more efficiently and confidently by providing clear information and meaningful insights.

Company size
1,001-5,000
Company stage
IPO
Headquarters
Boston, MA
Founded
2006

Recently Posted Jobs

Explore more opportunities at CarGurus

See more jobs