H

Harvey

Builds AI software for lawyers

Staff Software Engineer - Backend Platform

Backend EngineeringConfirmed live in the last 24 hours
Full-time$231k - $340k /yrHybrid

About the Job

Requirements

  • At least 8 years of software engineering experience after a bachelor's or master's degree, including building scalable backend systems or internal developer platforms.
  • Proficiency in Python or similar languages and deep knowledge of backend development fundamentals, including APIs, data stores, concurrency, and distributed systems.
  • Hands-on experience with web frameworks and service architectures, such as Flask or FastAPI, bounded-context services, and microservices, and an understanding of designing clean, versioned APIs.
  • Familiarity with caching, messaging, and database technologies, including Redis, Kafka, SQL and NoSQL databases, and vector databases, and how to use them effectively for high performance and reliability.
  • A track record of writing high-quality, well-tested code and using unit and integration testing, static typing, and continuous integration tools to catch issues early and ensure reliability.
  • Strong problem-solving skills and a passion for improving developer experience through tools or frameworks that make other engineers more productive.
  • Ability to collaborate and communicate across teams and incorporate feedback.

Responsibilities

  • Develop and maintain internal backend frameworks and libraries that provide common capabilities such as API routing, service lifecycle management, caching and messaging primitives, and error-handling interfaces, so product teams do not have to reinvent them.
  • Create and improve APIs, service templates, and versioned interfaces that establish consistent patterns for building new services and features.
  • Introduce and champion backend architecture patterns such as asynchronous input/output (asyncio) and streaming data processing, continually evolving the platform for better performance and scalability.
  • Design Harvey-specific abstractions and domain-specific frameworks covering cross-cutting concerns such as authorization and streaming, as well as data governance and event processing, to provide product engineers with these capabilities out of the box.
  • Build tracing, metrics, and automated tests into the platform to embed reliability and observability and ensure services built on the foundation are robust and easy to monitor.
  • Collaborate with the Model Infrastructure team on challenges unique to generative AI-native applications, including supporting high-throughput model inference, managing streaming and long-running API interactions, and designing abstractions for retrieval, context handling, and prompt lifecycle.
  • Collaborate with the Developer Experience and Infrastructure teams to integrate platform components into the deployment and monitoring ecosystem, including their continuous integration and continuous delivery pipelines, build tools, and release infrastructure.
  • Work with product engineering teams to gather feedback, evangelize best practices, and establish the paved-road approach by providing strong defaults and clear documentation.

Desired Qualifications

  • Experience contributing to or maintaining internal libraries or frameworks.

About the Company

Harvey

Builds AI software for lawyers

Harvey builds AI software made specifically for legal work, used by lawyers at large law firms and corporate legal departments. It became one of the first generative AI tools rolled out across a major law firm when Allen & Overy gave it to its lawyers worldwide in 2023. Lawyers use Harvey to research legal questions, draft and review contracts, and run due diligence across large sets of documents, with answers grounded in their firm's own files and trusted legal sources. Firms pay through enterprise subscriptions, and Harvey can tailor its workflows to practice areas such as litigation and mergers. Harvey was founded in 2022 with early backing from the OpenAI Startup Fund and is based in San Francisco.

Company size
1,001-5,000
Company stage
Late Stage VC
Total funding
$1.8B
Headquarters
San Francisco, CA
Founded
2022

Recently Posted Jobs

Explore more opportunities at Harvey

See more jobs