S

Syllo

AI-powered document review and case strategy

Senior Software Engineer - Applied AI

AI Application EngineeringUpdated on Nov 10
Full-timeRemote in USA$160k - $200kRemote

About the Job

Requirements

  • Proven ability to build and deploy complex, high-quality software systems, emphasizing maintainable code, rigorous testing, and engineering best practices.
  • Fluency in Python and its ecosystem for backend services and data processing.
  • Strong grasp of system design principles, including distributed systems and API design, with demonstrated ability to design scalable distributed systems.
  • Experience directly building, shipping, and maintaining AI-powered products, agents, or intelligent features in a commercial setting.
  • Hands-on experience engineering Large Language Model integrations in production, including prompt engineering, vector databases, retrieval-augmented generation systems, and context window management.
  • Ability to read, understand, and navigate an unfamiliar codebase quickly.

Responsibilities

  • Design and build high-performance production AI-powered features and services, focusing on reliability and scalability.
  • Develop engineering solutions to mitigate Large Language Model unreliability, including guardrails, validation pipelines, error handling, caching, and failover or fallback mechanisms.
  • Design long-running batch processing that is idempotent, resumable, and resilient to individual item failures.
  • Optimize latency, throughput, and cost efficiency for AI-powered services.
  • Integrate models and data feeds with existing business logic and application programming interfaces.
  • Define and implement evaluation of AI feature output quality as well as system correctness.
  • Implement unit, integration, and performance testing to ensure AI features are robust before and after deployment.
  • Enforce high standards for code quality, architectural design, and system documentation, and participate in peer code reviews.
  • Own the full lifecycle of new AI features, from design and prototyping through application programming interface design, front-end service integration, persistent data storage, deployment, monitoring, and alerting.
  • Onboard onto the existing codebase to maintain and enhance data and feature pipelines, improving their efficiency and robustness.
  • Work with product managers and engineers to scope, estimate, and deliver features on a fast iterative cycle.

Desired Qualifications

  • Experience fine-tuning or distilling smaller task-specific models, with judgment about when it is worthwhile.
  • Familiarity with agent frameworks and their failure modes.
  • Familiarity with cloud platforms such as AWS, Google Cloud Platform, and Azure, and containerization tools such as Docker and Kubernetes for deploying and managing services.

About the Company

Syllo

AI-powered document review and case strategy

Syllo.ai provides an AI-powered workspace for litigation that helps lawyers and paralegals manage cases by reviewing millions of documents quickly, aiding in proof charting, and delivering deep case insights across the discovery-to-trial process. How it works: an in-house AI analyzes large data volumes to extract relevant information and surface insights, while human lawyers provide judgment and strategic input within a secure platform. Why it stands out: it targets elite litigators with an end-to-end, litigation-focused workspace that combines large-scale document processing, specialized features, and customizable solutions. Its goal is to streamline the litigation process, save time, reduce manual work, and help legal teams build stronger, data-driven strategies.

Company size
51-200
Company stage
Early VC
Total funding
$35.2M
Headquarters
New York City, New York
Founded
2019

Recently Posted Jobs

Explore more opportunities at Syllo

See more jobs