E

Expert Institute

Senior Backend Software Engineer - Case Intelligence

AI Application EngineeringPosted on Nov 13
Full-timeNew York, NY, USANo salary listedIn-person

About the Job

Requirements

  • At least five years of professional software engineering experience, including substantial work on backend systems or data pipelines.
  • Strong Python skills, including typing, Pydantic, and automated testing, plus solid SQL.
  • Production experience with AWS serverless or container services and event-driven systems.
  • Experience building with LLM APIs beyond prototypes, with attention to output quality, latency, and cost.
  • Experience processing PDFs, scans, OCR output, or other unstructured documents at scale.
  • Ability to investigate ambiguous problems, make sound technical decisions, and move work forward independently.
  • Clear written communication with technical and nontechnical partners.

Responsibilities

  • Design, build, and operate pipelines using AWS services such as SQS, Lambda, ECS/Fargate, Step Functions, S3, and EventBridge.
  • Turn large volumes of unstructured documents into reliable, structured data.
  • Build production LLM workflows using Amazon Bedrock, OpenAI, and Gemini, including batch inference, structured outputs, model routing, and long-document processing.
  • Develop retrieval and machine-learning components using embeddings, OpenSearch, reranking, classifiers, and entity resolution where they improve results.
  • Work with the evaluation team to turn QA findings into measurable improvements in output quality.
  • Model and maintain data in PostgreSQL, DynamoDB, OpenSearch, and S3/Athena.
  • Make pipelines resilient to bad inputs and unreliable upstream systems through retries, dead-letter queues, idempotency, and backfills.
  • Own the infrastructure, deployment, access controls, and observability for the systems you build.
  • Reduce processing time and cost without compromising quality.
  • Handle sensitive medical and legal information responsibly, and keep technical documentation current.
  • Take complex projects from technical design through production operation, identify failure modes, make practical tradeoffs, improve quality over time, and communicate risks early.
  • Contribute to the team’s technical direction and help other engineers make better decisions.

Desired Qualifications

  • Experience with Amazon Bedrock, retrieval-augmented generation, vector search, reranking, or LLM evaluation tools such as Langfuse, pydantic-evals, or Label Studio.
  • Experience with classic machine learning or natural language processing in production, including classifiers, embeddings, or entity resolution.
  • Experience with OpenSearch/Elasticsearch, Logstash, or Salesforce data integration.
  • Experience with infrastructure as code, GitHub Actions, Datadog, and CloudWatch.
  • Experience with dbt, Athena, or Looker.
  • Experience with TypeScript, NestJS, GraphQL, or Angular.
  • Experience in HIPAA or other regulated data environments.
  • Experience in legal technology or healthcare.
  • Productive use of AI coding agents such as Claude Code or Codex.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Expert Institute

See more jobs