H

Highlight AI

On-screen AI assistant with private data

Member of Technical Staff - ML

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA

About the Job

Requirements

  • Have 4+ years of experience in machine learning or artificial intelligence engineering, including significant experience shipping production systems.
  • Have strong software engineering fundamentals and write clean, maintainable code.
  • Have deep experience with retrieval, ranking, retrieval-augmented generation, or search systems at scale.
  • Have hands-on proficiency with PyTorch, vector databases, and modern machine learning infrastructure.
  • Have experience with large language model applications, including prompt engineering, fine-tuning, and evaluation frameworks.
  • Understand how to connect machine learning products to constraints, evaluations, and modeling.
  • Be based in or willing to relocate to San Francisco.
  • Work on site in the office five days a week.

Responsibilities

  • Design, build, and optimize machine learning pipelines for context retrieval, action detection, and output generation.
  • Implement and iterate on retrieval-augmented generation systems, ranking models, and prompt engineering to improve quality.
  • Build comprehensive evaluations and monitoring to measure and improve machine learning system performance.
  • Investigate alternative models and fine-tuning approaches for background processing workloads, implementing improved systems to increase quality and cost efficiency.
  • Collaborate with Backend and Product Engineering to ship AI-powered features.
  • Contribute to machine learning infrastructure decisions and best practices across the engineering organization.
  • Stay current on large language model advances, retrieval techniques, and machine learning tooling, and bring insights back to the team.
  • Own critical systems end to end and collaborate with the Head of AI Engineering to scale machine learning capabilities.

Desired Qualifications

  • Experience connecting machine learning products to product constraints, evaluations, and modeling.
  • Ship quickly, measure rigorously, and iterate based on data.

About the Company

Highlight AI

On-screen AI assistant with private data

Highlight AI provides an on-screen AI assistant that sits on the user’s desktop and offers instant, smart, and shareable answers based on what the user sees and does. It works by staying constantly accessible on the screen and using the user’s on-device data to generate responses, with privacy kept by storing data locally until the user chooses to share it. The system can understand and respond to anything the user sees, hears, or says, and is customizable for different business software environments. Revenue likely comes from subscriptions or licenses for access to the AI platform. Compared with competitors, its main differences are a privacy-first approach (data stays on the device unless shared), on-screen accessibility, and easy-to-use customization across industries such as education, healthcare, legal, and engineering. The goal is to deliver a private, easily accessible AI experience that improves efficiency for professionals while protecting user data.

Company size
11-50
Company stage
Series A
Total funding
$50.1M
Headquarters
San Francisco, CA
Founded
2024

Recently Posted Jobs

Explore more opportunities at Highlight AI

See more jobs