H

Hark

Develops proactive multimodal personal AI hardware

Member of Technical Staff

Natural Language Processing & LLMsPosted on Nov 9
Full-timeSan Jose, CA, USA$180k - $450k /yrIn-person

About the Job

Requirements

  • Experience with continued pretraining or late-stage training, such as learning-rate decay, high-quality data mixtures, or context extension.
  • Experience building synthetic data pipelines, including generation, verification, and filtering, and evaluating their effects on model quality and data diversity.
  • Strong experimental judgment, including isolating recipe changes in controlled ablations and assessing whether improvements transfer to larger runs.
  • Experience implementing and debugging distributed training workloads across GPU clusters.
  • Experience designing evaluations and identifying confounds such as benchmark contamination, prompt sensitivity, and formatting effects.
  • Strong engineering skills, including implementing training methods and building reliable data and experimentation pipelines.
  • A record of improving model capabilities or training methods through research, datasets, systems, or production work.

Responsibilities

  • Develop mid-training recipes using high-quality and synthetic data, including learning-rate decay schedules and data-mixture changes.
  • Build synthetic data pipelines with code execution tests, math-answer checks, and filters for reasoning traces.
  • Distill capabilities from larger models into smaller models through synthetic data generation and rejection sampling.
  • Develop long-context data recipes, including document packing and sequence construction, and evaluate their effect on both long- and short-context performance.
  • Evaluate mid-training checkpoints with the post-training team, measure how well results predict subsequent model quality, and select checkpoints for further training.
  • Run controlled experiments on learning-rate schedules, mixture weights, and data ordering across text, code, and multimodal training data.

Desired Qualifications

  • Experience with distillation, rejection sampling, or model-based data generation for reasoning, code, or math.
  • Experience with long-context training, including rotary position embedding (RoPE) scaling, context parallelism, or long-document datasets.
  • Experience with post-training and evaluating how pretrained checkpoints respond to subsequent adaptation.
  • Experience training or distilling smaller models for constrained inference budgets.
  • Experience with audio, speech, image, video, or interleaved multimodal datasets.
  • Experience detecting benchmark contamination and removing overlapping examples from training data.

About the Company

Hark

Develops proactive multimodal personal AI hardware

Hark builds personal AI hardware and software by vertically integrating AI research with consumer electronics to create a proactive, human-centric digital companion. It runs recursive, multimodal AI on custom-built devices, combining speech, vision, and touch to understand real-world context and reduce cognitive load. Unlike rivals, it controls the full stack—from silicon to user interface—emphasizing privacy, speed, and agentic, goal-directed behavior without relying on third-party operating systems. Its goal is to redefine personal computing by delivering a private, seamless experience that blends advanced AI with high-quality hardware.

Company size
51-200
Company stage
Series A
Total funding
$800M
Headquarters
San Jose, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at Hark

See more jobs