N

Neurophos

Optical metasurface AI accelerators

Senior Modeling Architect - Performance Benchmarking

Hardware EngineeringConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • A BS or MS in Computer Engineering, Electrical Engineering, Computer Science, or equivalent practical experience.
  • At least 5 years of experience in GPU performance engineering, accelerator benchmarking, HPC performance measurement, or ML systems measurement.
  • A track record of building or operating benchmark harnesses that produced measured results on real GPUs or accelerators, including turning a Hugging Face model card, paper, or application description into a runnable benchmark.
  • Hands-on experience with roofline analysis, limiter analysis, or analytical performance modeling.
  • GPU performance analysis using NVIDIA Nsight Systems and Nsight Compute, or an equivalent profiler, covering HBM-bound versus compute-bound analysis, precision (FP16, BF16, FP8, INT8), and batching.
  • Working knowledge of LLM inference stacks such as Hugging Face, vLLM, SGLang, or TensorRT-LLM, including prefill versus decode, continuous batching, and Mixture-of-Experts (MoE).
  • Proficiency in Python for harnesses, parsing, and plots, and comfort working in Linux.
  • Cloud GPU operations on AWS, GCP, or Azure, including containers, instance types, drivers, quotas, and cost.

Responsibilities

  • Own the performance and energy metrics that architecture, product, and leadership rely on, and keep them consistent across modeling fidelities and measured hardware.
  • Produce numbers for the same workloads across roofline and limiter models, architecture performance models, in-house RTL simulation, and measured competitor hardware; work with the modeling team to keep simulated and measured workload sets aligned.
  • Hold workload definitions constant across fidelities, including model or application, sequence length, batch, precision, prefill versus decode, and tensor, pipeline, and sequence parallelism.
  • Bring up inference workloads from Hugging Face, PyTorch, published papers, and vendor stacks such as vLLM, SGLang, TensorRT-LLM, and Triton Inference Server. Workloads include dense and Mixture-of-Experts transformers, attention and KV-cache reduction strategies, hybrid/SSM models, retrieval, speech, vision, and recommendation workloads that map onto the accelerator.
  • Measure competing GPUs and accelerators end-to-end, owning the cloud or lab account, image, drivers, and run recipe.
  • Report time to first token (TTFT), inter-token latency (ITL), tokens per second, tokens per second per watt, and energy using nvidia-smi, DCGM, power capping, or equivalent instrumentation.
  • Document where RTL simulation, the performance model, and measured competitor results disagree, and attach the configurations and logs behind each.
  • Maintain a reviewed internal benchmark suite; keep internal-only results clearly separate from results cleared for customer or public use, and route external claims through the designated approver before they ship.

Desired Qualifications

  • Experience correlating a performance model or RTL/Verilator simulation against measured silicon or GPUs.
  • GPU kernel work in CUDA, CUTLASS, or Triton, or familiarity with PyTorch internals.
  • Familiarity with current inference-serving internals such as PagedAttention, FlashAttention, speculative decoding, and disaggregated prefill.
  • Distributed inference experience covering collectives, all-reduce, NCCL, NVLink, and InfiniBand, or work with MLPerf or production inference benchmarking pipelines.
  • Background at a hyperscaler, GPU vendor, accelerator company, or inference lab.

About the Company

Neurophos

Optical metasurface AI accelerators

Neurophos designs AI accelerator chips built with optical metasurfaces and silicon photonics to deliver high-density, energy-efficient AI computation for data centers. Its processors are designed to shrink optical components by about 8000x, increasing compute power per dollar spent and reducing both capital and operating expenditures. The product works by using optical processing techniques that handle AI inference workloads more efficiently than traditional GPUs or electronic AI accelerators, enabling faster throughput with lower power use. Neurophos differentiates itself by combining optical metasurfaces with silicon photonics to achieve higher density and energy efficiency, targeting data centers and enterprises that need scalable, cost-sensitive AI inference. The company aims to reshape the AI landscape by offering faster, denser, and more energy-efficient AI computation while lowering the total cost of ownership for data centers.

Company size
51-200
Company stage
Series A
Total funding
$117.2M
Headquarters
Austin, TX
Founded
2020

Recently Posted Jobs

Explore more opportunities at Neurophos

See more jobs