Senior AI/Machine Learning Engineer

Goodfire's EVEE reclassifies a hearing-loss variant scoring 4.2M entries. Goodfire's EVEE system scored every ClinVar variant with an interpretable probe on Evo 2 embeddings, triggering a real reclassification of a hearing loss mutation. · 4 hrs ago Read 6 min * Goodfire and Mayo Clinic's EVEE scored all 4.2M ClinVar variants with interpretable predictions. * MEPE c.209_212del was reclassified as likely pathogenic, linked to hearing loss. * Pathogenicity probe hits 0.997 AUROC on 839k SNVs, 0.991 on indels zero-shot. * Built on frozen Evo 2 embeddings with covariance-based sequence pooling, not end-to-end fine-tuning. * Annotation probes plus Claude Sonnet 4.6 generate readable disruption hypotheses per variant. * Roughly 2M variants of uncertain significance now have structured mechanistic hypotheses attached. How EVEE helped reclassify a hearing-loss variant. Goodfire's machine-learning system helped move a MEPE variant associated with hearing loss from "uncertain significance" to "likely pathogenic" in ClinVar, the public archive maintained by the National Center for Biotechnology Information. After scoring 4.2 million ClinVar entries, the system highlighted MEPE c.209_212del as a candidate for clinical review. The system, called EVEE, or Evo Variant Effect Explorer, combines a genomic foundation model, small supervised classifiers called probes, and a reasoning large language model. Goodfire developed it with Mayo Clinic to rank variants, predict disrupted biological features, and generate testable explanations of how a mutation might cause disease. Goodfire describes the methods in its research report. Two million unresolved variants. ClinVar aggregates variant classifications from clinical laboratories, researchers, expert panels, and professional organizations. When sequencing identifies a potentially relevant mutation, clinicians consult these assertions alongside a patient's symptoms, family history, inheritance pattern, and other evidence. A variant of uncertain significance, commonly shortened to VUS, lacks enough evidence for a confident classification. A VUS generally cannot guide diagnosis or medical management. In the ClinVar snapshot analyzed by Goodfire, roughly 2 million of 4.2 million entries carried that label. Current predictors cover different parts of the problem. Protein-focused systems such as AlphaMissense primarily evaluate missense variants, which change one amino acid. They can miss mutations that alter RNA splicing, gene regulation, or other non-protein mechanisms. Genome-wide tools such as CADD combine more than 100 annotations, but their transformed and interacting features can make an individual prediction difficult to explain. Freeze the model, train the probes. EVEE builds on Evo 2, a neural network trained on billions of DNA bases from organisms across the tree of life. The authors report that Evo 2 was not trained on human genetic-variation records, allowing them to test whether its learned representation of genomic structure transfers to clinical variants. Goodfire freezes Evo 2's parameters and trains lightweight probes on its internal representations, or embeddings. Freezing reduces training cost and preserves the base model, while each probe learns a focused task from labeled examples. * EVEE encodes the reference DNA sequence and the mutated sequence with Evo 2. * Covariance-based pooling summarizes relationships among sequence features. * A pathogenicity probe compares the two representations and assigns a score. * Annotation probes estimate changes to splice sites, regulatory elements, structural domains, and other known features. * A reasoning model combines those signals with gene context to draft a mechanistic hypothesis. Covariance pooling preserves feature co-occurrence across a sequence, such as a motif appearing within a particular structural context. Mean pooling averages positions together and can erase those relationships. The pathogenicity probe operates on the difference between the pooled reference and mutant embeddings. What 0.997 AUROC captures. Goodfire reports strong ranking performance across single-nucleotide variants and short insertions or deletions. AUROC measures how reliably a model ranks pathogenic variants above benign ones across many classification thresholds, with 1.0 representing perfect ranking and 0.5 representing chance. | Evaluation | Scope | AUROC | Training status | | ClinVar single-nucleotide variants | 839,000 variants | 0.997 | Primary variant class | | Short insertions and deletions | Variant count not specified | 0.991 | Zero-shot transfer | The authors also report better performance than classical meta-predictors, protein-specific systems, and other foundation-model approaches across consequence types and conservation levels. EVEE transferred to deep mutational-scanning datasets for BRCA1, BRCA2, TP53, and LDLR, which experimentally measure the effects of many mutations in parallel. AUROC leaves several deployment questions open, including probability calibration, performance within specific patient populations, and the positive predictive value for rare variant classes. Clinical use also requires prospective validation beyond retrospective benchmark labels. Mechanisms in plain language. Annotation probes estimate how a mutation changes recognizable biological features. For each variant, EVEE compares the probe outputs for the reference and mutant sequences, producing a "disruption profile" that identifies the largest predicted changes. Goodfire says the public application uses Claude Sonnet 4.6 to combine the disruption profile, pathogenicity score, and gene context into a natural-language hypothesis. The resulting explanation can suggest mechanisms for expert review, such as altered splicing or disruption of a functional domain. Goodfire evaluated the explanations against 154 ClinVar variants carrying at least three review stars, a level associated with expert-panel or practice-guideline review. An LLM judge scored mechanism coverage, biological accuracy, and specificity. EVEE received a composite score of 3.8 out of 5, compared with 2.8 for explanations generated from variant metadata alone. The MEPE assertion changes. The MEPE variant c.209_212del deletes four bases from the coding sequence, which is expected to shift the gene's reading frame. Goodfire reports that EVEE ranked it highly enough to prompt a focused evidence review and contributed to its classification moving from VUS to likely pathogenic. That category can support a diagnosis when the molecular evidence aligns with phenotype, inheritance, and other clinical findings. ClinVar stores assertions from submitters and can display conflicting classifications for the same variant. A reclassification therefore reflects a changed or added submission, including its evidence and review status. NCBI does not independently adjudicate every assertion deposited in the archive. The MEPE case documents a practical workflow: score millions of records, prioritize a manageable set, generate mechanistic leads, and assemble evidence for expert review. A single successful reclassification does not measure the system's prospective clinical accuracy, but it shows how computational prioritization can enter an established variant-curation process. How to test EVEE. * The free EVEE web app provides precomputed scores and disruption profiles for 4.2 million ClinVar variants. * Users can request natural-language explanations for individual variants, including VUS entries. * Researchers can inspect EVEE's predictions as candidate mechanisms for laboratory testing or manual curation. * The covariance-pooling and probe-based design can be adapted to other genomic prediction tasks built on frozen sequence models. Research guardrails. * Predictions require validation. Pathogenicity scores and generated explanations remain research hypotheses until supported by clinical, functional, or segregation evidence. * Probes reflect their labels. Annotation probes can identify biological concepts represented in their training data. Uncharacterized mechanisms may remain hidden. * Generated prose can fail. The language model may omit relevant evidence, overstate a mechanism, or introduce an unsupported claim. Experts should inspect the underlying scores and sources. * Aggregate metrics have limits. High AUROC does not provide a calibrated patient-level probability or guarantee performance for every gene, ancestry, or variant class. * The explanation evaluation is indirect. An LLM judge offers a scalable comparison, while experimental evidence and specialist review provide stronger validation. * The work remains preliminary. The research is available as a bioRxiv preprint and is undergoing peer review. A pattern beyond genomics. EVEE's architecture turns a foundation model's internal representations into named biological concepts. The frozen model supplies broad sequence features, supervised probes map those features to known annotations, and the language model assembles the results into readable hypotheses. For teams building variant-effect predictors or interpretability systems for scientific models, EVEE offers a concrete reference design. Its broader value will depend on prospective validation, transparent evaluation, and evidence that the generated mechanisms help researchers choose better experiments and clinicians curate variants more efficiently.

5 things to catch. What's happening this week? Today at 5:00 AM News Reporting 1. More medical research Using data from almost 40,000 patients' health records, a team of Mayo Clinic researchers are testing an AI tool to predict one's pancreatic cancer risk. Read all about the research in the Tuesday edition of the Post Bulletin. Zumbrota-Mazeppa knocks off Winona Cotter, relishing new era of Z-M football 2. Century grad a smash hit at UMD Century graduate Paige Decker, now a college senior, has helped guide the University of Minnesota Duluth volleyball team to a 16-1 record this season. She is one of three southeastern Minnesotans on the team, and is one of UMD's best players. PB sports reporter has her story in Tuesday's Sports. 3. Election coverage continues As we get closer to the November election, we'll have more stories in our paper this week. Look out for stories on the auditor's race and the Rochester mayor's race. 4. Making a splash Elise Weingarten has had some outstanding role models to learn from during her time in competitive swimming. Now it's her turn to be a leader on the Mayo High swimming and diving team, while going through the college recruiting process. PB sports reporter Madeline Warren has Weingarten's story on Tuesday. 5. Lack of officials? In the Saturday edition of the Post Bulletin, we'll have a look at how those who are officiating local high school games has changed over time. Look for that story later this week. News Reporting Our newsroom occasionally reports stories under a byline of "staff." Often, the "staff" byline is used when rewriting basic news briefs that originate from official sources, such as a city press release about a road closure, and which require little or no reporting. At times, this byline is used when a news story includes numerous authors or when the story is formed by aggregating previously reported news from various sources. If outside sources are used, it is noted within the story. More stories for you. Get daily personally-crafted news reviews from Editor Jeff Pieters in your inbox. Conversation