<p>All of life encodes information with DNA. Although tools for genome sequencing, synthesis and editing have transformed biological research, we still lack sufficient understanding of the immense complexity encoded by genomes to predict the effects of many classes of genomic changes or to intelligently compose new biological systems. Artificial intelligence models that learn information from genomic sequences across diverse organisms have increasingly advanced prediction and design capabilities<sup><CitationRef CitationID="CR1">1</CitationRef>,<CitationRef CitationID="CR2">2</CitationRef></sup>. Here we introduce Evo 2, a biological foundation model trained on 9 trillion DNA base pairs from a highly curated genomic atlas spanning all domains of life to have a 1 million token context window with single-nucleotide resolution. Evo 2 learns to accurately predict the functional impacts of genetic variation—from noncoding pathogenic mutations to clinically significant <i>BRCA1</i> variants—without task-specific fine-tuning. Mechanistic interpretability analyses reveal that Evo 2 learns representations associated with biological features, including exon–intron boundaries, transcription factor binding sites, protein structural elements and prophage genomic regions. The generative abilities of Evo 2 produce mitochondrial, prokaryotic and eukaryotic sequences at genome scale with greater naturalness and coherence than previous methods. Evo 2 also generates experimentally validated chromatin accessibility patterns when guided by predictive models<sup><CitationRef CitationID="CR3">3</CitationRef>,<CitationRef CitationID="CR4">4</CitationRef></sup> and inference-time search. We have made Evo 2 fully open, including model parameters, training code<sup><CitationRef CitationID="CR5">5</CitationRef></sup>, inference code and the OpenGenome2 dataset, to accelerate the exploration and design of biological complexity.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Genome modelling and design across all domains of life with Evo 2

  • Garyk Brixi,
  • Matthew G. Durrant,
  • Jerome Ku,
  • Mohsen Naghipourfar,
  • Michael Poli,
  • Gwanggyu Sun,
  • Greg Brockman,
  • Daniel Chang,
  • Alison Fanton,
  • Gabriel A. Gonzalez,
  • Samuel H. King,
  • David B. Li,
  • Aditi T. Merchant,
  • Eric Nguyen,
  • Chiara Ricci-Tam,
  • David W. Romero,
  • Jonathan C. Schmok,
  • Ali Taghibakhshi,
  • Anton Vorontsov,
  • Brandon Yang,
  • Myra Deng,
  • Liv Gorton,
  • Nam Nguyen,
  • Nicholas K. Wang,
  • Michael T. Pearce,
  • Elana Simon,
  • Etowah Adams,
  • Zachary J. Amador,
  • Euan A. Ashley,
  • Stephen A. Baccus,
  • Haoyu Dai,
  • Steven Dillmann,
  • Stefano Ermon,
  • Daniel Guo,
  • Michael H. Herschl,
  • Rajesh Ilango,
  • Ken Janik,
  • Amy X. Lu,
  • Reshma Mehta,
  • Mohammad R. K. Mofrad,
  • Madelena Y. Ng,
  • Jaspreet Pannu,
  • Christopher Ré,
  • John St. John,
  • Jeremy Sullivan,
  • Joseph Tey,
  • Ben Viggiano,
  • Kevin Zhu,
  • Greg Zynda,
  • Daniel Balsam,
  • Patrick Collison,
  • Anthony B. Costa,
  • Tina Hernandez-Boussard,
  • Eric Ho,
  • Ming-Yu Liu,
  • Thomas McGrath,
  • Kimberly Powell,
  • Sudarshan Pinglay,
  • Dave P. Burke,
  • Hani Goodarzi,
  • Patrick D. Hsu,
  • Brian L. Hie

摘要

All of life encodes information with DNA. Although tools for genome sequencing, synthesis and editing have transformed biological research, we still lack sufficient understanding of the immense complexity encoded by genomes to predict the effects of many classes of genomic changes or to intelligently compose new biological systems. Artificial intelligence models that learn information from genomic sequences across diverse organisms have increasingly advanced prediction and design capabilities1,2. Here we introduce Evo 2, a biological foundation model trained on 9 trillion DNA base pairs from a highly curated genomic atlas spanning all domains of life to have a 1 million token context window with single-nucleotide resolution. Evo 2 learns to accurately predict the functional impacts of genetic variation—from noncoding pathogenic mutations to clinically significant BRCA1 variants—without task-specific fine-tuning. Mechanistic interpretability analyses reveal that Evo 2 learns representations associated with biological features, including exon–intron boundaries, transcription factor binding sites, protein structural elements and prophage genomic regions. The generative abilities of Evo 2 produce mitochondrial, prokaryotic and eukaryotic sequences at genome scale with greater naturalness and coherence than previous methods. Evo 2 also generates experimentally validated chromatin accessibility patterns when guided by predictive models3,4 and inference-time search. We have made Evo 2 fully open, including model parameters, training code5, inference code and the OpenGenome2 dataset, to accelerate the exploration and design of biological complexity.