Contact us info@computomics.com +49 7071 568 3995
company headquarter

Foundation Models

Unlocking the Future of Plant Breeding.

Unlocking the Future of Plant Breeding With AI Foundation Models

Why Foundation Models?

The field of plant breeding has experienced a significant surge in data collected in recent years, with massive growth in genetic, phenotypic, and environmental records. Traditional breeding approaches rely on statistical models that struggle to capture complex gene interactions and environmental influences. Machine learning techniques have helped bridge this gap by providing predictive insights, particularly for variety selection, trait development and plant health monitoring. However, machine learning models require extensive, high-quality datasets, which are expensive and difficult to obtain. Moreover, these models lack flexibility, often being trained for a single, narrow analysis task.

 

Foundation models offer a revolutionary approach that addresses these shortcomings. These models are pre-trained on broad datasets, enabling them to serve as a basis for specialized AI applications and adapt to new challenges with minimal additional training. By leveraging specifically adjusted foundation models, plant breeders can enhance prediction accuracy, accelerate breeding cycles, and make more informed decisions, even if they only have limited data available themselves.

What Are Foundation Models?

Foundation models are advanced AI consisting of deep learning architectures that serve as a versatile base for a wide range of applications. Trained on massive amounts of data, they capture intricate patterns in genetic sequences, allowing them to be fine-tuned to data for specific agricultural challenges.

Foundation models have three key characteristics:

Scalability and Architecture

Foundation models consist of deep neural networks with billions of parameters, enabling complex pattern recognition.

Pre-Training Process

Self-supervised learning techniques allow these models to understand biological sequences without labeled data.

Transferability and Fine-Tuning

Once trained, foundation models can be adapted for specialized tasks, such as predicting plant trait performance or identifying genetic markers linked to diseases.

Recent advancements in genomic foundation models, such as PlantCaduceus and AgroNT, demonstrate their potential in plant breeding. These models have been pre-trained on diverse plant genomes, allowing them to perform cross-species predictions and uncover functional genomic elements with high accuracy. The ability to process long genomic sequences makes them particularly valuable for understanding complex traits controlled by distant genetic interactions.

Foundation Models at Computomics

At Computomics, we are committed to harnessing the power of foundation models to boost plant breeding. Prof. Dr. Gunnar Rätsch and Prof. Dr. Karsten Borgwardt are two of our Scientific Advisory Board members who together bring decades of experience in AI, foundation models, and deep learning. Our goal is to integrate foundational models into predictive breeding pipelines, enabling more accurate trait selection and accelerating the development of resilient, high-yielding crops. By leveraging genomic language models, we can:

  • Enhance Genomic Selection: Improve the prediction of complex traits using multi-modal data integration (genotype, environment, and phenotype).
  • Develop Efficient Fine-Tuning Strategies: Optimize foundation models to work effectively with smaller, proprietary datasets.
  • Enable Cross-Species Insights: Utilize the transfer learning capabilities of foundation models to apply knowledge from well-studied crops to lesser-known species.
  • Future Climates: Train models on likely future climate conditions based on predicted environmental conditions using proprietary approaches to calculate microclimates.

As the agricultural sector faces increasing pressures from climate change and global food security concerns, the adoption of AI-driven tools will be critical in shaping the future of sustainable farming. Computomics is excited to be at the forefront of this transformation, bringing cutting-edge technology to plant breeders worldwide and exploring these new possibilities together. By working hand in hand, we can help advance the field and contribute to a more sustainable future in agriculture.

Get in touch with us