• Home
  • Search
  • BarcodeBERT: transformers for biodiversity analyses
  • Cite Icon1
  • https://doi.org/10.1093/bioadv/vbag054Copy DOI Icon

BarcodeBERT: transformers for biodiversity analyses

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

MotivationIn the global effort to characterize biodiversity, short species-specific genomic sequences known as DNA barcodes enable fine-grained comparisons among organisms within the same kingdom of life. Although machine learning algorithms specifically designed for the analysis of DNA barcodes are becoming more popular, most existing methodologies rely on generic supervised training algorithms.ResultsWe introduce BarcodeBERT, a family of models tailored to biodiversity analysis and trained exclusively on data from a reference library of 1.5 M invertebrate DNA barcodes. We evaluate BarcodeBERT on taxonomic identification tasks against a spectrum of machine learning approaches, including supervised training of classical neural architectures and fine-tuning of general DNA foundation models. Our self-supervised pretraining strategies on domain-specific data outperform fine-tuned foundation models, especially in identification tasks involving lower taxa such as genera and species. Compared with BLAST, a widely used sequence-search tool, BarcodeBERT achieves comparable species-level classification accuracy while being 55× faster. Our analysis of masking and tokenization strategies also provides practical guidance for building customized DNA language models, emphasizing the importance of aligning model training strategies with dataset characteristics and domain knowledge.Availability and implementationThe code repository is available at https://github.com/bioscan-ml/BarcodeBERT.

Similar Papers
  • Research Article
  • Citations9

DNA barcoding and metabarcoding of highly diverse aquatic mites (Acarina) can improve their use in routine biological monitoring

  • May 17, 2022
  • Marine and Freshwater Research
  • Melissa E Carew +4
  • Research Article
  • Citations1025

Many species in one: DNA barcoding overestimates the number of species when nuclear mitochondrial pseudogenes are coamplified

  • Sep 09, 2008
  • Proceedings of the National Academy of Sciences
  • Hojun Song +3
  • PDF
  • Research Article
  • Citations22

Alignment-free analysis of barcode sequences by means of compression-based methods

  • Apr 01, 2013
  • BMC Bioinformatics
  • Massimo La Rosa +3
  • Research Article
  • Citations11

DNA barcoding reveals CITES-listed species among Taiwanese government-seized chelonian specimens.

  • Jun 19, 2018
  • Genome
  • Chia-Hao Chang +6
  • Supplementary Content

Optimising Extraction of DNA From Museum Insect Specimens

  • Sep 26, 2025
  • Molecular Ecology Resources
  • Andrew Dopheide +1
  • Research Article

Is Federated Learning Still Alive in the Foundation Model Era?

  • May 20, 2024
  • Proceedings of the AAAI Symposium Series
  • Nathalie Baracaldo
  • Research Article
  • Citations1

Application of DNA barcoding and morphometric analysis in differentiating cystacanths of Polymorphus species (Acanthocephala: Polymorphidae) from central Alberta, Canada.

  • Sep 07, 2020
  • Parasitology Research
  • Zhuoyan Song +1
  • Research Article

The Impact of Occupancy Dynamics on Indoor CO2 Forecasting: A Cross-Scenario Evaluation

  • Mar 24, 2026
  • Forecasting
  • Peio Garcia-Pinilla +3
  • PDF
  • Research Article
  • Citations24

DNA Barcoding analysis of seafood accuracy in Washington, D.C. restaurants

  • Apr 25, 2017
  • PeerJ
  • David B Stern +3
  • PDF
  • Research Article
  • Citations5

PROTAX-GPU: a scalable probabilistic taxonomic classification system for DNA barcodes.

  • May 06, 2024
  • Philosophical transactions of the Royal Society of London. Series B, Biological sciences
  • Roy Li +4
  • Research Article
  • Citations1

Chloroplast structure, codon usage bias, and machine learning-based molecular identification using DNA barcoding of Sophorae Tonkinensis Radix et Rhizoma (Shan Dou Gen) and its analogues.

  • Jan 01, 2026
  • Fitoterapia
  • Mengdi Zheng +4
  • Research Article
  • Citations4

DNA barcoding, identification, and validation of the pufferfish (Order: Tetraodontiformes) in China coastal waters

  • Feb 01, 2024
  • Ecology and Evolution
  • Kaiying Liu +7
  • Research Article

Abstract 4366734: Mortality Prediction in Cardiogenic Shock Using a Time Series Machine Learning Foundation Model

  • Nov 04, 2025
  • Circulation
  • Curtis Ginder +7
  • PDF
  • Research Article
  • Citations108

DiversityScanner: Robotic handling of small invertebrates with machine learning methods.

  • Dec 23, 2021
  • Molecular Ecology Resources
  • Lorenz Wührl +8
  • Conference Article

Exploring Foundation Models for Synthetic Medical Imaging: A Study on Chest X-Rays and Fine-Tuning Techniques

  • Sep 30, 2024
  • Davide Clode Da Silva +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.