AI-ready biodiversity data

Most biodiversity data still sits in collection trays and vials. I co-lead the curation of a continental-scale ground beetle dataset with validated trait measurements, and build the detection, segmentation and verification pipelines that move specimens from a tray photograph to a clean, linked record.

Project pagePitfall traps30 NEON sitesSpecimens11,654 vial, 1,579 pinnedImagingup to 6960 x 4640 pxSpecimen cropsone image per beetleElytra traits39,064 measurementselytra lengthelytra width1 cmImage measurements agree with calipersThree annotators on vial imageselytra lengthR² 0.94Two observers with caliperspinned specimensR² 0.94Image tool (TORAS) vs caliperspinned specimensR² 0.9765Mean R² across specimens; full error statistics in the paper.
Scientific Data 2026First author

A continental-scale dataset of ground beetles with high-resolution images and validated morphological trait measurements

S M Rayeed, Mridul Khurana, Alyson East, Isadora E. Fluck, Elizabeth G. Campolongo, Samuel Stevens, Iuliia Zarubiieva, Scott C. Lowe, Michael W. Denslow, Evan D. Donoso, Jiaman Wu, Michelle Ramirez, Benjamin Baiser, Charles V. Stewart, Paula Mabee, Tanya Berger-Wolf, Anuj Karpatne, Hilmar Lapp, Robert P. Guralnick, Graham W. Taylor, Sydne Record
Scientific Data (Nature Portfolio), Data Descriptor

Over 13,200 NEON ground beetles from 30 sites across the continental US and Hawaii, imaged at high resolution with 39,064 elytra measurements. Measurements from images agree closely with calipers on physical specimens.

Tray photographIterative detectionGrounding DINO + SAM; found boxes aremasked and the tray is re-detected atlower thresholds, 0.30 down to 0.10VLM check:any left?yes: flag for recheckCropped and ordered123456Scale bar and color cardlocated with MoondreamNEON recordsMetadata validatedagainst the databaseCuration errors returned to the biorepository65,236specimens3,649trays518species96%tray-level detection
MEE 2026Under review

From collection trays to AI-ready data: An operational framework for automated entomological specimen processing

S M Rayeed (co-author)
Methods in Ecology and Evolution (under review)

An end-to-end workflow from photographed collection trays to curated, AI-ready specimen data: iterative open-vocabulary detection with VLM completeness checks, scale-bar and color-card localization, automated metadata validation, and curation errors sent back to the biorepository.

DetectCrop and sortSegmentID 101ID 102ID 103ID 104ID 105ID 106HeadPronotumElytraLegsAntennae97.81%of 1,506 NEON trayscounted exactly1 cropper beetle, matchedto its metadata85.11mIoU, 5 parts77.38 with 9 parts
NeurIPS 2025 Workshop

BeetleFlow: An Integrative Deep Learning Pipeline for Beetle Image Processing

Fangxun Liu, S M Rayeed, Samuel Stevens, Alyson East, + 17 co-authors, Sydne Record, Charles V. Stewart, Wei-Lun Chao
NeurIPS 2025 Workshop on Imageomics

Three stages for tray images of pinned beetles: detect every specimen, crop and sort it with its metadata, and segment it into body parts. Detection matches the exact count on 97.81% of 1,506 NEON trays.

ID 0412Metadata and labelsResolution and magnificationScale bar in frameLossless file formatsStandard positioningColor calibration cardUniform backgroundEven, diffuse lighting
MEE 2025

Optimizing Image Capture for Computer Vision-Powered Taxonomic Identification and Trait Recognition of Biodiversity Specimens

Alyson East, Elizabeth G. Campolongo, Luke Meyers, S M Rayeed, Samuel Stevens, Iuliia Zarubiieva, Isadora E. Fluck, + 21 co-authors, Sydne Record
Methods in Ecology and Evolution, 2025

A practical framework, written by taxonomists, collection managers, ecologists and computer scientists together, for imaging specimens so that computer vision can use them: metadata, positioning, calibration, background, lighting, resolution and file formats.

Datasets

Hawaii-beetles

Hugging Face, DOI 10.57967/hf/7272, CC BY 4.0

Pinned carabids from NEON's Hawaii site: 162 group images, 1,614 individual specimen crops and 1,579 trait rows across 14 endemic species, with caliper and image-based elytra measurements.

2018-NEON-beetles

Hugging Face, DOI 10.57967/hf/6890, CC BY-SA 4.0

Ethanol-preserved carabids from 30 NEON sites: 577 group images, 11,654 individual specimen images and 39,064 elytra measurement records, plus segmentation train and test splits.

Other research areas