Vision datasets and detection pipelines

Large, clean image datasets do not exist for most specialized domains. I build the pipelines that create them, with iterative Grounding DINO detection, SAM and Mask2Former segmentation and VLM completeness checks, and release the resulting datasets with validated measurements.

Project pageImaging and trait-measurement workflow for pinned (top) and vial (bottom) specimens.
Scientific Data 2026First author

A continental-scale dataset of ground beetles with high-resolution images and validated morphological trait measurements

S M Rayeed, Mridul Khurana, Alyson East, Isadora E. Fluck, Elizabeth G. Campolongo, Samuel Stevens, Iuliia Zarubiieva, Scott C. Lowe, Michael W. Denslow, Evan D. Donoso, Jiaman Wu, Michelle Ramirez, Benjamin Baiser, Charles V. Stewart, Paula Mabee, Tanya Berger-Wolf, Anuj Karpatne, Hilmar Lapp, Robert P. Guralnick, Graham W. Taylor, Sydne Record
Scientific Data (Nature Portfolio), Data Descriptor

Over 13,200 NEON ground beetles from 30 sites across the continental US and Hawaii, imaged at high resolution with 39,064 elytra measurements. Measurements from images agree closely with calipers on physical specimens.

Individual specimen extraction: Grounding DINO with the prompt “a beetle.” detects each specimen in a group image, which is then cropped.
Individual specimen extraction: Grounding DINO with the prompt “a beetle.” detects each specimen in a group image, which is then cropped.
Elytra length from images (TORAS) against calipers on physical specimens, for three observers.
Elytra length from images (TORAS) against calipers on physical specimens, for three observers.
MEE 2026Under review

From collection trays to AI-ready data: An operational framework for automated entomological specimen processing

Alyson East, S M Rayeed, Elizabeth G. Campolongo, Nathan Cain, Chandra Earl, Michael Belitz, Isabelle Betancourt, Eric R. Sokol, Leah Cotton, Jacqueline Dominguez, Brennan Hays, Fangxun Liu, Samuel Stevens, Charles V. Stewart, Tanya Berger-Wolf, Wei-Lun Chao, Hilmar Lapp, Sydne Record
Methods in Ecology and Evolution (under review)

An end-to-end workflow from photographed collection trays to curated, AI-ready specimen data: iterative open-vocabulary detection with VLM completeness checks, scale-bar and color-card localization, automated metadata validation, and curation errors sent back to the biorepository.

BeetleFlow pipeline: iterative Grounding DINO detection with a VLM check, cropping and metadata matching, and Mask2Former part segmentation.
NeurIPS 2025 Workshop

BeetleFlow: An Integrative Deep Learning Pipeline for Beetle Image Processing

Fangxun Liu, S M Rayeed, Samuel Stevens, Alyson East, Cheng Hsuan Chiang, Colin Lee, Daniel Yi, Junke Yang, Tejas Naik, Ziyi Wang, Connor Kilrain, Elijah H. Buckwalter, Jiacheng Hou, Saul Ibaven Bueno, Shuheng Wang, Xinyue Ma, Yifan Liu, Zhiyuan Tao, Ziheng Zhang, Eric Sokol, Michael Belitz, Sydne Record, Charles V. Stewart, Wei-Lun Chao
NeurIPS 2025 Workshop on Imageomics

Three stages for tray images of pinned beetles: detect every specimen, crop and sort it with its metadata, and segment it into body parts. Detection matches the exact count on 97.81% of 1,506 NEON trays.

Part segmentation on NEON specimens: each pair shows a beetle and its annotated head, pronotum, elytra, legs and antennae.
Part segmentation on NEON specimens: each pair shows a beetle and its annotated head, pronotum, elytra, legs and antennae.
Ten considerations for imaging biological specimens for computer vision: metadata, positioning, size and color calibration, multiple specimens, background, lighting, resolution, file formats, archiving and data sharing.
MEE 2025

Optimizing Image Capture for Computer Vision-Powered Taxonomic Identification and Trait Recognition of Biodiversity Specimens

Alyson East, Elizabeth G. Campolongo, Luke Meyers, S M Rayeed, Samuel Stevens, Iuliia Zarubiieva, Isadora E. Fluck, Jennifer C. Girón, Maximiliane Jousse, Scott Lowe, Kayla I. Perry, Isabelle Betancourt, Noah Charney, Evan Donoso, Nathan Fox, Kim J. Landsbergen, Ekaterina Nepovinnykh, Michelle Ramirez, Parkash Singh, Khum Thapa-Magar, Matthew Thompson, Evan Waite, Tanya Berger-Wolf, Hilmar Lapp, Paula Mabee, Charles V. Stewart, Graham W. Taylor, Sydne Record
Methods in Ecology and Evolution, 2025

A practical framework, written by taxonomists, collection managers, ecologists and computer scientists together, for imaging specimens so that computer vision can use them: metadata, positioning, calibration, background, lighting, resolution and file formats.

Datasets

Other research areas