Projects

Lizard X-ray

Lizard X-ray

User Interface Project

The goal of this project is to develop a user-friendly tool that automates the placement of anatomical landmarks on lizards. Landmarks are annotated points on a specimen, such as joints, that enable researchers to measure and compare individuals. These comparisons support the identification of broader morphological patterns within and across ecosystems. The tool integrates a pose-estimation model to predict landmark locations and is connected to an interactive user interface that allows users to edit, visualize, and download the model’s predictions. By streamlining the data collection process, this tool helps researchers work more efficiently, allowing them to focus on analysis and discovery rather than manual annotation.

To get the most recent updates on this project, visit our Wikipedia page: https://humanaugmentedanalyticsgroup.miraheze.org/wiki/Stroud_Lab_Projects/Lizard_Morph
Lizard Toepads

Lizard Toepads

User interface Project

The goal of this project is to develop an automated machine learning pipeline that applies morphometric measurements to lizard toepad scans, building directly on the framework used for the lizard x-ray project. We currently perform this process manually, but now have a large, annotated dataset available for researchers to use in developing and refining an automated pipeline. The same pipeline architecture and graphical user interface (GUI) from the lizard x-ray project will be leveraged for consistency and efficiency. At present, a YOLO model has already been trained to detect and localize the toepads in images. Students will have the opportunity to iterate on and improve this model to increase accuracy and robustness. The next step in the pipeline will involve building a model capable of automatically placing thin-plate spline (TPS) landmark points on the detected toepads, enabling high-throughput morphometric analysis.

Natural History Museum Digital Catalog

Natural History Museum Digital Catalog

User Interface Project

This project aims to develop a robust (work in a harsh field environment), high-performance, and open-source cross-platform app to record natural history specimens. The app will streamline data recording from the field/lab collections to the museum database. Our work will revolutionize natural history studies, making them more efficient, accessible, and reproducible. It will reduce the cost of maintaining biological collections and minimize errors in data recording. Downstream research, such as studies on parasites and genomics using non-model organisms, as well as any other studies that rely on natural history collections, will significantly benefit from having consistent and predictable data sources.

BioCosmos

BioCosmos

User Interface Project

This project aims to develop a multimodal, AI-powered interface for biologists to search a species database by image or text. At its core is a language-vision model (LVM) trained to capture fine-grained relationships across modalities: jointly learned image and text encoders bridge the gap between visual data and natural language. Users will be able to enter a text query or upload an image query into the web application interface, the LVM embeds the query, a vector search is performed against the database, and ultimately a gallery of database items most similar to the query is populated for the user. The MVP focuses on butterflies, with plans to expand the system to cover additional taxa in future releases.

To learn more, check out: https://humanaugmentedanalyticsgroup.miraheze.org/wiki/BioCosmos

Past Seminars

Publications

  • A paper on the “Lizard X-ray” software is submitted to ACM CHI Conference for review.