Weekly Group Meeting – Week 5

Attendees:

• Thomas Deatherage
• Vy Nguyen
• Romouald Dombrovski

Summary:

Thomas Deatherage

• Merged https://github.com/BioCosmos-AI/BioCosmos/pull/2
• Should we archive https://github.com/Human-Augment-Analytics/NFHM ?
• Will begin looking into and experimenting Florence-2
  • https://blog.roboflow.com/florence-2/ 
  • Focusing on trait grounding and trait referring, per our plan with Dr Porto
• Will be absent starting tomorrow (9/18) to Monday (9/23)

Romouald Dombrovski

• Read up on Florence-2 in the paper 
• Updated VLM4Bio scripts to be more useable by the BioCosmos team
• Fixed bugs with index out of range on the classifier script
• Investigating embeddings generated by florence-2

Vy Nguyen

• After detecting species using Florence-2, I continued to explore using another model (Mask R-CNN with a ResNet-50 backbone) to perform segmentation for trait identification. This segmentation will be used for purposes such as trait counting and identification.
• Update our website