What data are you bringing?

[DiamondKMG]

If you have a data set that you are planning to focus on at Image Datapalooza, could you drop a response here explaining a little about the data set and what questions you'd like to be able to answer?

[jennamk14]

Hi! I have access to a video dataset containing annotated behaviors of zebras and giraffes. I was part of the team that collected this dataset at the Mpala Research Center in Kenya last January. A few questions I would like to answer with this dataset:

1. Can we individually identify zebras and giraffes from videos? WildMe uses computer vision techniques to individually identify zebras and giraffes to identify individuals from photos. Can we build a pipeline to do the same thing from videos?
2. Can we combine the annotated video frames with the flight telemetry data to determine optimal angle, speed, etc. to improve the quality of the video data? Flight telemetry data includes timestamps, the drone's altitude, velocity in the x, y, and z axis, latitude and longitude, etc. Several videos we collected in Kenya were not usable for behavior annotation due to poor quality, so would like to do an analysis of our telemetry data to see if there are flight techniques we can implement to improve the quality of the video data in the future.

[nickynicolson]

I am currently supervising a couple of student projects that are building datasests from our Kew herbarium specimen digitisation project. Ideas for their areas of focus - for example, covering the building of datasets that display specific traits, and the integration of specimen images with other data (illustrations drawn from the specimen, scientific descriptions of the traits displayed by the specimen) are here: https://github.com/orgs/KewBridge/discussions
We also have some background info on the project here: https://github.com/KewBridge

[aperrault]

Hi! I have access to a video dataset containing annotated behaviors of zebras and giraffes. I was part of the team that collected this dataset at the Mpala Research Center in Kenya last January. A few questions I would like to answer with this dataset:

1. Can we individually identify zebras and giraffes from videos? WildMe uses computer vision techniques to individually identify zebras and giraffes to identify individuals from photos. Can we build a pipeline to do the same thing from videos?
2. Can we combine the annotated video frames with the flight telemetry data to determine optimal angle, speed, etc. to improve the quality of the video data? Flight telemetry data includes timestamps, the drone's altitude, velocity in the x, y, and z axis, latitude and longitude, etc. Several videos we collected in Kenya were not usable for behavior annotation due to poor quality, so would like to do an analysis of our telemetry data to see if there are flight techniques we can implement to improve the quality of the video data in the future.

I am quite interested in the second question and perhaps the broader question of how to optimize flight trajectories for identification.

[Callithrix-omics]

I have a large set of photographs of small Brazilian primate species (marmosets genus Callithrix) which hybridize anthropogenically. I also have genomic data on these hybrid to confirm their actual ancestral species. The photographs are facial as well as of various portions of the body and consist of reference ancestral species as well as various types of hybrids from various ancestral species combinations. There are various important conservation, ecological, and population management implications for properly identifying the likely ancestral species of hybrids based on phenotypic and genotypic information. The anthropogenic hybrids are considered exotic and invasive from where they are in the wild.

I am interested in learning about and using computer vision techniques to build AI models to identify the likely ancestral species of a given hybrid, as well as in the long term developing an easily accessible app incorporating such models that can be used by clinical and biological staff at animal triage centers in Brazil where apprehended or captured anthropogenic hybrids are managed and need to be identified properly.

[balhoff]

I'd like to work with the Plazi taxonomic treatments dataset, which includes many images with associated anatomical descriptions. However, the images typically contain several subpanels within each, and likewise the text combines the descriptions for all the sub panels. I'm hoping to separate these into correctly grouped images and descriptions, and further to link the text to taxonomic names and anatomy ontology concepts.

[douglasmbura]

Hi! I am particularly interested in how we can incorporate knowledge from local indigenous communities to create more contextually relevant image analysis techniques. Indigenous Communities possess deep knowledge about their local ecosystems, including wildlife behavior, migration patterns, and habitat preferences. Any Insights?

[DiamondKMG]

@douglasmbura I would be very interested in helping with/ learning more about this. Do you have a data set/ topic in mind? I don't have the data for this context but would love to learn more about how to do this for future projects/ contribute to other projects.

[douglasmbura]

@DiamondKMG Thanks alot for your interest. I work with the GEO Indigenous Alliance and I'm involved in a planned project that seeks to enhance the Samburu Community's resilience to disaster risks associated with famine and draught and reducing human-wildlife conflicts. The Samburu are pastrolist community which live in the semi-arid Northern part Kenya. Traditionally the community has relied on Indigenous knowledge of moving stars, the moon and insitu observations of behaviour of animals and birds to predict the occurrence of potential hazards. The idea therefore is to incorporate this indigenous insights to build a culturally acceptable solution. There's a plan to install camera traps in strategic locations to capture certain animal behaviours. The project is called "Lopa" which means The "Moon" Project. I would be glad to share with you alot more and will truly appreciate your help.

[DiamondKMG]

@DiamondKMG Thanks alot for your interest. I work with the GEO Indigenous Alliance and I'm involved in a planned project that seeks to enhance the Samburu Community's resilience to disaster risks associated with famine and draught and reducing human-wildlife conflicts. The Samburu are pastrolist community which live in the semi-arid Northern part Kenya. Traditionally the community has relied on Indigenous knowledge of moving stars, the moon and insitu observations of behaviour of animals and birds to predict the occurrence of potential hazards. The idea therefore is to incorporate this indigenous insights to build a culturally acceptable solution. There's a plan to install camera traps in strategic locations to capture certain animal behaviours. The project is called "Lopa" which means The "Moon" Project. I would be glad to share with you alot more and will truly appreciate your help.

That sounds so cool! I wonder if there's a way to use an ontology-like system to help with the data collection/ training process. Looking forward to learning more about the project when we are all in person next week! How do you respectfully collect/organize the indigenous knowledge if you don't mind sharing?

[douglasmbura]

@DiamondKMG Sure, there's a proposed way to collect the data in a structured way. I will share with you alot during the workshop. And I would also like to learn the best approaches.

[dirtmaxim]

Hi! I have access to a video dataset containing annotated behaviors of zebras and giraffes. I was part of the team that collected this dataset at the Mpala Research Center in Kenya last January. A few questions I would like to answer with this dataset:

1. Can we individually identify zebras and giraffes from videos? WildMe uses computer vision techniques to individually identify zebras and giraffes to identify individuals from photos. Can we build a pipeline to do the same thing from videos?
2. Can we combine the annotated video frames with the flight telemetry data to determine optimal angle, speed, etc. to improve the quality of the video data? Flight telemetry data includes timestamps, the drone's altitude, velocity in the x, y, and z axis, latitude and longitude, etc. Several videos we collected in Kenya were not usable for behavior annotation due to poor quality, so would like to do an analysis of our telemetry data to see if there are flight techniques we can implement to improve the quality of the video data in the future.

I want to add some ideas regarding the drone videos. The dataset contains annotations for the behavior of zebras and giraffes. We have already tested the dataset against several known action recognition models, but it is still interesting how much we can improve the classification results compared to our baseline. The dataset has labels for 3 species: Grevy's zebras, plains zebras, and giraffes. A few questions we can answer during Datapalooza:

1. Can we identify species by behavior alone?
2. Is it possible to determine the sex of animals by behavior?
3. Are there distinct behavioral traits that can help differentiate between subspecies of zebras (Grevy's zebras vs. plains zebras) or different age groups of giraffes?
4. How does the altitude and speed of the drone impact the quality and accuracy of behavior annotations?
5. Can we analyze how behavior changes in relation to geographical features, vegetation density, or other environmental factors visible in the drone footage?

[hhsieh]

Hi! I have access to a video dataset containing annotated behaviors of zebras and giraffes. I was part of the team that collected this dataset at the Mpala Research Center in Kenya last January. A few questions I would like to answer with this dataset:

1. Can we individually identify zebras and giraffes from videos? WildMe uses computer vision techniques to individually identify zebras and giraffes to identify individuals from photos. Can we build a pipeline to do the same thing from videos?
2. Can we combine the annotated video frames with the flight telemetry data to determine optimal angle, speed, etc. to improve the quality of the video data? Flight telemetry data includes timestamps, the drone's altitude, velocity in the x, y, and z axis, latitude and longitude, etc. Several videos we collected in Kenya were not usable for behavior annotation due to poor quality, so would like to do an analysis of our telemetry data to see if there are flight techniques we can implement to improve the quality of the video data in the future.

I want to add some ideas regarding the drone videos. The dataset contains annotations for the behavior of zebras and giraffes. We have already tested the dataset against several known action recognition models, but it is still interesting how much we can improve the classification results compared to our baseline. The dataset has labels for 3 species: Grevy's zebras, plains zebras, and giraffes. A few questions we can answer during Datapalooza:

1. Can we identify species by behavior alone?
2. Is it possible to determine the sex of animals by behavior?
3. Are there distinct behavioral traits that can help differentiate between subspecies of zebras (Grevy's zebras vs. plains zebras) or different age groups of giraffes?
4. How does the altitude and speed of the drone impact the quality and accuracy of behavior annotations?
5. Can we analyze how behavior changes in relation to geographical features, vegetation density, or other environmental factors visible in the drone footage?

Among these questions, I am in particular interested in questions 4 and 5. There could be an extension of question 5 - landscape of fear. How are the geographic features, vegetation density, or other environmental factors associated with the anti-predation behavior (e.g. alert, escape) of the herbivores? Do we see predators in the drone footage?

Were the drone footage taken at the same sites over time? Does fear of predation influence vegetation density and primary productivity?

Also, to reflect on questions 1, 2, and 3 - do the species, sex and subspecies of zebras show different anti-predation behavior and how the behavioral change in relation to fear within an herbivore population influence vegetation density and primary productivity?

There is a trade-off between predation risk and food intake. In response to lower vegetation availability in drought, the herbivores would need to take more risks to maintain a sufficient nutrient intake level. Drought would change the herbivores' anti-predation behavior.