ΑΙhub.org
 

AI can track bees on camera. Here’s how that will help farmers


by
23 February 2023



share this:
a bee on a sunflower

By Malika Nisal Ratnayake, Monash University; Adrian Dyer, Monash University, and Alan Dorin, Monash University

Artificial intelligence (AI) offers a new way to track the insect pollinators essential to farming.

In a new study, we installed miniature digital cameras and computers inside a greenhouse at a strawberry farm in Victoria, Australia, to track bees and other insects as they flew from plant to plant pollinating flowers.

Using custom AI software, we analysed several days’ video footage from our system to build a picture of pollination behaviour over a wide area.

In the same way that monitoring roads can help traffic run smoothly, our system promises to make pollination more efficient. This will enable better use of resources and increased food production.

A fresh set of eyes

With a growing human population and limited natural resources, food production needs to become more efficient and sustainable. Precision agriculture powered by new technologies, like AI, can help secure future food production.

Efficient pollination is crucial to produce healthy fruits, vegetables, legumes and nuts.

Optimal pollination requires just the right number of insect pollinator visits to flowers. Too few or too many visits, or visits by ineffective insect pollinators, can diminish the quality of food a flowering plant produces.

Typical techniques for monitoring insect pollination use direct visual observation or pan trapping, which are labour-intensive and take many days.

Additionally, without a very large number of trained observers it is impossible to collect simultaneous data across large farms. Yet such data are needed to provide time-critical evidence of the extent of crop pollination, before a season’s pollination window is closed.

With our digital system, however, a farm manager could obtain same-day data on crop pollination levels.

How fine-grained analysis of insect pollinator movement enables better food production

Tracking honeybees on strawberry plants

Our pollination monitoring system was set up at Sunny Ridge farm in a strawberry greenhouse open to insects. The array of cameras monitored insect activity among the strawberries, recording honeybees, hover flies, moths, butterflies and some wasps.

small video capture units are mounted on tall poles in an array across a greenhouse full of strawberry plants

Video capture units placed over strawberry plants.

Managing big (insect) data with advanced software

The volume of data our system collects requires custom software to reliably track individual insects flying among complex foliage.

A key issue our software overcomes is identifying insect movements within a video sequence, so an individual insect on a single path isn’t accidentally counted multiple times. This enables accurate assessment of the number of insects in a region during a day, an analysis of their type (e.g. species), and monitoring of their flower visits.

Our custom software uses a hybrid detection model to detect and track insects and flowers in videos. This model combines the AI-based object-detection capabilities of deep learning using a convolutional neural network, together with separate foreground detection algorithms to identify the precise positions of insects and the flowers they visit in the recorded videos.

The software includes features to make data processing more efficient and save on computer power.

The insect paths our software produces are computed using a method called the Hungarian algorithm. This examines the positions of insects in each video frame in a sequence, and enables the identification of a match between the locations of the insects across a sequence of video frames.

By recording and visualising these paths, we gain an understanding of insect behaviour and the efficiency of pollination in a greenhouse.

Strawberries produce quality fruit after a minimum of four insect visits to an individual flower. Too many visits can actually damage flowers and reduce fruit quality.

Which insects drive pollination?

Insect counts, tracks and flower visits recorded across the farm.

Insect counts, tracks and flower visits reported at three sample locations at our field site. Bar charts above the plots indicate the number of tracks and total number of flower visits for each insect type. Track colours represent different insect varieties. Flower locations are indicated by blue circles. Ratnayake et al., 2022.

Honeybee flower visits were recorded more frequently in the monitored area than visits by other insects. Our analysis showed 68% of recorded flowers received the minimum number of four insect visits required for full fertilisation during the monitoring period.

While honeybees contributed the most to pollination, visits by other insects often resulted in individual flowers achieving the desired threshold of four visits, potentially improving the crop yield.

Contribution of different insect types towards strawberry pollination.

Contribution of different insect types towards strawberry pollination. Bar chart shows percentage of flowers visited by each insect type at three sample locations at our field site. The dark grey portion shows the percentage of flowers with over four (number of visits required for strawberry flower fertilisation) from each insect type. The red dashed line in the plots show the total percentage of flowers with more than four visits in a location. Ratnayake et al., 2022.

By detecting the numbers, types and timing of insects needed for optimal pollination, our monitoring system provides farmers the evidence they need to inform decision-making.

For example, knowing the extent to which a crop has been pollinated allows growers to alter hive locations and numbers to boost pollination shortfalls.

Farmers might also open or close greenhouse sidewalls to encourage or discourage insect visits from particular directions. They may decide to add attractant flowers to entice insects to explore crop regions that have been inadequately visited.

These simple interventions can ensure a higher rate of pollination success, and a higher yield of market-quality fruit. Smart insect management like this promises to help meet the need to feed a growing population with healthy produce.The Conversation

Malika Nisal Ratnayake, Postdoctoral Research Fellow, Faculty of Information Technology, Monash University; Adrian Dyer, Associate Professor, Monash University, and Alan Dorin, Associate Professor, Faculty of Information Technology, Monash University

This article is republished from The Conversation under a Creative Commons license. Read the original article.




The Conversation is an independent source of news and views, sourced from the academic and research community and delivered direct to the public.
The Conversation is an independent source of news and views, sourced from the academic and research community and delivered direct to the public.




            AIhub is supported by:


Related posts :



monthly digest

AIhub monthly digest: May 2025 – materials design, object state classification, and real-time monitoring for healthcare data

  30 May 2025
Welcome to our monthly digest, where you can catch up with AI research, events and news from the month past.

Congratulations to the #AAMAS2025 best paper, best demo, and distinguished dissertation award winners

  29 May 2025
Find out who won the awards presented at the International Conference on Autonomous Agents and Multiagent Systems last week.

The Good Robot podcast: Transhumanist fantasies with Alexander Thomas

  28 May 2025
In this episode, Eleanor talks to Alexander Thomas, a filmmaker and academic, about the transhumanist narrative.

Congratulations to the #ICRA2025 best paper award winners

  27 May 2025
The winners and finalists in the different categories have been announced.

#ICRA2025 social media round-up

  23 May 2025
Find out what the participants got up to at the International Conference on Robotics & Automation.

Interview with Gillian Hadfield: Normative infrastructure for AI alignment

  22 May 2025
Kumar Kshitij Patel spoke to Gillian Hadfield about her interdisciplinary research, career trajectory, path into AI alignment, law, and general thoughts on AI systems.

PitcherNet helps researchers throw strikes with AI analysis

  21 May 2025
Baltimore Orioles tasks Waterloo Engineering researchers to develop AI tech that can monitor pitchers using low-resolution video captured by smartphones

Interview with Filippos Gouidis: Object state classification

  20 May 2025
Read the latest interview in our series featuring the AAAI/SIGAI Doctoral Consortium participants.



 

AIhub is supported by:






©2025.05 - Association for the Understanding of Artificial Intelligence


 












©2025.05 - Association for the Understanding of Artificial Intelligence