A Comparison of Machine-Learning Assisted Optical and Thermal Camera Systems for Beehive Activity Counting

There is a documented shortage of reliable counting systems for the entrance of beehives. Movement at the entrance of a hive is a measure of hive health and abnormalities, in addition to an indicator of predators. To that end, two camera systems have been designed to provide a comparative analysis for a thermal camera system. The first, a visible spectrum camera, competed directly with the thermal camera system. Machine learning is used to address the narrower field of view of the thermal camera system, in addition to lost extracted tracks from both cameras. K-nearest-neighbour, support vector machine, random forest, and neural network are used to classify flights as arriving, departing, or hovering bees. A hierarchical system is used to determine the nature of any flights where a clear label is not possibly assigned based on the information from either test camera system. A third camera at distance from the hive served as the end authority. After three iterations of training and testing, a test case is evaluated between both camera systems. Finally, human expertise is used to measure the real performance of both systems, showing that the thermal camera system using machine learning can perform to the same success as the visual camera despite a smaller field of view, fewer pixels and lower frame-rate, while both systems achieve greater than 96% accuracy and both camera systems are 93% successful at extracting flights. This is advantageous as a thermal camera will work in a wider range of environments, keeping the accuracy of an optical camera, and predicting based on movement characteristics will allow expanded uses such as predicting the presence of predators