DEEP-PEST-DETECTOR: AUTOMATED DETECTION AND LOCALIZATION OF PROCESSIONARY MOTH NESTS ON PINE TREES VIA AERIAL DRONES AND DEEP NEURAL NETWORKS

Abstract

The pine processionary moth (PPM) is considered the main defoliator of pine trees and is a menacing threat to various other perennial species including oak and cedar. Given their negative secondary effects, spraying of pesticides has been banned as a means for the eradication of PPM; instead, an individualized approach is to be adopted, in which each nest is localized and destroyed. Detection of PPM nests using optical sensing is challenging because of the changing outdoor lighting conditions and the camouflaged appearance of moth in the underlying foliage. This article proposes a promising solution for nest detection by fusing sensory data from an RGB camera on one hand, and a thermal camera on the other, both mounted on an aerial drone. The proposed detection system is built on a two-channeled deep convolutional neural network, one for each spectrum of the collected sensory data. Experiments performed in a pine forest demonstrate successful detection rates with an average accuracy of 97% in various experiments and settings. Geo-localization is performed to report the position of the detected nests within a scanned forest map by means of an estimation scheme that is particularly designed for this purpose achieving centimeter accuracy (<20 cm). © 2022 American Society of Agricultural and Biological Engineers.