Beyond Vision: A Multimodal Dataset and Framework for Pest Recognition via Plant Electrophysiological Signals
Beyond Vision: A Multimodal Dataset and Framework for Pest Recognition via Plant Electrophysiological Signals
Lu Wang, Jiaming Lin, Yuting Ye, Tao Wei, Chuchu Qin
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence
AI and Social Good. Pages 7492-7500.
https://doi.org/10.24963/ijcai.2026/833
Precise pest identification is essential for sustainable agriculture. Current visual recognition systems are brittle in the wild, where performance degrades due to occlusion and variable illumination. In contrast, plant electrophysiological signals serve as a robust, all-weather physiological modality, capable of detecting cryptic feeding behaviors that escape optical sensors. However, this field remains constrained by the scarcity of data and the absence of specialized algorithms. To bridge this gap, we introduce the Herbivory-Induced Plant Bio-signal Multimodal (HIPB-MM) dataset, the first fine-grained dataset comprising 4,023 synchronized plant electrophysiological signal-video pairs recording the feeding processes of three typical pest species. To address the weak and non-stationary nature of these signals, we propose the Herbivory-Induced Physiological Sensing (HIPS) framework. It integrates a Morphological Semantic Decoupling strategy to recover robust slow-wave semantics, and a Generation-State Encoder to model latent physiological states. Complementing this, an auxiliary dual-stream visual branch calibrates signal representations using explicit behavioral and morphological cues. Experiments demonstrate that HIPS establishes a solid benchmark (69.81% accuracy), comprehensively outperforming state-of-the-art baselines. Crucially, this work validates plant electrophysiology as a low-cost, all-weather modality for sustainable crop protection, effectively reducing pesticide dependency and safeguarding ecosystem health.
Keywords:
Data Mining: Data Mining
Machine Learning: Machine Learning
Multidisciplinary Topics and Applications: Multidisciplinary Topics and Applications
