Three-quarter Sibling Regression for Denoising Observational Data

Three-quarter Sibling Regression for Denoising Observational Data

Shiv Shankar, Daniel Sheldon, Tao Sun, John Pickering, Thomas G. Dietterich

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence
AI for Improving Human Well-being. Pages 5960-5966. https://doi.org/10.24963/ijcai.2019/826

Many ecological studies and conservation policies are based on field observations of species, which can be affected by systematic variability introduced by the observation process. A recently introduced causal modeling technique called 'half-sibling regression' can detect and correct for systematic errors in measurements of multiple independent random variables. However, it will remove intrinsic variability if the variables are dependent, and therefore does not apply to many situations, including modeling of species counts that are controlled by common causes. We present a technique called 'three-quarter sibling regression' to partially overcome this limitation. It can filter the effect of systematic noise when the latent variables have observed common causes. We provide theoretical justification of this approach, demonstrate its effectiveness on synthetic data, and show that it reduces systematic detection variability due to moon brightness in moth surveys.
Keywords:
Special Track on AI for Improving Human-Well Being: Computational sustainability (Special Track on AI and Human Wellbeing)