Proceedings

SpaceDet: A Large-scale Space-based Image Dataset and RSO Detection for Space Situational Awareness

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. AI4Tech: AI Enabling Technologies. Pages 9402-9410.

https://doi.org/10.24963/ijcai.2025/1045

Abstract

Space situational awareness (SSA) plays an imperative role in maintaining safe space operations, especially given the increasingly congested space traffic around the Earth. Space-based SSA offers a flexible and lightweight solution compared to traditional ground-based SSA. With advanced machine learning approaches, space-based SSA can extract features from high-resolution images in space to detect and track resident space objects (RSOs). However, existing spacecraft image datasets, such as SPARK, fall short of providing realistic camera observations, rendering the derived algorithms unsuitable for real SSA systems. In this work, we introduce SpaceDet, a large-scale realistic space-based image dataset for SSA. We consider accurate space orbit dynamics and a physical camera model with various noise distributions, generating images at the photon level. To extend the available observation window, four overlapping cameras are simulated with a fixed rotation angle. SpaceDet includes images of RSOs observed from 19 km to 63,000 km, captured by a tracker operating in LEO, MEO, and GEO orbits over a period of 5,000 seconds. Each image has a resolution of 4418 x 4418 pixels, providing detailed features for developing advanced SSA approaches. We split the dataset into three subsets: SpaceDet-100, SpaceDet-5000, and SpaceDet-full, catering to various image processing applications. The SpaceDet-full corpus includes a comprehensive dataloader with 781.5 GB of images and 25.9 MB of ground truth labels. Furthermore, we adapted detection and tracking algorithms on the collected dataset using a specified splitting method to accelerate the training process. The trained model can detect RSOs from real-world space observations with zero-shot capability.

  1. [Aharon et al., 2022] Nir Aharon, Roy Orfaig, and Ben-Zion Bobrovsky. Bot-sort: Robust associations multi-pedestrian tracking. arXiv preprint arXiv:2206.14651, 2022.
  2. [Carion et al., 2020] Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. End-to-end object detection with transformers. In European conference on computer vision, pages 213-229. Springer, 2020.
  3. [Chen et al., 2019] Kai Chen, Jiaqi Wang, Jiangmiao Pang, Yuhang Cao, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jiarui Xu, Zheng Zhang, Dazhi Cheng, Chenchen Zhu, Tianheng Cheng, Qijie Zhao, Buyu Li, Xin Lu, Rui Zhu, Yue Wu, Jifeng Dai, Jingdong Wang, Jianping Shi, Wanli Ouyang, Chen Change Loy, and Dahua Lin. MMDetection: Open mmlab detection toolbox and benchmark. arXiv preprint arXiv:1906.07155, 2019.
  4. [Chen et al., 2023] Zhe Chen, Yang Yang, Anne Bettens, Youngho Eun, and Xiaofeng Wu. A simulation-augmented benchmarking framework for automatic rso streak de- tection in single-frame space images. arXiv preprint arXiv:2305.00412, 2023.
  5. [Engels and Junkins, 1981] RC Engels and John L Junkins. The gravity-perturbed lambert problem: A ks variation of parameters approach. Celestial mechanics, 24(1):3-21, 1981.
  6. [Fletcher et al., 2019] Justin Fletcher, Ian McQuaid, Peter Thomas, Jeremiah Sanders, and Greg Martin. Feature- based satellite detection using convolutional neural net- works. In Proceedings of the Advanced Maui Optical and Space Surveillance Technologies Conference, page 11, 2019.
  7. [Harris et al., 2021] Toby Harris, Harriet Brettle, Morgane Lecas, Laurence Blacketer, Antoine Carr, Alberto Fernan- dez, and Andrea Puppa. An exploration of opportuni- ties to advance ground-based and space-based ssa systems through in-orbit demonstration missions. ESA Space De- bris Office, 2021.
  8. [Hein, 2020] Guenter W Hein. Status, perspectives and trends of satellite navigation. Satellite Navigation, 1(1):22, 2020.
  9. [IAU, 2021] SOFA Board IAU. Iau sofa software collection, 2021.
  10. [Jia et al., 2024] Qianlei Jia, Jiaping Xiao, Lu Bai, Yuhang Zhang, Rangya Zhang, and Mir Feroskhan. Space situ- ational awareness systems: Bridging traditional methods and artificial intelligence. Acta Astronautica, 2024.
  11. [Jocher et al., 2023] Glenn Jocher, Ayush Chaurasia, and Jing Qiu. Ultralytics YOLO, January 2023. [Jocher, 2020]
  12. Glenn Jocher. YOLOv5 by Ultralytics, May 2020.
  13. [Kisantal et al., 2020] Mate Kisantal, Sumant Sharma, Tae Ha Park, Dario Izzo, Marcus Märtens, and Simone D'Amico. Satellite pose estimation challenge: Dataset, competition design, and results. IEEE Transactions on Aerospace and Electronic Systems, 56(5):4083-4098, 2020.
  14. [Musallam et al., 2021a] Mohamed Adel Musallam, Vincent Gaudilliere, Enjie Ghorbel, Kassem Al Ismaeil, Mar- cos Damian Perez, Michel Poucet, and Djamila Aouada. Spacecraft recognition leveraging knowledge of space en- vironment: simulator, dataset, competition design and analysis. In 2021 IEEE International Conference on Im- age Processing Challenges (ICIPC), pages 11-15. IEEE, 2021.
  15. [Musallam et al., 2021b] Mohamed Adel Musallam, Vincent Gaudilliere, Enjie Ghorbel, Kassem Al Ismaeil, Mar- cos Damian Perez, Michel Poucet, and Djamila Aouada. Spacecraft recognition leveraging knowledge of space en- vironment: simulator, dataset, competition design and analysis. In 2021 IEEE International Conference on Im- age Processing Challenges (ICIPC), pages 11-15. IEEE, 2021.
  16. [Park et al., 2023] Tae Ha Park, Marcus Märtens, Mohsi Jawaid, Zi Wang, Bo Chen, Tat-Jun Chin, Dario Izzo, and Simone D'Amico. Satellite pose estimation competition 2021: Results and analyses. Acta Astronautica, 204:640- 665, 2023.
  17. [Pauly et al., 2023] Leo Pauly, Wassim Rharbaoui, Carl Shneider, Arunkumar Rathinam, Vincent Gaudillière, and Djamila Aouada. A survey on deep learning-based monoc- ular spacecraft pose estimation: Current state, limitations and prospects. Acta Astronautica, 2023.
  18. [Peli, 1990] Eli Peli. Contrast in complex images. JOSA A, 7(10):2032-2040, 1990.
  19. [Pisutsin et al., 2024] Phumrapee Pisutsin, Jiaping Xiao, and Mir Feroskhan. Omnidrone-det: Omnidirectional 3d drone detection in flight. In 2024 IEEE 20th International Con- ference on Automation Science and Engineering (CASE), pages 2409-2414, 2024.
  20. [Proenc ¸a and Gao, 2020] Pedro F Proenc ¸a and Yang Gao. Deep learning for spacecraft pose estimation from photo- realistic rendering. In 2020 IEEE International Confer- ence on Robotics and Automation (ICRA), pages 6007- 6013. IEEE, 2020.
  21. [Qiao et al., 2022] Sijia Qiao, Haopeng Zhang, Gang Meng, Meng An, Fengying Xie, and Zhiguo Jiang. Deep- learning-based satellite relative pose estimation using monocular optical images and 3d structural information. Aerospace, 9(12):768, 2022.
  22. [Redmon, 2018] Joseph Redmon. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767, 2018.
  23. [Ren et al., 2016] Shaoqing Ren, Kaiming He, Ross Gir- shick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE transactions on pattern analysis and machine intelligence, 39(6):1137-1149, 2016.
  24. [Shen et al., 2024] Naijun Shen, Rui Xv, Yang Gao, Chen Qian, and Qingwei Chen. An improved yolov5 model based on feature fusion and attention mechanism for multi- scale satellite recognition. IEEE Sensors Journal, 2024.
  25. [Suthakar et al., 2023] Vithurshan Suthakar, Aiden Alexan- der Sanvido, Randa Qashoa, and Regina SK Lee. Com- parative analysis of resident space object (rso) detection methods. Sensors, 23(24):9668, 2023.
  26. [Tang et al., 2023] Qiang Tang, Xiangwei Li, Meilin Xie, and Jialiang Zhen. Intelligent space object detection driven by data from space objects. Applied Sciences, 14(1):333, 2023.
  27. [Thorsteinson, 2018] Stefan Thorsteinson. Key findings from the neossat space-based ssa microsatellite mission. In Proc. of the Advanced Maui Optical and Space Surveil- lance Technologies Conference, pages 89-103, 2018.
  28. [Usovik, 2023] IV Usovik. Review of perspective space de- bris mitigation solutions. Journal of Space Safety Engi- neering, 10(1):55-58, 2023.
  29. [Vallado and Crawford, 2008] David Vallado and Paul Crawford. Sgp4 orbit determination. In AIAA/AAS Astrodynamics Specialist Conference and Exhibit, page 6770, 2008.
  30. [Vallado, 2001] David A Vallado. Fundamentals of astrody- namics and applications, volume 12. Springer Science & Business Media, 2001.
  31. [Wang et al., 2022] Beichao Wang, Shuang Li, Jinzhen Mu, Xiaolong Hao, Wenshan Zhu, and Jiaqian Hu. Research advancements in key technologies for space-based situa- tional awareness. Space: Science & Technology, 2022.
  32. [Wang et al., 2024] Ao Wang, Hui Chen, Lihao Liu, Kai Chen, Zijia Lin, Jungong Han, and Guiguang Ding. Yolov10: Real-time end-to-end object detection. arXiv preprint arXiv:2405.14458, 2024.
  33. [Xiao et al., 2024] Jiaping Xiao, Jian Hui Chee, and Mir Fer- oskhan. Real-time multi-drone detection and tracking for pursuit-evasion with parameter search. IEEE Transactions on Intelligent Vehicles, pages 1-11, 2024.
  34. [Zhang et al., 2010] H Zhang, Z Liu, Z Jiang, M An, and D Zhao. Buaa-sid1. 0 space object image dataset. Space- craft recovery & remote sensing, 31(4):65-71, 2010.
  35. [Zhang et al., 2022a] Hao Zhang, Feng Li, Shilong Liu, Lei Zhang, Hang Su, Jun Zhu, Lionel M Ni, and Heung- Yeung Shum. Dino: Detr with improved denoising an- chor boxes for end-to-end object detection. arXiv preprint arXiv:2203.03605, 2022.
  36. [Zhang et al., 2022b] Yifu Zhang, Peize Sun, Yi Jiang, Dongdong Yu, Fucheng Weng, Zehuan Yuan, Ping Luo, Wenyu Liu, and Xinggang Wang. Bytetrack: Multi-object tracking by associating every detection box. In European conference on computer vision, pages 1-21. Springer, 2022.
  37. [Zhang et al., 2022c] Zipeng Zhang, Chenwei Deng, and Zhiyuan Deng. A diverse space target dataset with mul- tidebris and realistic on-orbit environment. IEEE Journal of Selected Topics in Applied Earth Observations and Re- mote Sensing, 15:9102-9114, 2022.
  38. [Zhang, 2000] Zhengyou Zhang. A flexible new technique for camera calibration. IEEE Transactions on pattern analysis and machine intelligence, 22(11):1330-1334, 2000.
  39. [Zhu et al., 2020] Xizhou Zhu, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, and Jifeng Dai. Deformable detr: Deformable transformers for end-to-end object detection. arXiv preprint arXiv:2010.04159, 2020.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards