Proceedings

Non-Euclidean Self-Organizing Maps

Video #1 Video #2 Download BibTeX Cite

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence. Main Track. Pages 1938-1944.

https://doi.org/10.24963/ijcai.2022/269

Abstract

Self-Organizing Maps (SOMs, Kohonen networks) belong to neural network models of the unsupervised class. In this paper, we present the generalized setup for non-Euclidean SOMs. Most data analysts take it for granted to use some subregions of a flat space as their data model; however, by the assumption that the underlying geometry is non-Euclidean we obtain a new degree of freedom for the techniques that translate the similarities into spatial neighborhood relationships. We improve the traditional SOM algorithm by introducing topology-related extensions. Our proposition can be successfully applied to dimension reduction, clustering or finding similarities in big data (both hierarchical and non-hierarchical).

  1. [Asan and Ercan, 2012] Umut Asan and Secil Ercan. An in- troduction to self-organizing maps. In C. Kahraman, edi- tor, Computational Intelligence Systems in Industrial En- gineering: with Recent Theory and Applications, pages 299-319. Atlantis Press, 2012.
  2. [Bezdek et al., 1993] James C. Bezdek, Lawrence O. Hall, and Laurence P. Clarke. Review of mr image segmen- tation techniques using pattern recognition. MEDICAL PHYSICS-LANCASTER PA-, 20:1033-1033, 1993.
  3. [Boniecki et al., 2012] Piotr Boniecki, Krzysztof Nowakowski, Robert Tomczak, Sebastian Kujawa, and Hanna Piekarska-Boniecka. The application of the Kohonen neural network in the nonparametric-quality- based classification of tomatoes. In ICDIP 2012, volume 8334, pages 440 -444. SPIE, 2012.
  4. [Celińska-Kopczyńska and Kopczyński, 2021] Dorota Celińska-Kopczyńska and Eryk Kopczyński. Non-euclidean self-organizing maps, 2021. https://arxiv.org/abs/2109.11769. Link
  5. [Chazal and Michel, 2017] Frédéric Chazal and Bertrand Michel. An introduction to topological data analysis: fun- damental and practical aspects for data scientists. Techni- cal report, 2017.
  6. [Coulon et al., 2020] Rémi Coulon, Elisabetta A. Mat- sumoto, Henry Segerman, and Steve J. Trettel. Ray- marching thurston geometries, 2020. arXiv 2010.15801. To appear in Experimental Mathematics.
  7. [Fisher, 1936] Ronald A. Fisher. The use of multiple mea- surements in taxonomic problems. Annals of Eugenics, 7(2):179-188, 1936.
  8. [Greene, 2020] William H. Greene. Econometric Analysis. Pearson Education Limited, 8 edition, 2020.
  9. [Grigor'yan and Noguchi, 1998] Alexander Grigor'yan and Masakazu Noguchi. The heat kernel on hyperbolic space. Bulletin of the London Mathematical Society, 30(6):643-650, 1998.
  10. [Grossberg and Carpenter, 1991] Stephen Grossberg and Gail A. Carpenter. Pattern recognition by self-organizing neural networks / edited by Gail A. Carpenter and Stephen Grossberg. MIT Press Cambridge, Mass, 1991.
  11. [Horst et al., 2020] Allison Marie Horst, Alison Presmanes Hill, and Kristen B Gorman. palmerpenguins: Palmer Archipelago (Antarctica) penguin data, 2020.
  12. [Kohonen, 1997] Teuvo Kohonen, editor. Self-organizing Maps. Springer-Verlag, Berlin, Heidelberg, 1997.
  13. [Kopczyński et al., 2017] Eryk Kopczyński, Dorota Celińska, and Marek Čtrnáct. HyperRogue: Playing with hyperbolic geometry. In Procs of Bridges, pages 9-16, Phoenix, Arizona, 2017. Tessellations Publishing.
  14. [Kopczyński and Celińska-Kopczyńska, 2022] Eryk Kopczyński and Dorota Celińska-Kopczyńska. Real-time visualization in anisotropic geometries. Experimental Mathematics, 0(0):1-20, 2022.
  15. [Krioukov et al., 2010] Dmitri Krioukov, Fragkiskos Pa- padopoulos, Maksim Kitsak, Amin Vahdat, and Marián Boguñá. Hyperbolic geometry of complex networks. Phys. Rev. E, 82:036106, Sep 2010.
  16. [Lamping et al., 1995] John Lamping, Ramana Rao, and Pe- ter Pirolli. A focus+context technique based on hyperbolic geometry for visualizing large hierarchies. In Procs of CHI '95, pages 401-408, New York, NY, USA, 1995. ACM Press/Addison-Wesley Publishing Co.
  17. [Martín-Merino and Muñoz, 2004] Manuel Martín-Merino and Alberto Muñoz. Extending the som algorithm to non- euclidean distances via the kernel trick. In ICONIP 2004, volume 3316, pages 150-157, 11 2004.
  18. [Mazzatorta et al., 2003] Paolo Mazzatorta, Marjan Vracko, Aneta Jezierska, and Emilio Benfenati. Modeling toxicity by using supervised kohonen neural networks. Journal of chemical information and computer sciences, 43(2):485- 492, 2003.
  19. [Munzner, 1998] Tamara Munzner. Exploring large graphs in 3d hyperbolic space. IEEE Computer Graphics and Ap- plications, 18(4):18-23, 1998.
  20. [Ontrup and Ritter, 2001] Jörg Ontrup and Helge Ritter. Hy- perbolic self-organizing maps for semantic navigation. In Procs of NIPS'01, pages 1417-1424, Cambridge, MA, USA, 2001. MIT Press.
  21. [Papadopoulos et al., 2012] Fragkiskos Papadopoulos, Mak- sim Kitsak, M. Angeles Serrano, Marian Boguñá, and Dmitri Krioukov. Popularity versus Similarity in Grow- ing Networks. Nature, 489:537-540, Sep 2012.
  22. [Pérez-Aguila, 2013] Ricardo Pérez-Aguila. Enhancing brain tissue segmentation and image classification via 1d kohonen networks and discrete compactness: An experi- mental study. Engineering Letters, 21(4), 2013.
  23. [Reddick et al., 1997] Wilburn E. Reddick, John O. Glass, Edwin N. Cook, T. David Elkin, and Russell J. Deaton. Automated segmentation and classification of multispec- tral magnetic resonance images of brain using artificial neural networks. IEEE Transactions on Medical Imaging, 16(6):911-918, 1997.
  24. [Ritter, 1999] Helge Ritter. Self-organizing maps on non- euclidean spaces. In E. Oja and S. Kaski, editors, Kohonen Maps, pages 97-108. Elsevier, 1999.
  25. [Rossi, 2014] Fabrice Rossi. How many dissimilarity/kernel self organizing map variants do we need? In WSOM, 2014.
  26. [Tobin, 1958] James Tobin. Estimation of relationships for limited dependent variables. Econometrica, 26(1):24-36, 1958.
  27. [Villmann et al., 1994] Thomas Villmann, Ralf Der, J. Her- rmann, and Thomas Martinetz. Topology preservation in self-organizing feature maps: General definition and effi- cient measurement. pages 159-166, 01 1994.
  28. [Wasserman, 2018] Larry Wasserman. Topological data analysis. Annual Review of Statistics and Its Application, 5(1):501-532, 2018.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards