Machine learning and artificial intelligence increasingly use methodological tools rooted in statistical physics. Conversely, limitations and pitfalls encountered in AI question the very foundations of statistical physics. This interplay between AI and statistical physics has been attested since the birth of AI, and principles underpinning statistical physics can shed new light on the conceptual basis of AI. During the last fifty years, statistical physics has been investigated through new geometric structures allowing covariant formalization of the thermodynamics. Inference methods in machine learning have begun to adapt these new geometric structures to process data in more abstract representation spaces. This volume collects selected contributions on the interplay of statistical physics and artificial intelligence. The aim is to provide a constructive dialogue around a common foundation to allow the establishment of new principles and laws governing these two disciplines in a unified manner. The contributions were presented at the workshop on the Joint Structures and Common Foundation of Statistical Physics, Information Geometry and Inference for Learning which was held in Les Houches in July 2020. The various theoretical approaches are discussed in the context of potential applications in cognitive systems, machine learning, signal processing.

Machine learning and artificial intelligence increasingly use methodological tools rooted in statistical physics. Conversely, limitations and pitfalls encountered in AI question the very foundations of statistical physics. This interplay between AI and statistical physics has been attested since the birth of AI, and principles underpinning statistical physics can shed new light on the conceptual basis of AI. During the last fifty years, statistical physics has been investigated through new geometric structures allowing covariant formalization of the thermodynamics. Inference methods in machine learning have begun to adapt these new geometric structures to process data in more abstract representation spaces. This volume collects selected contributions on the interplay of statistical physics and artificial intelligence. The aim is to provide a constructive dialogue around a common foundation to allow the establishment of new principles and laws governing these two disciplines in a unified manner. The contributions were presented at the workshop on the Joint Structures and Common Foundation of Statistical Physics, Information Geometry and Inference for Learning which was held in Les Houches in July 2020. The various theoretical approaches are discussed in the context of potential applications in cognitive systems, machine learning, signal processing.

This book focuses on information geometry manifolds of structured data/information and their advanced applications featuring new and fruitful interactions between several branches of science: information science, mathematics and physics. It addresses interrelations between different mathematical domains like shape spaces, probability/optimization & algorithms on manifolds, relational and discrete metric spaces, computational and Hessian information geometry, algebraic/infinite dimensional/Banach information manifolds, divergence geometry, tensor-valued morphology, optimal transport theory, manifold & topology learning, and applications like geometries of audio-processing, inverse problems and signal processing. The book collects the most important contributions to the conference GSI’2017 – Geometric Science of Information.

This book constitutes the proceedings of the 5th International Conference on Geometric Science of Information, GSI 2021, held in Paris, France, in July 2021. The 98 papers presented in this volume were carefully reviewed and selected from 125 submissions. They cover all the main topics and highlights in the domain of geometric science of information, including information geometry manifolds of structured data/information and their advanced applications. The papers are organized in the following topics: Probability and statistics on Riemannian Manifolds; sub-Riemannian geometry and neuromathematics; shapes spaces; geometry of quantum states; geometric and structure preserving discretizations; information geometry in physics; Lie group machine learning; geometric and symplectic methods for hydrodynamical models; harmonic analysis on Lie groups; statistical manifold and Hessian information geometry; geometric mechanics; deformed entropy, cross-entropy, and relative entropy; transformation information geometry; statistics, information and topology; geometric deep learning; topological and geometrical structures in neurosciences; computational information geometry; manifold and optimization; divergence statistics; optimal transport and learning; and geometric structures in thermodynamics and statistical physics.

This book constitutes the proceedings of the 5th International Conference on Geometric Science of Information, GSI 2021, held in Paris, France, in July 2021. The 98 papers presented in this volume were carefully reviewed and selected from 125 submissions. They cover all the main topics and highlights in the domain of geometric science of information, including information geometry manifolds of structured data/information and their advanced applications. The papers are organized in the following topics: Probability and statistics on Riemannian Manifolds; sub-Riemannian geometry and neuromathematics; shapes spaces; geometry of quantum states; geometric and structure preserving discretizations; information geometry in physics; Lie group machine learning; geometric and symplectic methods for hydrodynamical models; harmonic analysis on Lie groups; statistical manifold and Hessian information geometry; geometric mechanics; deformed entropy, cross-entropy, and relative entropy; transformation information geometry; statistics, information and topology; geometric deep learning; topological and geometrical structures in neurosciences; computational information geometry; manifold and optimization; divergence statistics; optimal transport and learning; and geometric structures in thermodynamics and statistical physics.

This Special Issue of the journal Entropy, titled “Information Geometry I”, contains a collection of 17 papers concerning the foundations and applications of information geometry. Based on a geometrical interpretation of probability, information geometry has become a rich mathematical field employing the methods of differential geometry. It has numerous applications to data science, physics, and neuroscience. Presenting original research, yet written in an accessible, tutorial style, this collection of papers will be useful for scientists who are new to the field, while providing an excellent reference for the more experienced researcher. Several papers are written by authorities in the field, and topics cover the foundations of information geometry, as well as applications to statistics, Bayesian inference, machine learning, complex systems, physics, and neuroscience.

The present monograph develops a versatile and profound mathematical perspective of the Wright--Fisher model of population genetics. This well-known and intensively studied model carries a rich and beautiful mathematical structure, which is uncovered here in a systematic manner. In addition to approaches by means of analysis, combinatorics and PDE, a geometric perspective is brought in through Amari's and Chentsov's information geometry. This concept allows us to calculate many quantities of interest systematically; likewise, the employed global perspective elucidates the stratification of the model in an unprecedented manner. Furthermore, the links to statistical mechanics and large deviation theory are explored and developed into powerful tools. Altogether, the manuscript provides a solid and broad working basis for graduate students and researchers interested in this field.