Recent advances in the area of lifted inference, which exploits the structure inherent in relational probabilistic models. Statistical relational AI (StaRAI) studies the integration of reasoning under uncertainty with reasoning about individuals and relations. The representations used are often called relational probabilistic models. Lifted inference is about how to exploit the structure inherent in relational probabilistic models, either in the way they are expressed or by extracting structure from observations. This book covers recent significant advances in the area of lifted inference, providing a unifying introduction to this very active field. After providing necessary background on probabilistic graphical models, relational probabilistic models, and learning inside these models, the book turns to lifted inference, first covering exact inference and then approximate inference. In addition, the book considers the theory of liftability and acting in relational domains, which allows the connection of learning and reasoning in relational domains.

Advanced statistical modeling and knowledge representation techniques for a newly emerging area of machine learning and probabilistic reasoning; includes introductory material, tutorials for different proposed approaches, and applications. Handling inherent uncertainty and exploiting compositional structure are fundamental to understanding and designing large-scale systems. Statistical relational learning builds on ideas from probability theory and statistics to address uncertainty while incorporating tools from logic, databases and programming languages to represent structure. In Introduction to Statistical Relational Learning, leading researchers in this emerging area of machine learning describe current formalisms, models, and algorithms that enable effective and robust reasoning about richly structured systems and data. The early chapters provide tutorials for material used in later chapters, offering introductions to representation, inference and learning in graphical models, and logic. The book then describes object-oriented approaches, including probabilistic relational models, relational Markov networks, and probabilistic entity-relationship models as well as logic-based formalisms including Bayesian logic programs, Markov logic, and stochastic logic programs. Later chapters discuss such topics as probabilistic models with unknown objects, relational dependency networks, reinforcement learning in relational domains, and information extraction. By presenting a variety of approaches, the book highlights commonalities and clarifies important differences among proposed approaches and, along the way, identifies important representational and algorithmic issues. Numerous applications are provided throughout.

An intelligent agent interacting with the real world will encounter individual people, courses, test results, drugs prescriptions, chairs, boxes, etc., and needs to reason about properties of these individuals and relations among them as well as cope with uncertainty. Uncertainty has been studied in probability theory and graphical models, and relations have been studied in logic, in particular in the predicate calculus and its extensions. This book examines the foundations of combining logic and probability into what are called relational probabilistic models. It introduces representations, inference, and learning techniques for probability, logic, and their combinations. The book focuses on two representations in detail: Markov logic networks, a relational extension of undirected graphical models and weighted first-order predicate calculus formula, and Problog, a probabilistic extension of logic programs that can also be viewed as a Turing-complete relational extension of Bayesian networks.

An introduction to the Bayesian approach to statistical inference that demonstrates its superiority to orthodox frequentist statistical analysis. This book offers an introduction to the Bayesian approach to statistical inference, with a focus on nonparametric and distribution-free methods. It covers not only well-developed methods for doing Bayesian statistics but also novel tools that enable Bayesian statistical analyses for cases that previously did not have a full Bayesian solution. The book's premise is that there are fundamental problems with orthodox frequentist statistical analyses that distort the scientific process. Side-by-side comparisons of Bayesian and frequentist methods illustrate the mismatch between the needs of experimental scientists in making inferences from data and the properties of the standard tools of classical statistics. The book first covers elementary probability theory, the binomial model, the multinomial model, and methods for comparing different experimental conditions or groups. It then turns its focus to distribution-free statistics that are based on having ranked data, examining data from experimental studies and rank-based correlative methods. Each chapter includes exercises that help readers achieve a more complete understanding of the material. The book devotes considerable attention not only to the linkage of statistics to practices in experimental science but also to the theoretical foundations of statistics. Frequentist statistical practices often violate their own theoretical premises. The beauty of Bayesian statistics, readers will learn, is that it is an internally coherent system of scientific inference that can be proved from probability theory.

The first comprehensive treatment of active inference, an integrative perspective on brain, cognition, and behavior used across multiple disciplines. Active inference is a way of understanding sentient behavior—a theory that characterizes perception, planning, and action in terms of probabilistic inference. Developed by theoretical neuroscientist Karl Friston over years of groundbreaking research, active inference provides an integrated perspective on brain, cognition, and behavior that is increasingly used across multiple disciplines including neuroscience, psychology, and philosophy. Active inference puts the action into perception. This book offers the first comprehensive treatment of active inference, covering theory, applications, and cognitive domains. Active inference is a “first principles” approach to understanding behavior and the brain, framed in terms of a single imperative to minimize free energy. The book emphasizes the implications of the free energy principle for understanding how the brain works. It first introduces active inference both conceptually and formally, contextualizing it within current theories of cognition. It then provides specific examples of computational models that use active inference to explain such cognitive phenomena as perception, attention, memory, and planning.

This book constitutes the refereed proceedings of the 15th International Conference on Scalable Uncertainty Management, SUM 2022, which was held in Paris, France, in October 2022. The 19 full and 4 short papers presented in this volume were carefully reviewed and selected from 25 submissions. Besides that, the book also contains 3 abstracts of invited talks and 2 tutorial papers. The conference aims to gather researchers with a common interest in managing and analyzing imperfect information from a wide range of fields, such as artificial intelligence and machine learning, databases, information retrieval and data mining, the semantic web and risk analysis. The chapter "Defining and Enforcing Descriptive Accuracy in Explanations: the Case of Probabilistic Classifiers" is licensed under the terms of the Creative Commons Attribution 4.0 International License.