This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramér and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notion of the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.

Linear Stochastic Systems, originally published in 1988, is today as comprehensive a reference to the theory of linear discrete-time-parameter systems as ever. Its most outstanding feature is the unified presentation, including both input-output and state space representations of stochastic linear systems, together with their interrelationships. The author first covers the foundations of linear stochastic systems and then continues through to more sophisticated topics including the fundamentals of stochastic processes and the construction of stochastic systems; an integrated exposition of the theories of prediction, realization (modeling), parameter estimation, and control; and a presentation of stochastic adaptive control theory. Written in a clear, concise manner and accessible to graduate students, researchers, and teachers, this classic volume also includes background material to make it self-contained and has complete proofs for all the principal results of the book. Furthermore, this edition includes many corrections of errata collected over the years.

Linear Stochastic Control Systems presents a thorough description of the mathematical theory and fundamental principles of linear stochastic control systems. Both continuous-time and discrete-time systems are thoroughly covered. Reviews of the modern probability and random processes theories and the Itô stochastic differential equations are provided. Discrete-time stochastic systems theory, optimal estimation and Kalman filtering, and optimal stochastic control theory are studied in detail. A modern treatment of these same topics for continuous-time stochastic control systems is included. The text is written in an easy-to-understand style, and the reader needs only to have a background of elementary real analysis and linear deterministic systems theory to comprehend the subject matter. This graduate textbook is also suitable for self-study, professional training, and as a handy research reference. Linear Stochastic Control Systems is self-contained and provides a step-by-step development of the theory, with many illustrative examples, exercises, and engineering applications.

This second edition of Mathematical Methods in the Robust Control of Linear Stochastic Systems includes a large number of recent results in the control of linear stochastic systems. More specifically, the new results presented are: - A unified and abstract framework for Riccati type equations arising in the stochastic control - Stability and control problems for systems perturbed by homogeneous Markov processes with infinite number of states - Mixed H2 / H∞ control problem and numerical procedures - Linear differential equations with positive evolution on ordered Banach spaces with applications for stochastic systems including both multiplicative white noise and Markovian jumps represented by a Markov chain with countable infinite set of states - Kalman filtering for stochastic systems subject both to state dependent noise and Markovian jumps - H∞ reduced order filters for stochastic systems The book will appeal to graduate students, researchers in advanced control engineering, finance, mathematical systems theory, applied probability and stochastic processes, and numerical analysis. From Reviews of the First Edition: This book is concerned with robust control of stochastic systems. One of the main features is its coverage of jump Markovian systems. ... Overall, this book presents results taking into consideration both white noise and Markov chain perturbations. It is clearly written and should be useful for people working in applied mathematics and in control and systems theory. The references cited provide further reading sources. (George Yin, Mathematical Reviews, Issue 2007 m) This book considers linear time varying stochastic systems, subjected to white noise disturbances and system parameter Markovian jumping, in the context of optimal control ... robust stabilization, and disturbance attenuation. ... The material presented in the book is organized in seven chapters. ... The book is very well written and organized. ... is a valuable reference for all researchers and graduate students in applied mathematics and control engineering interested in linear stochastic time varying control systems with Markovian parameter jumping and white noise disturbances. (Zoran Gajic, SIAM Review, Vol. 49 (3), 2007)

Since its origins in the 1940s, the subject of decision making under uncertainty has grown into a diversified area with application in several branches of engineering and in those areas of the social sciences concerned with policy analysis and prescription. These approaches required a computing capacity too expensive for the time, until the ability to collect and process huge quantities of data engendered an explosion of work in the area. This book provides succinct and rigorous treatment of the foundations of stochastic control; a unified approach to filtering, estimation, prediction, and stochastic and adaptive control; and the conceptual framework necessary to understand current trends in stochastic control, data mining, machine learning, and robotics.

This comprehensive introduction to the estimation and control of dynamic stochastic systems provides complete derivations of key results. The second edition includes improved and updated material, and a new presentation of polynomial control and new derivation of linear-quadratic-Gaussian control.

This monograph, now in a thoroughly revised second edition, develops the theory of stochastic calculus in Hilbert spaces and applies the results to the study of generalized solutions of stochastic parabolic equations. The emphasis lies on second-order stochastic parabolic equations and their connection to random dynamical systems. The authors further explore applications to the theory of optimal non-linear filtering, prediction, and smoothing of partially observed diffusion processes. The new edition now also includes a chapter on chaos expansion for linear stochastic evolution systems. This book will appeal to anyone working in disciplines that require tools from stochastic analysis and PDEs, including pure mathematics, financial mathematics, engineering and physics.