This comprehensive introduction to the estimation and control of dynamic stochastic systems provides complete derivations of key results. The second edition includes improved and updated material, and a new presentation of polynomial control and new derivation of linear-quadratic-Gaussian control.

This book helps students, researchers, and practicing engineers to understand the theoretical framework of control and system theory for discrete-time stochastic systems so that they can then apply its principles to their own stochastic control systems and to the solution of control, filtering, and realization problems for such systems. Applications of the theory in the book include the control of ships, shock absorbers, traffic and communications networks, and power systems with fluctuating power flows. The focus of the book is a stochastic control system defined for a spectrum of probability distributions including Bernoulli, finite, Poisson, beta, gamma, and Gaussian distributions. The concepts of observability and controllability of a stochastic control system are defined and characterized. Each output process considered is, with respect to conditions, represented by a stochastic system called a stochastic realization. The existence of a control law is related to stochastic controllability while the existence of a filter system is related to stochastic observability. Stochastic control with partial observations is based on the existence of a stochastic realization of the filtration of the observed process.​

In this monograph the authors develop a theory for the robust control of discrete-time stochastic systems, subjected to both independent random perturbations and to Markov chains. Such systems are widely used to provide mathematical models for real processes in fields such as aerospace engineering, communications, manufacturing, finance and economy. The theory is a continuation of the authors’ work presented in their previous book entitled "Mathematical Methods in Robust Control of Linear Stochastic Systems" published by Springer in 2006. Key features: - Provides a common unifying framework for discrete-time stochastic systems corrupted with both independent random perturbations and with Markovian jumps which are usually treated separately in the control literature; - Covers preliminary material on probability theory, independent random variables, conditional expectation and Markov chains; - Proposes new numerical algorithms to solve coupled matrix algebraic Riccati equations; - Leads the reader in a natural way to the original results through a systematic presentation; - Presents new theoretical results with detailed numerical examples. The monograph is geared to researchers and graduate students in advanced control engineering, applied mathematics, mathematical systems theory and finance. It is also accessible to undergraduate students with a fundamental knowledge in the theory of stochastic systems.

Stochastic processes are found in probabilistic systems that evolve with time. Discrete stochastic processes change by only integer time steps (for some time scale), or are characterized by discrete occurrences at arbitrary times. Discrete Stochastic Processes helps the reader develop the understanding and intuition necessary to apply stochastic process theory in engineering, science and operations research. The book approaches the subject via many simple examples which build insight into the structure of stochastic processes and the general effect of these phenomena in real systems. The book presents mathematical ideas without recourse to measure theory, using only minimal mathematical analysis. In the proofs and explanations, clarity is favored over formal rigor, and simplicity over generality. Numerous examples are given to show how results fail to hold when all the conditions are not satisfied. Audience: An excellent textbook for a graduate level course in engineering and operations research. Also an invaluable reference for all those requiring a deeper understanding of the subject.

This will be the most up-to-date book in the area (the closest competition was published in 1990) This book takes a new slant and is in discrete rather than continuous time

This book extrapolates many of the concepts that are well defined for discrete-time deterministic sliding-mode control for use with discrete-time stochastic systems. It details sliding-function designs for various categories of linear time-invariant systems and its application for control. The resulting sliding-mode control addresses robustness issues and the functional-observer approach reduces the observer order substantially. Sliding-mode control (SMC) is designed for discrete-time stochastic systems, extended so that states lie within a specified band, and able to deal with incomplete information. Functional-observer-based SMC is designed for various clauses of stochastic systems: discrete-time; discrete-time with delay; state time-delayed; and those with parametric uncertainty. Stability considerations arising because of parametric uncertainty are taken into account and, where necessary, the effects of unmatched uncertainties mitigated. A simulation example is used to explain the use of the functional-observer approach to SMC design. Discrete-Time Stochastic Sliding-Mode Control Using Functional Observation will interest all researchers working in sliding-mode control and will be of particular assistance to graduate students in understanding the changes in design philosophy that arise when changing from continuous- to discrete-time systems. It helps to pave the way for further progress in applications of discrete-time SMC.

The book addresses the system performance with a focus on the network-enhanced complexities and developing the engineering-oriented design framework of controllers and filters with potential applications in system sciences, control engineering and signal processing areas. Therefore, it provides a unified treatment on the analysis and synthesis for discrete-time stochastic systems with guarantee of certain performances against network-enhanced complexities with applications in sensor networks and mobile robotics. Such a result will be of great importance in the development of novel control and filtering theories including industrial impact. Key Features Provides original methodologies and emerging concepts to deal with latest issues in the control and filtering with an emphasis on a variety of network-enhanced complexities Gives results of stochastic control and filtering distributed control and filtering, and security control of complex networked systems Captures the essence of performance analysis and synthesis for stochastic control and filtering Concepts and performance indexes proposed reflect the requirements of engineering practice Methodologies developed in this book include backward recursive Riccati difference equation approach and the discrete-time version of input-to-state stability in probability