Page 1
Page 1
Stochastic Optimization Methods ; 1st ed.
Optimization problems arising in practice involve random parameters. For the computation of robust optimal solutions, i.e., optimal solutions being insensitive with respect to random parameter variations, deterministic substitute problems are needed. Based on the distribution of the random data, and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into deterministic substitute problems. Due to the occurring probabilities and expectations, approximative solution techniques must be applied. Deterministic and stochastic approximation methods and their analytical properties are provided: Taylor expansion, regression and response surface methods, probability inequalities, First Order Reliability Methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation methods, differentiation of probability and mean value functions. Convergence results of the resulting iterative solution procedures are given.
Stochastic Optimization Methods ; 2nd ed.
Optimization problems arising in practice involve random model parameters. For the computation of robust optimal solutions, i.e., optimal solutions being insensitive with respect to random parameter variations, appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data, and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the occurring probabilities and expectations, approximative solution techniques must be applied. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures, differentiation formulas for probabilities and expectations.
Stochastic Learning and Optimization : A Sensitivity-Based Approach
Covers various disciplines in learning and optimization, including perturbation analysis (PA) of discrete-event dynamic systems, Markov decision processes (MDP)s), reinforcement learning (RL), and adaptive control, within a unified framework. (A simple approach to MDPs) This book introduces MDP theory through a simple approach based on performance difference formulas. This approach leads to results for the n-bias optimality with long-run average-cost criteria and Blackwell's optimality without discounting.
Resource Allocation In Multiuser Multicarrier Wireless Systems
This book proposes a unified algorithmic framework based on dual optimization techniques that have complexities that are linear in the number of subcarriers and users, and that achieve negligible optimality gaps in standards-based numerical simulations.
Modeling Uncertainty : An Examination of Stochastic Theory, Methods, and Applications
Modeling Uncertainty: An Examination of Stochastic Theory, Methods, and Applications, is a volume undertaken by the friends and colleagues of Sid Yakowitz in his honor. Fifty internationally known scholars have collectively contributed 30 papers on modeling uncertainty to this volume. Each of these papers was carefully reviewed and in the majority of cases the original submission was revised before being accepted for publication in the book. The papers cover a great variety of topics in probability, statistics, economics, stochastic optimization, control theory, regression analysis, simulation, stochastic programming, Markov decision process, application in the HIV context, and others. There are papers with a theoretical emphasis and others that focus on applications. A number of papers survey the work in a particular area and in a few papers the authors present their personal view of a topic. It is a book with a considerable number of expository articles, which are accessible to a nonexpert - a graduate student in mathematics, statistics, engineering, and economics departments, or just anyone with some mathematical background who is interested in a preliminary exposition of a particular topic. Many of the papers present the state of the art of a specific area or represent original contributions which advance the present state of knowledge. In sum.
Discrete-Time Markov Chains : Two-Time-Scale Methods and Applications
The motivation stems from existing and emerging applications in optimization and control of complex hybrid Markovian systems in manufacturing, wireless communication, and financial engineering. Much effort in this book is devoted to designing system models arising from these applications, analyzing them via analytic and probabilistic techniques, and developing feasible computational algorithms so as to reduce the inherent complexity. This book presents results including asymptotic expansions of probability vectors, structural properties of occupation measures, exponential bounds, aggregation and decomposition and associated limit processes, and interface of discrete-time and continuous-time systems. One of the salient features is that it contains a diverse range of applications on filtering, estimation, control, optimization, and Markov decision processes, and financial engineering.
Le choix bayésien: Principes et pratique
Covers the so-called Bayesian approach to statistical inference and in particular its decision-making aspects. The bases of this axiomatics (choice of the a priori, optimal decisions, tests and regions of confidence) are discussed in detail, as well as more recent openings of Bayesian analysis such as the choice of models, the use of numerical methods. Stochastic approximation (MCMC), the theory of noninformative laws (Berger-Bernardo axioms) and the relation to the classical theory of admissibility. Each chapter is completed by an extensive series of exercises of increasing difficulty and by bibliographical notes on the themes addressed. This book can be used in a Master's program in Applied Mathematics, Biometrics, Econometrics or any other program that uses quantitative information processing techniques. It only requires a basic course in probability theory and mathematical statistics as a preliminary.
