Zur Startseite gehen
0,00 €*
Cover: 9781461268840 | Discrete-Time Markov Control Processes | Basic Optimality Criteria
Dekorationsartikel gehören nicht zum Leistungsumfang.
Discrete-Time Markov Control Processes
Basic Optimality Criteria
Taschenbuch von Jean B. Lasserre (u. a.)
Sprache: Englisch

160,49 €*

inkl. MwSt.

Versandkostenfrei per Post / DHL

Aktuell nicht verfügbar

Kategorien:
Beschreibung
This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro­ grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re­ source management, (control of) epidemics, etc. However, most of the lit­ erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys­ tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.
This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro­ grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re­ source management, (control of) epidemics, etc. However, most of the lit­ erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys­ tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.
Inhaltsverzeichnis
1 Introduction and Summary.- 1.1 Introduction.- 1.2 Markov control processes.- 1.3 Preliminary examples.- 1.4 Summary of the following chapters.- 2 Markov Control Processes.- 2.1 Introduction.- 2.2 Markov control processes.- 2.3 Markov policies and the Markov property.- 3 Finite-Horizon Problems.- 3.1 Introduction.- 3.2 Dynamic programming.- 3.3 The measurable selection condition.- 3.4 Variants of the DP equation.- 3.5 LQ problems.- 3.6 A consumption-investment problem.- 3.7 An inventory-production system.- 4 Infinite-Horizon Discounted-Cost Problems.- 4.1 Introduction.- 4.2 The discounted-cost optimality equation.- 4.3 Complements to the DCOE.- 4.4 Policy iteration and other approximations.- 4.5 Further optimality criteria.- 4.6 Asymptotic discount optimality.- 4.7 The discounted LQ problem.- 4.8 Concluding remarks.- 5 Long-Run Average-Cost Problems.- 5.1 Introduction.- 5.2 Canonical triplets.- 5.3 The vanishing discount approach.- 5.4 The average-cost optimality inequality.- 5.5 The average-cost optimality equation.- 5.6 Value iteration.- 5.7 Other optimality results.- 5.8 Concluding remarks.- 6 The Linear Programming Formulation.- 6.1 Introduction.- 6.2 Infinite-dimensional linear programming.- 6.3 Discounted cost.- 6.4 Average cost: preliminaries.- 6.5 Average cost: solvability.- 6.6 Further remarks.- Appendix A Miscellaneous Results.- Appendix B Conditional Expectation.- Appendix C Stochastic Kernels.- Appendix D Multifunctions and Selectors.- Appendix E Convergence of Probability Measures.- References.
Details
Erscheinungsjahr: 2012
Fachbereich: Wahrscheinlichkeitstheorie
Genre: Mathematik
Rubrik: Naturwissenschaften & Technik
Medium: Taschenbuch
Reihe: Stochastic Modelling and Applied Probability
Inhalt: xiv
216 S.
ISBN-13: 9781461268840
ISBN-10: 1461268842
Sprache: Englisch
Ausstattung / Beilage: Paperback
Einband: Kartoniert / Broschiert
Autor: Lasserre, Jean B.
Hernandez-Lerma, Onesimo
Auflage: Softcover reprint of the original 1st ed. 1996
Hersteller: Springer New York
Springer US, New York, N.Y.
Stochastic Modelling and Applied Probability
Maße: 235 x 155 x 13 mm
Von/Mit: Jean B. Lasserre (u. a.)
Erscheinungsdatum: 30.09.2012
Gewicht: 0,365 kg
Artikel-ID: 105721268
Inhaltsverzeichnis
1 Introduction and Summary.- 1.1 Introduction.- 1.2 Markov control processes.- 1.3 Preliminary examples.- 1.4 Summary of the following chapters.- 2 Markov Control Processes.- 2.1 Introduction.- 2.2 Markov control processes.- 2.3 Markov policies and the Markov property.- 3 Finite-Horizon Problems.- 3.1 Introduction.- 3.2 Dynamic programming.- 3.3 The measurable selection condition.- 3.4 Variants of the DP equation.- 3.5 LQ problems.- 3.6 A consumption-investment problem.- 3.7 An inventory-production system.- 4 Infinite-Horizon Discounted-Cost Problems.- 4.1 Introduction.- 4.2 The discounted-cost optimality equation.- 4.3 Complements to the DCOE.- 4.4 Policy iteration and other approximations.- 4.5 Further optimality criteria.- 4.6 Asymptotic discount optimality.- 4.7 The discounted LQ problem.- 4.8 Concluding remarks.- 5 Long-Run Average-Cost Problems.- 5.1 Introduction.- 5.2 Canonical triplets.- 5.3 The vanishing discount approach.- 5.4 The average-cost optimality inequality.- 5.5 The average-cost optimality equation.- 5.6 Value iteration.- 5.7 Other optimality results.- 5.8 Concluding remarks.- 6 The Linear Programming Formulation.- 6.1 Introduction.- 6.2 Infinite-dimensional linear programming.- 6.3 Discounted cost.- 6.4 Average cost: preliminaries.- 6.5 Average cost: solvability.- 6.6 Further remarks.- Appendix A Miscellaneous Results.- Appendix B Conditional Expectation.- Appendix C Stochastic Kernels.- Appendix D Multifunctions and Selectors.- Appendix E Convergence of Probability Measures.- References.
Details
Erscheinungsjahr: 2012
Fachbereich: Wahrscheinlichkeitstheorie
Genre: Mathematik
Rubrik: Naturwissenschaften & Technik
Medium: Taschenbuch
Reihe: Stochastic Modelling and Applied Probability
Inhalt: xiv
216 S.
ISBN-13: 9781461268840
ISBN-10: 1461268842
Sprache: Englisch
Ausstattung / Beilage: Paperback
Einband: Kartoniert / Broschiert
Autor: Lasserre, Jean B.
Hernandez-Lerma, Onesimo
Auflage: Softcover reprint of the original 1st ed. 1996
Hersteller: Springer New York
Springer US, New York, N.Y.
Stochastic Modelling and Applied Probability
Maße: 235 x 155 x 13 mm
Von/Mit: Jean B. Lasserre (u. a.)
Erscheinungsdatum: 30.09.2012
Gewicht: 0,365 kg
Artikel-ID: 105721268
Warnhinweis

Ähnliche Produkte

Ähnliche Produkte

Taschenbuch
Cover: 9783528055660 | IT-Sicherheit | Grundlagen und Umsetzung in der Praxis | Rolf Oppliger
IT-Sicherheit
Grundlagen und Umsetzung in der Praxis
EAN: 9783528055660
Sprache: Deutsch
Von/Mit: Rolf Oppliger

79,99 €*

Aktuell nicht verfügbar

Buch
Cover: 9783642025914 | Terahertz Techniques | Erik Bründermann (u. a.) | Buch | XXII | 2012
Terahertz Techniques
EAN: 9783642025914
Sprache: Englisch
Von/Mit: Erik Bründermann (u. a.)

106,99 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9783540160274 | Montage großvolumiger Produkte mit Industrierobotern | Jörg Walther
Montage großvolumiger Produkte mit Industrierobotern
EAN: 9783540160274
Sprache: Deutsch
Von/Mit: Jörg Walther

54,99 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9783322946584 | Schalentheorie | Ernest Axelrad | Taschenbuch | Paperback | 211 S.
Schalentheorie
EAN: 9783322946584
Sprache: Deutsch
Von/Mit: Ernest Axelrad

37,99 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9783519022800 | Programmierung in Modula-2 | Joachim Lutz (u. a.) | Taschenbuch | 1989
Programmierung in Modula-2
Eine Einführung in das modulare Programmieren mit Anwendungsbeispielen unter UNIX, MS-DOS und TOS
EAN: 9783519022800
Sprache: Deutsch
Von/Mit: Joachim Lutz (u. a.)

49,95 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9783540077299 | Winddruckprobleme bei Bauwerken | Gustav-Erich Rosemeier | Taschenbuch
Winddruckprobleme bei Bauwerken
EAN: 9783540077299
Sprache: Deutsch
Von/Mit: Gustav-Erich Rosemeier

54,99 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9783330877528 | Eléments de statistiques pour les "non initiés" | Joé Clauvis Diffo
Eléments de statistiques pour les "non initiés"
EAN: 9783330877528
Sprache: Französisch
Von/Mit: Joé Clauvis Diffo

55,90 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9783519230328 | Laser | Markus Werner Sigrist (u. a.) | Taschenbuch | Paperback | vi
Laser
EAN: 9783519230328
Von/Mit: Markus Werner Sigrist (u. a.)

49,99 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9781493988518 | Semiparametric Regression with R | Jaroslaw Harezlak (u. a.) | Buch
Semiparametric Regression with R
EAN: 9781493988518
Sprache: Englisch
Von/Mit: Jaroslaw Harezlak (u. a.)

139,09 €*

Aktuell nicht verfügbar

Taschenbuch
Cover: 9781916279179 | Linear Regression With Matlab | James V Stone | Taschenbuch | Englisch
Linear Regression With Matlab
A Tutorial Introduction to the Mathematics of Regression Analysis
EAN: 9781916279179
Sprache: Englisch
Von/Mit: James V Stone

29,40 €*

Aktuell nicht verfügbar

Buch
Cover: 9783755784951 | Medizinprodukte und IVD | Wolfgang Ecker | Buch | 308 S. | Deutsch
Medizinprodukte und IVD
Die neuen EU-Verordnungen Ihr Komplettseminar für Projekt, Studium und Beruf
EAN: 9783755784951
Sprache: Deutsch
Von/Mit: Wolfgang Ecker

69,00 €*

Aktuell nicht verfügbar

Diese Website verwendet Cookies, um eine bestmögliche Erfahrung bieten zu können. Mehr Informationen ...