Cargando…

Markov Decision Processes with Their Applications

Markov decision processes (MDPs), also called stochastic dynamic programming, were first studied in the 1960s. MDPs can be used to model and solve dynamic decision-making problems that are multi-period and occur in stochastic circumstances. There are three basic branches in MDPs: discrete-time MDPs,...

Descripción completa

Detalles Bibliográficos
Clasificación:Libro Electrónico
Autores principales: Hu, Qiying (Autor), Yue, Wuyi (Autor)
Autor Corporativo: SpringerLink (Online service)
Formato: Electrónico eBook
Idioma:Inglés
Publicado: New York, NY : Springer US : Imprint: Springer, 2008.
Edición:1st ed. 2008.
Colección:Advances in Mechanics and Mathematics, 14
Temas:
Acceso en línea:Texto Completo

MARC

LEADER 00000nam a22000005i 4500
001 978-0-387-36951-8
003 DE-He213
005 20220114152216.0
007 cr nn 008mamaa
008 100301s2008 xxu| s |||| 0|eng d
020 |a 9780387369518  |9 978-0-387-36951-8 
024 7 |a 10.1007/978-0-387-36951-8  |2 doi 
050 4 |a T57.6-57.97 
050 4 |a T55.4-60.8 
072 7 |a KJT  |2 bicssc 
072 7 |a BUS049000  |2 bisacsh 
072 7 |a KJT  |2 thema 
082 0 4 |a 003  |2 23 
100 1 |a Hu, Qiying.  |e author.  |4 aut  |4 http://id.loc.gov/vocabulary/relators/aut 
245 1 0 |a Markov Decision Processes with Their Applications  |h [electronic resource] /  |c by Qiying Hu, Wuyi Yue. 
250 |a 1st ed. 2008. 
264 1 |a New York, NY :  |b Springer US :  |b Imprint: Springer,  |c 2008. 
300 |a XV, 297 p.  |b online resource. 
336 |a text  |b txt  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
347 |a text file  |b PDF  |2 rda 
490 1 |a Advances in Mechanics and Mathematics,  |x 1876-9896 ;  |v 14 
505 0 |a Discretetimemarkovdecisionprocesses: Total Reward -- Discretetimemarkovdecisionprocesses: Average Criterion -- Continuous Time Markov Decision Processes -- Semi-Markov Decision Processes -- Markovdecisionprocessesinsemi-Markov Environments -- Optimal control of discrete event systems: I -- Optimal control of discrete event systems: II -- Optimal replacement under stochastic Environments -- Optimalal location in sequential online Auctions. 
520 |a Markov decision processes (MDPs), also called stochastic dynamic programming, were first studied in the 1960s. MDPs can be used to model and solve dynamic decision-making problems that are multi-period and occur in stochastic circumstances. There are three basic branches in MDPs: discrete-time MDPs, continuous-time MDPs and semi-Markov decision processes. Starting from these three branches, many generalized MDPs models have been applied to various practical problems. These models include partially observable MDPs, adaptive MDPs, MDPs in stochastic environments, and MDPs with multiple objectives, constraints or imprecise parameters. Markov Decision Processes With Their Applications examines MDPs and their applications in the optimal control of discrete event systems (DESs), optimal replacement, and optimal allocations in sequential online auctions. The book presents four main topics that are used to study optimal control problems: *a new methodology for MDPs with discounted total reward criterion; *transformation of continuous-time MDPs and semi-Markov decision processes into a discrete-time MDPs model, thereby simplifying the application of MDPs; *MDPs in stochastic environments, which greatly extends the area where MDPs can be applied; *applications of MDPs in optimal control of discrete event systems, optimal replacement, and optimal allocation in sequential online auctions. This book is intended for researchers, mathematicians, advanced graduate students, and engineers who are interested in optimal control, operation research, communications, manufacturing, economics, and electronic commerce. 
650 0 |a Operations research. 
650 0 |a Management science. 
650 0 |a Probabilities. 
650 0 |a Mathematical optimization. 
650 0 |a Calculus of variations. 
650 0 |a Industrial engineering. 
650 0 |a Production engineering. 
650 1 4 |a Operations Research, Management Science . 
650 2 4 |a Probability Theory. 
650 2 4 |a Calculus of Variations and Optimization. 
650 2 4 |a Industrial and Production Engineering. 
700 1 |a Yue, Wuyi.  |e author.  |4 aut  |4 http://id.loc.gov/vocabulary/relators/aut 
710 2 |a SpringerLink (Online service) 
773 0 |t Springer Nature eBook 
776 0 8 |i Printed edition:  |z 9781441942388 
776 0 8 |i Printed edition:  |z 9780387515465 
776 0 8 |i Printed edition:  |z 9780387369501 
830 0 |a Advances in Mechanics and Mathematics,  |x 1876-9896 ;  |v 14 
856 4 0 |u https://doi.uam.elogim.com/10.1007/978-0-387-36951-8  |z Texto Completo 
912 |a ZDB-2-SMA 
912 |a ZDB-2-SXMS 
950 |a Mathematics and Statistics (SpringerNature-11649) 
950 |a Mathematics and Statistics (R0) (SpringerNature-43713)