| Título: | Mixed Acceleration Techniques for Solving Quickly Stochastic Shortest-Path Markov Decision Processes |
| Autores: |
García-Hernández,M. de G. Ruiz-Pinales,J Onaindía,E Ledesma-Orozco,S Aviña-Cervantes,J. G. Alvarado-Méndez,E Reyes-Ballesteros,A |
| Fecha: | 2011-08-01 |
| Publicador: | SCIELO |
| Fuente: |
 |
| Tipo: | journal article |
| Tema: |
Markov decision processes acceleration techniques prioritization |
| Descripción: | In this paper we propose the combination of accelerated variants of value iteration mixed with improved prioritized sweeping for the fast solution of stochastic shortest-path Markov decision processes. Value iteration is a classical algorithm for solving Markov decision processes, but this algorithm and its variants are quite slow for solving considerably large problems. In order to improve the solution time, acceleration techniques such as asynchronous updates, prioritization and prioritized sweeping have been explored in this paper. A topological reordering algorithm was also compared with static reordering. Experimental results obtained on finite state and action-space stochastic shortest-path problems show that our approach achieves a considerable reduction in the solution time with respect to the tested variants of value iteration. For instance, the experiments showed in one test a reduction of 5.7 times with respect to value iteration with asynchronous updates. |
| Idioma: | Inglés |
1 | 6 Fracturas maxilofaciales y factores asociados en derechohabientes del IMSS Campeche, México: Análisis retrospectivo 1994-1999 por Medina-Solis,Cario Eduardo,Córdova-González,José Luis,Casanova-Rosado,Alejandro José,Zazueta-Hernández,Maria Alejandra |
2 | 7 Factores de riesgo de mortalidad en el hijo de madre toxémica por Gómez-Gómez,Manuel,Danglot-Banck,Cecilia,García-de la Torre,Guadalupe Silvia,Antonio-Ocampo,Abdiel,Fajardo-Gutiérrez,Arturo,Sánchez-García,Maria Luisa,Ahumada-Ramírez,Elias |
3 Cerámicas mexicanas para cicatrización de piel por Piña-Barba,María Cristina,Tejeda-Cruz,Adriana,Regalado-Hernández,Miguel Ángel,Arenas-Reyes,María Isabel,Martín-Mandujano,Salvador,Montalvo,César | 8 I. De la enseñanza tutoral al aprendizaje a distancia por Cravioto,Alejandro |
4 Seguimiento de egresados de un diplomado en enseñanza de la Medicina por Ponce de León-Castañeda,Ma. Eugenia,Ruíz-Alcocer,Ma. del Carmen,Lozano-Sánchez,J. Rogelio | 9 II. La vocación científica: compromisos con el cambio permanente y la educación continua por Kretschmer,Roberto |
5 Primer estudio de teledermatología en México: Una nueva herramienta de salud pública por Lepe,Verónica,Moneada,Benjamín,Castanedo-Cázares,Juan Pablo,Martínez-Rodríguez,Alejandra,Mercado-Ceja,Sergio M,Gordillo-Moscoso,Antonio | 10 |