| Título: | Energy Storage Applications of the Knowledge Gradient for Calibrating Continuous Parameters, Approximate Policy Iteration using Bellman Error Minimization with Instrumental Variables, and Covariance Matrix Estimation using an Errors-in-Variables Factor Model |
| Autores: | Scott, Warren Robert |
| Fecha: |
2012-08-01 2012-08-01 2012 |
| Publicador: | Universidad de Princenton |
| Fuente: |
 |
| Tipo: | Academic dissertations (Ph.D.) |
| Tema: | Operations research |
| Descripción: | We describe an adaptation of the knowledge gradient, originally developed for discrete ranking and selection problems, to the problem of calibrating continuous parameters for the purpose of tuning a simulator. The knowledge gradient for continuous parameters uses a continuous approximation of the expected value of a single measurement to guide the choice of where to collect information next. We show how to find the parameter setting that maximizes the expected value of a measurement by optimizing a continuous but nonconcave surface. We compare the method to sequential kriging for a series of test surfaces, and then demonstrate its performance in the calibration of an expensive industrial simulator. We next describe an energy storage problem which combines energy from wind and the grid along with a battery to meet a stochastic load. We formulate the problem as an infinite horizon Markov decision process. We first discretize the state space and action space on a simplfied version of the problem to get optimal solutions using exact value iteration. We then evaluate several approximate policy iteration algorithms and evaluate their performance. We show that Bellman error minimization with instrumental variables is equivalent to projected Bellman error minimization, previously believed to be two different policy evaluation algorithms. Furthermore, we provide a convergence proof for Bellman error minimization with instrumental variables under certain assumptions. We compare approximate policy iteration and direct policy search on the simplified benchmark problems along with the full continuous problems. Finally, we describe a portfolio selection method for choosing virtual electricity contracts in the PJM electricity markets, contracts whose payoffs depend on the difference between the day-ahead and real-time locational marginal electricity prices in PJM. We propose an errors-in-variables factor model which is an extension of the classical capital asset pricing model. We show how the model can be used to estimate the covariance matrix of the returns of assets. For US equities and PJM virtual contracts, we show the benefits of the portfolios produced with the new covariance estimation method. |
| Idioma: | Inglés |
1 Engineering solutions for a carbon-constrained world por Celia, M. A.,Nordbotten, J. M. | 6 Impact of capillary forces on large-scale migration of CO2 por Nordbotten, Jan M.,Dahle, Helge K. |
2 Analysis of Plume Extent using Analytical Solutions for CO2 Storage por Nordbotten, Jan M.,Celia, Michael A. | 7 Impact of geological heterogeneity on early-stage CO2 plume migration por Ashraf, Meisam,Lie, Knut-Andreas,Nilsen, Halvor M.,Nordbotten, Jan M.,Skorstad, Arne |
3 A model-oriented benchmark problem for CO2 storage por Dahle, Helge K.,Eigestad, Geir T.,Nordbotten, Jan M.,Pruess, K. | 8 CO2 trapping in sloping aqiufers: High resolution numerical simulations por Elenius, Maria,Tchelepi, Hamdi,Johannsen, Klaus |
4 Report from CO2 storage workshop por Dahle, Helge K.,Lien, Martha,Nordbotten, Jan M.,Lie, Knut-Andreas,Braathen, Alvar,Helmig, Rainer,Class, Holger,Celia, Michael A. | 9 Streamline methods for parabolic differential equations por Hafver, Jørn |
5 Summary of Princeton Workshop on Geological Storage of CO2 por Celia, Michael A.,Nordbotten, Jan M.,Bachu, Stefan,Kavetski, Dmitri,Gasda, Sarah | 10 Vertically Averaged Models for CO2 Storage in Porous Media por Hammer, Andreas |