| Título: | Models for Individual Decision-Making with Social Feedback |
| Autores: | Nedic, Andrea |
| Fecha: |
2011-11-18 2011-11-18 2011 |
| Publicador: | Universidad de Princenton |
| Fuente: |
 |
| Tipo: | Academic dissertations (Ph.D.) |
| Tema: |
choice model decision model social feedback social influence tafc task Cognitive psychology Neurosciences |
| Descripción: | To investigate the influence of input from fellow group members in a constrained decision-making context, we develop four 2-armed bandit tasks in which subjects freely select one of two options (A or B) and are informed of the resulting reward following each choice. Rewards are determined by the fraction x of past A choices by two functions f_A(x), f_B(x) (unknown to the subject) which intersect at a matching point that does not generally represent globally-optimal behavior. Each task is designed to probe a different type of behavior, and subjects work in groups of five with feedback of other group members' choices, of their rewards, of both, or with no knowledge of others' behavior. We employ a soft-max choice model that emerges from a drift-diffusion process, commonly used to model perceptual decision making with noisy stimuli. Here the stimuli are replaced by estimates of expected rewards produced by a temporal-difference reinforcement-learning algorithm, augmented to include appropriate feedback terms. Models are fitted for each task and feedback condition, and we use them to compare choice allocations averaged across subjects and individual choice sequences to highlight differences between tasks and inter-subject differences. The most complex model, involving both choice and reward feedback, contains only four parameters, but nonetheless reveals significant differences in individual strategies. Strikingly, we find that rewards feedback can be either detrimental or advantageous to performance, depending upon the task. To further investigate social effects and disassociate the behaviors motivated by the reward structure itself from the behaviors caused by social influence, we investigate data from our second experiment: a two-dimensional spatial exploration task in which rewards received are determined by a spatially-dependent schedule whose mean varies along one dimension, with no change in rewards, on average, along the other direction. We examine how rewards may be inferred over the space being explored, and then consider how this reward-inference model may elucidate behavioral changes and different propensities for exploration or exploitation arising from various types of social feedback. |
| Idioma: | Inglés |
1 Engineering solutions for a carbon-constrained world por Celia, M. A.,Nordbotten, J. M. | 6 Impact of capillary forces on large-scale migration of CO2 por Nordbotten, Jan M.,Dahle, Helge K. |
2 Analysis of Plume Extent using Analytical Solutions for CO2 Storage por Nordbotten, Jan M.,Celia, Michael A. | 7 Impact of geological heterogeneity on early-stage CO2 plume migration por Ashraf, Meisam,Lie, Knut-Andreas,Nilsen, Halvor M.,Nordbotten, Jan M.,Skorstad, Arne |
3 A model-oriented benchmark problem for CO2 storage por Dahle, Helge K.,Eigestad, Geir T.,Nordbotten, Jan M.,Pruess, K. | 8 CO2 trapping in sloping aqiufers: High resolution numerical simulations por Elenius, Maria,Tchelepi, Hamdi,Johannsen, Klaus |
4 Report from CO2 storage workshop por Dahle, Helge K.,Lien, Martha,Nordbotten, Jan M.,Lie, Knut-Andreas,Braathen, Alvar,Helmig, Rainer,Class, Holger,Celia, Michael A. | 9 Streamline methods for parabolic differential equations por Hafver, Jørn |
5 Summary of Princeton Workshop on Geological Storage of CO2 por Celia, Michael A.,Nordbotten, Jan M.,Bachu, Stefan,Kavetski, Dmitri,Gasda, Sarah | 10 Vertically Averaged Models for CO2 Storage in Porous Media por Hammer, Andreas |