Animals routinely adapt to changes in the environment in order to survive. Though reinforcement learning may play a role in such adaptation, it is not clear that it is the only mechanism involved, as it is not well suited to producing rapid, relatively immediate changes in strategies in response to environmental changes. This research proposes that counterfactual reasoning might be an additional mechanism that facilitates change detection. An experiment is conducted in which a task state changes over time and the (...) participants had to detect the changes in order to perform well and gain monetary rewards. A cognitive model is constructed that incorporates reinforcement learning with counterfactual reasoning to help quickly adjust the utility of task strategies in response to changes. The results show that the model can accurately explain human data and that counterfactual reasoning is key to reproducing the various effects observed in this change detection paradigm. (shrink)

Ben shu zuo zhe tong guo zi shen de li jie he jing yan dui " dao de jing " jin xing le jie shuo he chan shi, bing jiang qi yu tai ji quan de lian quan dao li lian xi de si si ru kou. quan shu gong fen ba shi yi zhang, ji dui " dao de jing " de ba shi yi zhang fen bie zuo jie, ti lian qi zhu yao jing shen, jiang zhi yu (...) tai ji quan de xiang si quan li jie he chan shi. (shrink)