The first finding that jumped out at us was that it is possible to learn too much ! In the tournament, investing lots of time in learning was not at all effective. In fact, we found a strong negative correlation between the proportion of a strategy’s moves that were INNOVATE or OBSERVE, as opposed to EXPLOIT, and how well the strategy performed. Successful strategies spent only a small fraction of their time (5-10%) learning, and the bulk of their time caching in on what they had learned, through playing EXPLOIT. Only through playing EXPLOIT can a strategy directly accrue fitness. Hencem every time a strategy chooses to learn new behavior, be it through playing INNOVATE or OBSERVE, there is a cost corresponding to the payoff that would have been received had EXPLOIT been played instead. This implied that the way to get on in life was to do a very quick bit of learning and then EXPLOIT, EXPLOIT, EXPLOIT until you die. That is a sobering lesson for someone like myself who has spent his whole life in school or university.
The first finding that jumped out at us was that it is possible to learn too much ! In the tournament, investing lots of time in learning was not at all effective. In fact, we found a strong negative correlation between the proportion of a strategy’s moves that were INNOVATE or OBSERVE, as opposed to EXPLOIT, and how well the strategy performed. Successful strategies spent only a small fraction of their time (5-10%) learning, and the bulk of their time caching in on what they had learned, through playing EXPLOIT. Only through playing EXPLOIT can a strategy directly accrue fitness. Hencem every time a strategy chooses to learn new behavior, be it through playing INNOVATE or OBSERVE, there is a cost corresponding to the payoff that would have been received had EXPLOIT been played instead. This implied that the way to get on in life was to do a very quick bit of learning and then EXPLOIT, EXPLOIT, EXPLOIT until you die. That is a sobering lesson for someone like myself who has spent his whole life in school or university.