Peekaboom is the second attempt (after Espgame) to produce a dataset which is useful for learning to solve vision problems based on voluntary game play. As a second attempt, it is meant to address all of the shortcomings of the first attempt. In particular:
- The locations of specific objects are provided by the data.
- The data collection is far more complete and extensive.
The data consists of:
- The source images. (1 file per image, just short of 60K images.)
- The in-game events. (1 file per image, in a lispy syntax.)
- A description of the event language.
There is a great deal of very specific and relevant data here so the hope that this will help solve vision problems seems quite reasonable.