TLDR Tech / AI
dig.bench
dig.bench is a benchmark that measures whether an agent can experiment to discover a game's unknown rules. It contains 70 text-based games, 21 that have been publicly released. Progress is scored by whether the game can be beaten within a limited number of steps. Humans can make the discoveries necessary to solve even the hardest games, while the best models struggle to beat games in the top tier.
Read the full story