yamike

I asked 17 LLMs to generate browser games that feature a dog. Across 804 playable games generated, the models almost never made the background dog interactive unless they were hinted to do so. I built DogLM, a benchmark that evaluates whether an LLM, when prompted to build a video game...