I've seen a lot of news lately about the ways that particular LLMs score on particular tests.

Which if any of those tests can I go take online to see how my performance on them compares to the models?

New to LessWrong?

New Answer
New Comment

3 Answers sorted by

adamarkin

Dec 15, 2023

10

I took the test at https://iqtestonline.io. The test contains 30 questions that must be completed within 20 minutes. It tests your numerical, logical, and spatial reasoning skills. I get the IQ score result right after completing it for free. 
I used to take qualified test before and the result is quite similar to this online test. I think it's a quick and easy way if you want to get the grasp of where you rank. 

p.b.

Mar 17, 2023

10

On twitter the IQ score of IIRC 84 for ChatGPT and 96 for GPT-4 were making the rounds, maybe you refer to those? I believe these scores are based on this freely available online test: 

https://iqtest.com/take-the-test/

I took it on wednesday just for fun. It's purely text-based but involves many different types of reasoning (including spatial reasoning). It's also a timed test which arguably inflates the LLM scores compared to humans. 

Is this one of those tests where you spend lot of time answering the questions, and at the end there is "if you want to see the results, send money"?

Also, is there any reason to believe that the test was actually somehow validated, as opposed to just numbers completely made up?

1p.b.1y
This is one of the tests where you spent not too much time (I think I took 13 minutes) and at the end there was "this is your result, if you want to see fine-grained scores, send money". Well, they claim that it is somehow validated and my score was somewhat realistic.  Main negative point was the need to provide an email for the result. 

baturinsky

Mar 17, 2023

10

Not for the all of them, but for the many of them you can see data and other info around here : https://paperswithcode.com/dataset/mmlu 

[-][anonymous]1y10

I browsed around but cannot find the actual mmlu questions, or an example of 1 question.  How do I view them>

1baturinsky1y
"Homepage" button links to github, github readme links to tar with tests. Yeah, it's kinda not evident in some cases.
2 comments, sorted by Click to highlight new comments since: Today at 9:04 AM
[-]jmh1y30

Not sure if you've seen this or not: https://mashable.com/article/openai-gpt-4-exam-scores

But that references a number of standardized tests, some of which I suspect you have also taken. Here are a could of links to practice test that might have good matches for you to try.

https://www.tests.com/Free-Practice-Tests

https://www.khanacademy.org/college-careers-more/college-admissions/making-high-school-count/standardized-tests/a/full-length-sats-to-take-online

[Rewrite as I don't think the first comment was actually helpful.]

[-]nim1y10

Thank you! I didn't see your first version of this, but your current version is helpful for the human-specific tests that they're benchmarked on :)