An update on this post, from my inside sources:
word on the math streets of SF is that the OpenAI team tried something like 500 problems to get their 10 solutions.
I don’t know how much of an insider this source is (or this sources sources, etc), but (allowing for the possibility of confirmation bias) this is within the expected range.