> Why do you think that the 2024 Putnam programs that they used to test were in the training data?

They reference https://artofproblemsolving.com/community/c13_contest_collec... for the source of their scrape and the Putnam problems are on that page under 'Undergraduate Contests'.