ChatGPT-4o scored 94% on the United Kingdom Medical Licensing Exam Applied Knowledge Test and 89.9% on the United States Medical Licensing Exam Step 1. Performance was not diminished when the questions were rewritten into novel versions, or on completely novel questions which were not based on any existing questions.
https://link.springer.com/article/10.1007/s40670-025-02293-z
https://link.springer.com/article/10.1007/s40670-025-02293-z