The prompt:
When was the last US Presidential election on a non-leap year, and when was the last leap year without a U.S. Presidential election?
The correct answer, to the best of my knowledge, is respectively 1) 1900, and 2) either 1784 or 2024, depending on how you interpret the question. But when I ask GPT-4 about this, it constantly gets confused about which years are leap years and which aren’t, often referring to the same year as both a leap year and a non-leap year in the same paragraph.
https://chat.openai.com/share/e7ee225b-2432-4973-984c-20dd6db130e0
https://chat.openai.com/share/c5417122-4398-4631-8fbe-cd2dd2c31bbf
https://chat.openai.com/share/cf8081fe-9b64-47f2-af14-4915580c6028