Get the latest Science News and Discoveries

Study finds ChatGPT gets science wrong more often than you think


A new study put ChatGPT to the test by asking it to judge whether hundreds of scientific hypotheses were true or false—and the results were far from reassuring. While the AI got it right about 80% of the time on the surface, its performance dropped significantly when accounting for random guessing, revealing only modest reasoning ability. Even more concerning, it frequently contradicted itself when asked the exact same question multiple times, sometimes flipping answers back and forth.

None

Get the Android app

Or read this on ScienceDaily

Read more on:

Photo of Science

Science

Photo of Study

Study

Photo of ChatGPT

ChatGPT

Related news:

News photo

Dick Van Dyke Credits His Longevity to One Habit, And Science Supports It

News photo

Changing flight paths could slash aviation’s climate impact, study suggests - EurekAlert!

News photo

Thoughts don’t kill people, but study suggests options for keeping guns from doing so - EurekAlert!