How good is ChatGPT at climate science?

CMCC President Antonio Navarra reflects on our interview with ChatGPT and how good it is at answering questions related to climate science. "ChatGPT doesn't actually 'understand' anything [but] the technology’s potential is enormous and the next versions will be able to do much more than this interview shows."

The interview with ChatGPT, conducted on Climate Foresight, is interesting because it shows in some sense the real nature of Chat GPT, which in a way represents a collective wisdom of the Internet and the average shared consensus knowledge that emerges from the analysis of everything that is on the net. 

The answers that ChatGPT gives on the issue of climate change are basically sound, and they express the basic foundational understanding of the climate change problem and the issues around it which allows us to either understand or tackle the issue. 

It is remarkable that the information is by and large sound and correct and therefore captures the basics, a climate change common sense which has been harvested very efficiently from the Web. Therefore, Chat-GPT works well when used as an integrator of the common planetary knowledge. It is the collective sentiment that emerges from the amount of information that is available on the web without many of the incoherences and contradictions. 

However, the interview also reveals how it is much less effective when used to obtain specific information. For example, when specific sources and references were demanded of it. The results were hallucinated answers and/or mistakes. 

The tendency to provide an answer regardless of whether it is accurate or not seems to win over the restraint of providing correct information. It may be that some parameters need to be tuned or it could be because ChatGPT still doesn’t have access to enough content to be able to comment in an informed way on detailed issues. 

This probably demonstrates that ChatGPT doesn’t actually “understand” anything, although it’s important to say that this technology’s potential is enormous and that ChatGPT’s next versions will be able to do much more than this interview shows. It looks like the next few years are going to be very interesting.

Share

Videos

Ocean. Stories of Humans and Climate Change

The ocean tells stories of climate change. Journalism brings them to the world. A dialogue on how climate change and pollution are affecting the ocean and people’s lives, and how stories grounded in scientific evidence can be made accessible to the public at large through journalism and writing.

Fish is life: insights from The State of World Fisheries and Aquaculture 2018
Article

Fish is life: insights from The State of World Fisheries and Aquaculture 2018

Since 1961 the annual global growth in fish consumption has been twice as high as population growth, demonstrating that the fisheries sector is crucial in meeting the goal of a world without hunger and malnutrition. Data and in-depth analyses on global fish production, consumption and marketing rates, together with some first attempts at quantifying the possible future scenarios regarding the linkages of fisheries and aquaculture both to climate change and to other challenges, such as pollution. The current state of these two key sectors worldwide up to 2018 in the new FAO report.

Article

The Relationship Between Extreme Weather and Climate Change

Extreme weather is becoming increasingly common. Most recently, a record breaking heatwave in Greenland has gone viral thanks to the image of sled dogs wading through water where there should be ice. However, relating single weather events to climate change is problematic and, although these instances can act as indicators of a trend and eye-openers for public opinion, it is important to distinguish between single weather events and climate change.