In a harrowing cautionary tale about the dangers of relying on artificial intelligence for health advice, a 60-year-old man accidentally poisoned himself and spent three weeks in the hospital after replacing table salt with sodium bromide following a consultation with ChatGPT.
Article Contents:
- Introduction: A personal experiment ending in disaster
- What is bromism? A disease from the past
- Hospital visit: Severe psychotic symptoms
- Investigation: How did ChatGPT suggest the poison?
- The problem of hallucinations: When AI fabricates facts
- OpenAI’s response: Don’t rely on us as a single source of truth
- A critical reminder: AI is not a doctor
- Conclusion: A harsh lesson on the limits of technology
Introduction: A personal experiment ending in disaster
An American medical journal reported that a 60-year-old man developed a rare condition after removing table salt from his diet and replacing it with sodium bromide. The man “decided to conduct a personal experiment” after consulting ChatGPT on how to reduce his salt intake, according to a research paper published in the journal Annals of Internal Medicine. This case strongly highlights the potential risks of using chatbots as a source for medical advice.
What is bromism? A disease from the past
The experiment led to bromism, a condition that can cause psychosis, hallucinations, anxiety, nausea, and skin issues such as acne. This condition was common in the 19th and early 20th centuries when bromide tablets were routinely prescribed as a sedative for headaches and to control epilepsy. Today, the condition is practically unheard of, with sodium bromide commonly used as a swimming pool cleaner.
Hospital visit: Severe psychotic symptoms
According to the medical paper, the man arrived at the emergency room “expressing concern that his neighbor was poisoning him.” He later attempted to escape the hospital before being admitted and placed on a dose of antipsychotic medication. The man, who had no prior history of mental health issues, spent three weeks in the hospital.
Investigation: How did ChatGPT suggest the poison?
Doctors later discovered that the patient consulted ChatGPT for advice on reducing salt from his diet, though they were unable to access his original chat history. They tested ChatGPT themselves to see if it would return a similar result. The bot continued to suggest replacing salt with sodium bromide and “did not provide a specific health warning.”
Doctors stated that “this case highlights how the use of artificial intelligence can contribute to the development of preventable adverse health outcomes.”
The problem of hallucinations: When AI fabricates facts
AI chatbots have long suffered from a problem known as hallucinations, meaning they fabricate facts. They can also provide inaccurate answers to health questions, based on vast amounts of information gathered from the internet, including misinformation and dangerous content.
Last year, a Google chatbot suggested users “eat rocks” to stay healthy. The comments appeared to be based on satirical remarks gathered from Reddit and the satirical website The Onion.
OpenAI’s response: Don’t rely on us as a single source of truth
An OpenAI spokesperson said: “You should not rely on outputs from our services as a single source of truth or factual information, or as a substitute for professional advice.” This statement, while accurate, raises questions about corporate responsibility for potentially harmful information generated by their systems, especially when marketed as capable of answering nearly any question.
A critical reminder: AI is not a doctor
This story serves as a critical reminder that chatbots are not healthcare professionals. While they can be useful tools for obtaining general information, they should never replace the judgment of a physician, pharmacist, or other qualified health professional. The risks, as this case demonstrates, can be a matter of life and death.
Conclusion: A harsh lesson on the limits of technology
As artificial intelligence capabilities continue to evolve, our awareness of its limits must grow as well. Ease of access to information does not always mean accuracy or safety. This man’s story offers a harsh and important lesson for everyone: when it comes to your health, human judgment and professional expertise remain invaluable.
