I had a personal experience with ChatGPT with a recent personal family issue with a severe disease and I also suffer from the over-optimism of these technologies, you know, so even this was a very, very complex case, the patient eventually died, and the technology was telling me, you know, she has a 95% chance of survival, so this was interesting for me because I was emotionally compromised, but at the same time, I was testing an AI tool that could, you know, I knew how it works...
I had a personal experience with ChatGPT with a recent personal family issue with a severe disease and I also suffer from the over-optimism of these technologies, you know, so even this was a very, very complex case, the patient eventually died, and the technology was telling me, you know, she has a 95% chance of survival, so this was interesting for me because I was emotionally compromised, but at the same time, I was testing an AI tool that could, you know, I knew how it works. So I was analyzing what it was trying to drive me. And I can tell, you know, that non-regulated AI tools just camouflage reality sometimes for patients. It’s also a very ethical issue. There is no clear solution for this. I think the only option is to spend more time with patients explaining the real conditions. Sometimes we are time-concerned and we cannot deliver the adequate information to patients. And if patients find this ChatGPT or Gemini kind of optimized answers, they’ll probably suffer some discomfort or lack of reliance. And it is not easy at all. I mean, I think the only solution for this kind of task would be for institutions like the NHS or our health systems to develop or at least validate tools that have been purposefully designed for such a task. But even so, you still largely depend on how the user puts the data on the system. So if you say that you are not so sick or you meet some of the conditions of your health, the AI will probably still tend to omit or to not emphasize the potential omissions that you made during the conversation. And that’s, oh, that’s terrible. I mean, I don’t have a clear solution for that, except probably this needs regulation. And I think it’s where Europe is moving to. I don’t know about other countries, but the European Union has a strong intention to regulate all these technologies. And probably it should somehow be regulated.
This transcript is AI-generated. While we strive for accuracy, please verify this copy with the video.