ChatGPT Falls Short in Bladder Cancer Diagnosis

Bladder cancer diagnosis is a complex process. Researchers looked at how well ChatGPT-4, a type of artificial intelligence, agrees with urologists on treatment plans. They used real patient data from 219 people who had a procedure called TURBT. The goal was to see if ChatGPT-4 could provide good advice based on patient information.

Patients in the study were mostly older adults, with an average age of 72. Many had had bladder cancer before. When looking at the tumors, doctors found that most were a type called urothelial carcinoma. Some were high-grade, which means they looked abnormal under a microscope.

Doctors and ChatGPT-4 did not agree on treatment plans very often. This was especially true for people who had had bladder cancer before or were getting a second look at their tumor. But, ChatGPT-4 was very good at agreeing with doctors on treatment plans for people with muscle-invasive bladder cancer.

ChatGPT-4 tended to be very cautious. It often suggested very serious treatments, like removing the bladder, even when they weren't necessary. This shows that while ChatGPT-4 can provide some helpful information, it's not good enough to make medical decisions on its own. Doctors need to use their own judgment, especially in tricky cases.

The study highlights the limitations of AI in healthcare. While AI can be helpful, it's not a replacement for doctor's expertise. Patients and doctors need to work together to make the best decisions. AI can help patients understand their options, but it's not ready to make decisions on its own.