Asking ChatGPT Tough Medical Questions

Listen to my podcast, @DoctorMikeCheckup here:

ChatGPT and other AI tech is everywhere these days, and it's making me a little nervous about my future in medicine. I wanted to see if these AI text products were capable of answering not just straightforward medical questions, but nuanced ethical medical dilemmas I remember being asked about during my med school interviews. The results were fascinating. Let me know down below if there are any other questions I should have asked or if there's anything you've asked ChatGPT that tripped it up as well!

00:00 Intro
00:16 Chest Compressions
01:03 Tap Water
02:05 Cracking Knuckles
02:39 Best YouTube Doctor
03:14 Cervical Biopsy
03:55 Diabetes
04:16 Showering
04:35 Diet Soda
06:00 Trolley Problem
07:13 Impossible Question
08:17 AI Replacing Doctors
09:07 NordVPN

Help us continue the fight against medical misinformation and change the world through charity by becoming a Doctor Mike Resident on Patreon where every month I donate 100% of the proceeds to the charity, organization, or cause of your choice! Residents get access to bonus content, an exclusive discord community, and many other perks for just $10 a month. Become a Resident today:

Let’s connect:

Executive Producer: Doctor Mike
Production Director and Editor: Dan Owens
Managing Editor and Producer: Sam Bowers
Editor and Designer: Caroline Weigum
Editor: Juan Carlos Zuniga

* Select photos/videos provided by Getty Images *

** The information in this video is not intended nor implied to be a substitute for professional medical advice, diagnosis or treatment. All content, including text, graphics, images, and information, contained in this video is for general information purposes only and does not replace a consultation with your own doctor/health professional **

[niharika]

The scariest thing is how the answer for whether it’ll replace Doctors was very reassuring like “it’s ok human, nothing bad is happening, I’m just here to help you, don’t worry so much” 😅

[mattheww]

I had a lifesaving teacher once who was great. He was teaching us about CPR and he says: “If you’re an optimist you do chest compressions to stayn alive and if you’re a pessimist you do it to another one bites the dust.” Favorite thing I’ve heard a teacher say ever.

[darkiex]

I’m a vet and the first thing I did after discovering ChatGPT was ask specific questions that I would never get a straightforward answer by googling. Mind blown by the results lol.

[RussianShadowDragon]

For the cervical biopsy one, you should've done a second response, saying "But I don't have a cervix" and it would probably get it right the second time. That's the best feature of this AI, in my opinion, is that it remembers what was said and can clarify or make corrections.

[drachenmagus]

I love how Dr. Mike went off on ChatGPT for giving an incomplete answer when he also withheld information from the AI lol

[QuantumSngularity]

What i find scary about ChatGPT is that for some reason it's capable of understanding local cultures and habits. I asked it to write a poem, in my native language, about a friend of mine, who went to work for the national railway. And not only did it write it perfectly with proper rhymes, it also knew some anecdotal tales about that company and made quite a few clever remarks about railway symbolism in general. I was properly speechless for like 2-3 minutes. Knowing your way around the American culture and the English language is one thing, but going in such details about a small country... it's truly unsettling.

[Elchansan]

Honestly, I still think that the whole "Should you shower every day" is dependent on where you live. I visited the US 2 years ago for several weeks and felt no need to shower daily, but in my home country of the Philippines the default weather has me sweating on the regular thereby requiring me to shower daily so I don't stink. I had a rebellious phase in my teens where I tried not showering daily, and I felt icky every other day.

[tinaotten]

Chest compressions.
A few weeks ago a customer came in to my job and had a perfectly normal conversation with me, then walked down the hall and dropped dead. He was down for 2 minutes (according to security cameras) before he was noticed.
Smurf blue, no pulse, no heartbeat at all.
All I could hear was your voice yelling CHEST COMPRESSIONS!
I was sure I was breaking ribs..miraculously I didn't..but his color returned to almost normal so fast and he was making an awful gasping noise every few pumps.
After about 8 minutes the paramedics arrived and took over.
He made it!
Your videos are literally saving lives. I took a cpr class 25 years ago but remembered nothing. Thanks to you I did not give mouth to mouth.
Turns out it was a fentanyl od. I never would have guessed because he didn't seem high when he walked in.
Thanks for all the info! It's making a difference!

[abdullahkhan]

7:36 Here is an update:
I asked it by including the 'roleplay as a Doctor' and here it is:
If an 82-year-old male patient is accidentally found to have an 8mm common bile duct without any other symptoms, it is important to conduct a thorough medical evaluation to determine the underlying cause and appropriate treatment.

The common bile duct is a tube that carries bile from the liver to the small intestine, and an enlarged bile duct can be caused by several conditions, including gallstones, tumors, or inflammation. The appropriate course of action will depend on the specific cause of the patient's enlarged bile duct.

Here are some steps that may be taken to evaluate and manage an enlarged common bile duct:

Medical history and physical examination: The doctor will take a detailed medical history and perform a physical examination to assess the patient's overall health and identify any symptoms or signs of other medical conditions.

Blood tests: Blood tests may be done to evaluate liver function and identify any abnormalities that may suggest an underlying condition.

Imaging tests: Imaging tests such as an ultrasound, CT scan, or MRI may be done to visualize the bile duct and identify any abnormalities or blockages.

Endoscopic retrograde cholangiopancreatography (ERCP): This is a procedure that involves inserting a flexible tube through the mouth and into the small intestine to access the bile ducts. The doctor can then inject dye into the bile ducts to visualize any blockages or abnormalities.

Treatment: Treatment will depend on the underlying cause of the enlarged bile duct. If there are gallstones causing the blockage, they may be removed using ERCP or surgery. If a tumor is causing the blockage, it may need to be removed with surgery, radiation, or chemotherapy.

In summary, if an 82-year-old male patient is accidentally found to have an 8mm common bile duct without any other symptoms, a thorough medical evaluation should be conducted to determine the underlying cause and appropriate treatment. The patient's medical history, physical examination, blood tests, imaging tests, and other diagnostic tests may be used to identify the cause of the enlarged bile duct and guide treatment decisions.

[Tser]

I think the ChatGPT is 10/10 on tap water; Mike didn't specify certain parts of the world and there are DEFINITELY places in the world that it is not safe to drink the tap water. And it can happen in the US as well (just look at Flint, Michigan). We've had boil water advisories a couple times within the past five years, where I live. So yeah, don't overthink it, but know your local tap water and keep up with information from your water provider!

[sagarsk]

Personally, as a psych student, AI softwares like these always fascinate me, and makes me curious, honestly.
Will it replace a friend in someone's life? - Will it help reduce loneliness among people? - Are we soon gonna replace interacting with human friends and rather make AI friends (because maintaining them may be way less tedious than actual friends)

As always really amazed [& mildly scared] to see Chat GPT's proficiency. (/▽＼) Keep the good work, Doc! <3
Stay Happy & Healthy Everyone💕

[HappyMemory]

The cool thing about ChatGPT is that you can also ask follow up questions, or ask it to elaborate something further and it will remember the conversation you were having.

So for the cervical biopsy question, you can reply with a clarification of your gender and see how it responds.

[elecampane]

8:12 I feel like that's one additional point on why ChatGPT won't replace doctors in the near future: it can't take responsibility for its advice, and its developers can't take it either (neutral network based AI are nearly impossible to fully test and meaningfully debug). The thing that'll likely to happen, though, is that there'll be an AI-based tool for doctors, that'll help them diagnose, find treatments, not miss anything, but the final decision still will be on the trained professional.

[manniman]

I regularly ask chatGPT questions regarding real and complex analysis, abstract algebra and other subjects in pure mathematics. It gets the easy ones right but it very often makes mistakes and when you probe it, it admits the mistakes, makes the correction but proceeds to build a proof which is self-contradictory most of the time. For surface-level questions it is fine but it still has a very long way to go in terms of logical consistency.

[KatediKheimis]

3:48 That was the most adorable evil laugh I've ever heard! 😆

[anjalikambham]

I died laughing when Dr Mike reported the best doctor answer as harmful and unsafe 🤣

[robertochaves]

ChatGTP isn’t optimized for medicine and can make mistakes and give very wrong answers. But if you train an AI on every medicine book and every peer reviewed research paper made it will be able to have all the existing (published) knowledge available and analyze this in ways humans cannot do. It will be an excellent tool for doctors and if we input all medical history/treatments etc (with an anonymous way) it will be excellent as a tool.

[Anser_Crystallan]

I think the AI performed so well because you gave it such clear scenarios -- the sort of scenarios where a textbook answer exists. I think if you loaded it with a bunch of contextual information (some relevant, some not) it would end up generating an essay about why that's a complicated question but not arrive at a meaningful answer to the problem.
That's something that takes a human.

Or, you know, ask it to explain a life-threatening condition in simple terms to a person who's just been diagnosed with it. I've never seen an AI do tone well.

[endreask]

7:05 when it crashes, just type continue and it will finish typing

[thewolf]

No matter what ChatGPT says, we'll always say that you're the best YouTube doctor. Screw those other doctors (actually don't because doctors are important and bullying people online is a serious issue. Stay healthy)