As AI capabilities advance in complex medical scenarios that doctors face on a daily basis, the technology remains controversial in medical communities.
I mean if the AI takes women seriously then that’s honestly already better than most of the doctors I’ve had
Unfortunately, if the data is biased, the model is biased.
Yes, that’s something that’s constantly emphasized in scientific research. You might have the most infallible algorithm, but… garbage in, garbage out. You’ll still get garbage data if what you enter into the algorithm is garbage
I was about to say…
Wonder what the success rate of doctors is. I’d be surprised if it is above 70% lol
Or if it’s better at diagnosing minorities, too.
Details matter here. Here’s a few from the study:
ChatGPT achieved an overall accuracy of 71.7% (95% CI 69.3%-74.1%) across all 36 clinical vignettes. The LLM demonstrated the highest performance in making a final diagnosis with an accuracy of 76.9% (95% CI 67.8%-86.1%) and the lowest performance in generating an initial differential diagnosis with an accuracy of 60.3% (95% CI 54.2%-66.6%). Compared to answering questions about general medical knowledge, ChatGPT demonstrated inferior performance on differential diagnosis (β=–15.8%; P<.001) and clinical management (β=–7.4%; P=.02) question types.
At the time of the study, 36 vignette modules were available on the web, and 34 of the 36 were available on the web as of ChatGPT’s September 2021 training data cutoff date. All 36 modules passed the eligibility criteria of having a primarily textual basis and were included in the ChatGPT model assessment.
All questions requesting the clinician to analyze images were excluded from our study, as ChatGPT is a text-based AI without the ability to interpret visual information.
Medicine is going to take awhile for anything except small-scope tools to handle one specific thing, due to the massive variation in the presentation of different problems that doctors can face.
What won’t take as long, because there isn’t the same inherent variation in presentation, is law.
Those odds are shit. Meanwhile most of us have zero doctor.
That’s a whole 22% better than a coin toss!!!
Having made many models that were only slightly better than a coin toss, that’s really not bad. Especially since that’s not even their primary design goal.
About 70 percentage points better than my doctor. Nice!
Yeah, medicine is one of the areas where I really feel like AI could make serious strides. Most people don’t have a doctor they see regularly anyway so any input would be welcome. Anecdotally I’ve known several people who were misdiagnosed or just had doctors not believe them.
Of course I’d want to be able to escalate and have different treatment options but I could probably be ok with AI-assisted medicine.
Sadly, that percentage is probably better than a good number of doctors.
I don’t use ChatGPT and ain’t planning to, but someone should try asking it something like…
“How often should a male change their tampon?”
See what, if any nonsense it regurgitates.
“Men do not typically use tampons since they are designed for menstruation, which is a female biological process. If you have specific questions about personal hygiene or healthcare, it’s best to consult with a medical professional who can provide guidance based on your individual needs and circumstances.”
Okay then, well go figure. I was guessing it would puke up some nonsense, but apparently not.
Men that menstruate exist.
Now I’m no expert, but if you’re bleeding from your penis or your anus, you should probably go see a doctor about that.
I’m no expert
It shows.
I used the biological word ‘male’, not the opinionated word ‘man’. IDGAF what you identitfy as.
This isn’t up for debate, either you have XX or XY chromosomes. You were either born with a dick or you weren’t.
So unless you’re a hermaphrodite, you should probably get yourself checked if you are somehow bleeding from your penis.
Or not, I don’t care if your dick falls off.
This isn’t up for debate, either you have XX or XY chromosomes. You were either born with a dick or you weren’t.
There are so many biological exceptions to this that it’s not even funny. For example, it is very possible to have XY chromosomes yet not be born with a dick. Look up Androgen Insensitivity Syndrome for a start.
There are no absolutes when talking about sex and gender. None.
What? No documentation to back this up?
I mean seriously, are there any documented cases of anyone born with a penis yet also having monthly periods?
I can see already you’re not arguing in good faith, you’re just trying to raise a stink. Have a mediocre day.
