• About Us
  • Who Are We
  • Work With Us
Friday, June 2, 2023
No Result
View All Result
NEWSLETTER
The Globe Post
39 °f
New York
44 ° Fri
46 ° Sat
40 ° Sun
41 ° Mon
No Result
View All Result
The Globe Post
No Result
View All Result
Home National

ChatGPT Takes on the Tough US Medical Licensing Exam

Staff Writer by Staff Writer
02/10/23
in National
A laptop screen showing ChatGPT

ChatGPT is a conversational artificial intelligence software application developed by OpenAI. Photo Credit: AFP

Share on FacebookShare on Twitter

Dr. ChatGPT will see you soon.

The artificial intelligence system scored passing or near passing results on the US medical licensing exam, according to a study published on Thursday.

“Reaching the passing score for this notoriously difficult expert exam, and doing so without any human reinforcement, marks a notable milestone in clinical AI maturation,” said the authors of the study published in the journal PLOS Digital Health.

“These results suggest that large language models may have the potential to assist with medical education, and potentially, clinical decision-making,” they said.

ChatGPT, which is able to produce essays, poems, and programming code within seconds, was developed by OpenAI, a California-based startup founded in 2015 with early funding from Elon Musk among others.

Microsoft invested $1 billion in OpenAI in 2019 and just inked a new multi-billion deal with the firm.

For the study, researchers at California-based AnsibleHealth tested ChatGPT’s performance on a three-part licensing exam taken by medical students and physicians-in-training in the United States.

The standardized exam tests knowledge in multiple medical disciplines from basic science to biochemistry to diagnostic reasoning to bioethics.

The AI system was tested on 350 of the 376 public questions on the June 2022 version of the exam, the study said, and the chatbot was not given any specialized training ahead of time.

Image-based questions were removed.

ChatGPT scored between 52.4 percent and 75 percent across the three parts of the exam.

A passing grade is around 60 percent.

According to the study, the first part of the exam, which focuses on basic science and pharmacology, is typically taken by medical students who have put in 300-400 hours of dedicated study time.

The second part is generally taken by fourth-year medical students and emphasizes clinical reasoning, medical management, and bioethics.

The final section is for physicians who have completed at least six months to a year of postgraduate medical education.

Dr. Google and Nurse Bing

The questions were presented to ChatGPT in various formats including open-ended prompting such as “What would be the patient’s diagnosis based on the information provided?”

There were also multiple choice questions such as: “The patient’s condition is mostly caused by which of the following pathogens?”

Two physician adjudicators who were blinded to each other reviewed the responses to come up with the final grades, the study said.

An outside expert, Simon McCallum, a senior lecturer in software engineering at Victoria University of Wellington, New Zealand, noted that Google has received encouraging results with an AI medical tool known as Med-PaLM.

“ChatGPT may pass the exam, but Med-PaLM is able to give advice to patients that is as good as a professional GP,” McCallum said. “And both of these systems are improving.”

“Society is about to change, and instead of warning about the hypochondria of randomly searching the internet for symptoms, we may soon get our medical advice from Doctor Google or Nurse Bing.”

ChatGPT also proved useful to the authors of the medical exam study in another way.

They used the chatbot to help write it, said co-author Tiffany Kung.

ShareTweet
Staff Writer

Staff Writer

AFP with The Globe Post

Related Posts

A man holds US, Taiwan flags
Business

US and Taiwan Ink Trade Deal as China Issues Warning

by Staff Writer
June 2, 2023
A noose is seen on makeshift gallows as supporters of US President Donald Trump gather on the West side of the US Capitol in Washington DC on January 6, 2021
National

Militia Leader Gets 18 Years in Prison Over US Capitol Attack

by Staff Writer
May 26, 2023
A billboard showing the debt limit is seen in Washington, D.C.
National

US Republicans Upbeat on Prospects for Debt Deal

by Staff Writer
May 19, 2023
Military hardware rolls through Dvortsovaya Square during a Victory Day military parade in central Saint Petersburg
National

Pressing Russia, US Shares Nuclear Warhead Data Under Treaty

by Staff Writer
May 16, 2023
A man holding a gun
Opinion

The NRA’s Continuing Agenda of Fear

by Stephen J. Lyons
May 12, 2023
US Panel Recommends Nonprescription Use of Contraception Pill
National

US Panel Recommends Nonprescription Use of Contraception Pill

by Staff Writer
May 11, 2023
Next Post
Top view of the US House of Representatives

'Cringy Awards:' Who Is the Most Embarrassing US House Representative?

deforestation

Major Firms Not Doing Enough to Curb Deforestation: Report

Please login to join discussion

Recommended

A man holds US, Taiwan flags

US and Taiwan Ink Trade Deal as China Issues Warning

June 2, 2023
Migrants waiting at the Turkish border.

Beyond Numbers: Confronting Europe’s Broken Border System

May 30, 2023
A noose is seen on makeshift gallows as supporters of US President Donald Trump gather on the West side of the US Capitol in Washington DC on January 6, 2021

Militia Leader Gets 18 Years in Prison Over US Capitol Attack

May 26, 2023
Customers queue to enter a re-opened Zara clothes shop

EU Targets Fast Fashion in Push for Durable Goods

May 23, 2023
A billboard showing the debt limit is seen in Washington, D.C.

US Republicans Upbeat on Prospects for Debt Deal

May 19, 2023
Military hardware rolls through Dvortsovaya Square during a Victory Day military parade in central Saint Petersburg

Pressing Russia, US Shares Nuclear Warhead Data Under Treaty

May 16, 2023

Opinion

Migrants waiting at the Turkish border.

Beyond Numbers: Confronting Europe’s Broken Border System

May 30, 2023
A man holding a gun

The NRA’s Continuing Agenda of Fear

May 12, 2023
US Supreme Court Justice Clarence Thomas

A Supreme Folly 

April 24, 2023
Transgender Army veteran Tanya Walker speaks to protesters in Times Square near a military recruitment centre

Tennessee Is A Drag on the First Amendment

March 26, 2023
Chinese President Xi Jinping

China’s Path to Economic Dominance

March 15, 2023
An earthquake survivor reacts as rescuers look for victims and other survivors in Hatay, a Turkish province where hundreds of buildings were destroyed by the earthquake

Heed the Call of Our Broken World

March 1, 2023
Facebook Twitter

Newsletter

Do you like our reporting?
SUBSCRIBE

About Us

The Globe Post

The Globe Post is part of Globe Post Media, a U.S. digital news organization that is publishing the world's best targeted news sites.

submit oped

© 2018 The Globe Post

No Result
View All Result
  • National
  • World
  • Business
  • Interviews
  • Lifestyle
  • Democracy at Risk
    • Media Freedom
  • Opinion
    • Editorials
    • Columns
    • Book Reviews
    • Stage
  • Submit Op-ed

© 2018 The Globe Post