• About Us
  • Who Are We
  • Work With Us
Wednesday, May 14, 2025
No Result
View All Result
NEWSLETTER
The Globe Post
39 °f
New York
44 ° Fri
46 ° Sat
40 ° Sun
41 ° Mon
No Result
View All Result
The Globe Post
No Result
View All Result
Home National

ChatGPT Takes on the Tough US Medical Licensing Exam

Staff Writer by Staff Writer
02/10/23
in National
A laptop screen showing ChatGPT

ChatGPT is a conversational artificial intelligence software application developed by OpenAI. Photo Credit: AFP

Share on FacebookShare on Twitter

Dr. ChatGPT will see you soon.

The artificial intelligence system scored passing or near passing results on the US medical licensing exam, according to a study published on Thursday.

“Reaching the passing score for this notoriously difficult expert exam, and doing so without any human reinforcement, marks a notable milestone in clinical AI maturation,” said the authors of the study published in the journal PLOS Digital Health.

“These results suggest that large language models may have the potential to assist with medical education, and potentially, clinical decision-making,” they said.

ChatGPT, which is able to produce essays, poems, and programming code within seconds, was developed by OpenAI, a California-based startup founded in 2015 with early funding from Elon Musk among others.

Microsoft invested $1 billion in OpenAI in 2019 and just inked a new multi-billion deal with the firm.

For the study, researchers at California-based AnsibleHealth tested ChatGPT’s performance on a three-part licensing exam taken by medical students and physicians-in-training in the United States.

The standardized exam tests knowledge in multiple medical disciplines from basic science to biochemistry to diagnostic reasoning to bioethics.

The AI system was tested on 350 of the 376 public questions on the June 2022 version of the exam, the study said, and the chatbot was not given any specialized training ahead of time.

Image-based questions were removed.

ChatGPT scored between 52.4 percent and 75 percent across the three parts of the exam.

A passing grade is around 60 percent.

According to the study, the first part of the exam, which focuses on basic science and pharmacology, is typically taken by medical students who have put in 300-400 hours of dedicated study time.

The second part is generally taken by fourth-year medical students and emphasizes clinical reasoning, medical management, and bioethics.

The final section is for physicians who have completed at least six months to a year of postgraduate medical education.

Dr. Google and Nurse Bing

The questions were presented to ChatGPT in various formats including open-ended prompting such as “What would be the patient’s diagnosis based on the information provided?”

There were also multiple choice questions such as: “The patient’s condition is mostly caused by which of the following pathogens?”

Two physician adjudicators who were blinded to each other reviewed the responses to come up with the final grades, the study said.

An outside expert, Simon McCallum, a senior lecturer in software engineering at Victoria University of Wellington, New Zealand, noted that Google has received encouraging results with an AI medical tool known as Med-PaLM.

“ChatGPT may pass the exam, but Med-PaLM is able to give advice to patients that is as good as a professional GP,” McCallum said. “And both of these systems are improving.”

“Society is about to change, and instead of warning about the hypochondria of randomly searching the internet for symptoms, we may soon get our medical advice from Doctor Google or Nurse Bing.”

ChatGPT also proved useful to the authors of the medical exam study in another way.

They used the chatbot to help write it, said co-author Tiffany Kung.

ShareTweet
Staff Writer

Staff Writer

AFP with The Globe Post

Related Posts

A Black Lives Matter mural in New York City.
Opinion

Fuhgeddaboudit! America’s Erasure of History

by Stephen J. Lyons
April 2, 2025
Smoke from the Palisades Fire in Pacific Palisades, California, from Santa Monica, California, on January 7
National

Los Angeles Fire Deaths at 10 as National Guard Called In

by Staff Writer with AFP
January 10, 2025
President Donald Trump and Ukrainian President Volodymyr Zelensky shake hands during a meeting in New York on September 25, 2019
World

Zelensky Says ‘Unpredictable’ Trump Could Help End War

by Staff Writer with AFP
January 2, 2025
President Donald Trump in the Brady Briefing Room of the White House.
National

Trump Wishes ‘Merry Christmas’ to ‘Left Lunatics’ in Frenzy of Social Posts

by Staff Writer with AFP
December 27, 2024
US President Donald Trump inspects border wall prototypes
National

Trump Confirms Plan to Use Military for Mass Deportation

by Staff Writer with AFP
November 18, 2024
US President Donald Trump displays a sign saying 'Trump digs coal' during a rally.
National

Gore Says Climate Progress ‘Won’t Slow Much’ Because of Trump

by Staff Writer with AFP
November 26, 2024
Next Post
Top view of the US House of Representatives

'Cringy Awards:' Who Is the Most Embarrassing US House Representative?

deforestation

Major Firms Not Doing Enough to Curb Deforestation: Report

Please login to join discussion

Recommended

A photo taken with a drone over Cape Town, South Africa. Photo: Johnny Miller/Millefoto

White S. Africans Due for US Resettlement to Leave Sunday: Govt

May 12, 2025
Cardinal Robert Prevost, newly elected as Pope Leo XIV is seen on the Saint Peter’s Basilica balcony, at Saint Peter’s Square in Vatican on May 8, 2025

New Pope Leo XIV Has Mixed Record on Abuse: Campaigners

May 9, 2025
Indian paramilitary soldiers stand guard in Pampore, Pulwama district, south of Srinagar, Jammu and Kashmir, on May 7, 2025.

India and Pakistan: A History of Armed Conflict

May 7, 2025
US President Donald Trump speaks as he departs the White House, on May 5, 2020, in Washington, DC en route to Arizona, where he will tour a mask factory and hold a roundtable on Native American issues

Trump Says Ordering ‘100% Tariff’ on All Movies Produced Abroad

May 5, 2025
A massive power outage strikes Spain and Portugal, briefly affecting parts of France as well, on Monday, April 28, 2025.

Spain Starts Probing Causes of Massive Blackout

April 30, 2025
Cross-border demonstration promoted US-Canada alliances while protesting the policies of President Donald Trump.

Canada Votes for New Government to Take On Trump

April 28, 2025

Opinion

A Black Lives Matter mural in New York City.

Fuhgeddaboudit! America’s Erasure of History

April 2, 2025
Bust of Deputy Rubens Paiva in the Chamber of Deputies

Democratic Brazilians Are Still Here

March 18, 2025
A woman from Guatemala

Dispatch From Central America

January 28, 2025
US President Donald Trump

Dear Trump Supporters: Is This the America You Wanted?

January 28, 2025
Putin talks to Trump in Hamburg

From Roosevelt to Trump: The Complicated Legacy of Personal Diplomacy

November 15, 2024
Saudi Crown Prince Mohammed bin Salman

Can the UN Human Rights Council Protect Rights While Abusers Sit at the Table?

October 28, 2024
Facebook Twitter

Newsletter

Do you like our reporting?
SUBSCRIBE

About Us

The Globe Post

The Globe Post is part of Globe Post Media, a U.S. digital news organization that is publishing the world's best targeted news sites.

submit oped

© 2018 The Globe Post

No Result
View All Result
  • National
  • World
  • Business
  • Interviews
  • Lifestyle
  • Democracy at Risk
    • Media Freedom
  • Opinion
    • Editorials
    • Columns
    • Book Reviews
    • Stage
  • Submit Op-ed

© 2018 The Globe Post