News

ChatGPT bot passes US law school exam

January 25, 2023 09:47 PM


A chatbot powered by reams of data from the internet has passed exams at a US law school after writing essays on topics ranging from constitutional law to taxation and torts.

ChatGPT from OpenAI, a US company that this week got a massive injection of cash from Microsoft, uses artificial intelligence (AI) to generate streams of text from simple prompts.

The results have been so good that educators have warned it could lead to widespread cheating and even signal the end of traditional classroom teaching methods.

Jonathan Choi, a professor at Minnesota University Law School, gave ChatGPT the same test faced by students, consisting of 95 multiple-choice questions and 12 essay questions.

In a white paper titled "ChatGPT goes to law school" published on Monday, he and his coauthors reported that the bot scored a C+ overall.

While this was enough for a pass, the bot was near the bottom of the class in most subjects and "bombed" at multiple-choice questions involving mathematics.

'Not a great student'

"In writing essays, ChatGPT displayed a strong grasp of basic legal rules and had consistently solid organization and composition," the authors wrote.

But the bot "often struggled to spot issues when given an open-ended prompt, a core skill on law school exams".

Officials in New York and other jurisdictions have banned the use of ChatGPT in schools, but Choi suggested it could be a valuable teaching aide.

"Overall, ChatGPT wasn't a great law student acting alone," he wrote on Twitter.

"But we expect that collaborating with humans, language models like ChatGPT would be very useful to law students taking exams and to practicing lawyers."

And playing down the possibility of cheating, he wrote in reply to another Twitter user that two out of three markers had spotted the bot-written paper.

"(They) had a hunch and their hunch was right, because ChatGPT had perfect grammar and was somewhat repetitive," Choi wrote.



Most Read

  1. Lahore Board extends due date of admission fee for Intermediate 2nd Annual Exam Lahore Board extends due date of admission fee for Intermediate 2nd Annual Exam
  2. Port Qasim Karachi receives its biggest ever cargo vessel ‘DP World’ Port Qasim Karachi receives its biggest ever cargo vessel ‘DP World’
  3. Visa rejection rumors: Ducky Bhai and Momin Saqib in extreme anger Visa rejection rumors: Ducky Bhai and Momin Saqib in extreme anger
  4. Hania Aamir recites Astaghfar after watching Yashma Gill’s bold video Hania Aamir recites Astaghfar after watching Yashma Gill’s bold video
  5. Pakistani rupee’s marathon-run against US dollar continues in interbank Pakistani rupee’s marathon-run against US dollar continues in interbank
  6.  Lux Style Awards 2023 nominations out now  Lux Style Awards 2023 nominations out now

Opinion

  1. India’s invasion of Kashmir is violation of UN Charter
    India’s invasion of Kashmir is violation of UN Charter

    By Dr Ghulam Nabi Fai

  2. World Suicide Prevention Day: Creating Hope Through Action
    World Suicide Prevention Day: Creating Hope Through Action

    By Dr Asif Channer

  3. Gender equality: A pre-requisite for a balanced society
    Gender equality: A pre-requisite for a balanced society

    By Mehak Sabir

  4. Time to move on and build a better Pakistan
    Time to move on and build a better Pakistan

    By Murtaza Rafiq Bhutto

  5. Asif Zardari as next PM could potentially unite political parties for economic stability
    Asif Zardari as next PM could potentially unite political parties for economic stability

    By Rehan Khan Ghauri