麻豆影视

Skip to main content

Lawyers blame ChatGPT for tricking them into citing bogus case law

Share
NEW YORK -

Two apologetic lawyers responding to an angry judge in Manhattan federal court blamed ChatGPT Thursday for tricking them into including fictitious legal research in a court filing.

Attorneys Steven A. Schwartz and Peter LoDuca are facing possible punishment over a filing in a lawsuit against an airline that included references to past court cases that Schwartz thought were real, but were actually invented by the artificial intelligence-powered chatbot.

Schwartz explained that he used the groundbreaking program as he hunted for legal precedents supporting a client's case against the Colombian airline Avianca for an injury incurred on a 2019 flight.

The chatbot, which has fascinated the world with its production of essay-like answers to prompts from users, suggested several cases involving aviation mishaps that Schwartz hadn't been able to find through usual methods used at his law firm.

The problem was, several of those cases weren't real or involved airlines that didn't exist.

Schwartz told U.S. District Judge P. Kevin Castel he was 鈥渙perating under a misconception ... that this website was obtaining these cases from some source I did not have access to.鈥

He said he 鈥渇ailed miserably鈥 at doing follow-up research to ensure the citations were correct.

鈥淚 did not comprehend that ChatGPT could fabricate cases,鈥 Schwartz said.

Microsoft has invested some $1 billion in OpenAI, the company behind ChatGPT.

Its success, demonstrating how artificial intelligence could change the way humans work and learn, has generated fears from some. Hundreds of industry leaders signed a letter in May that warns 鈥 mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.鈥

Judge Castel seemed both baffled and disturbed at the unusual occurrence and disappointed the lawyers did not act quickly to correct the bogus legal citations when they were first alerted to the problem by Avianca's lawyers and the court. Avianca pointed out the bogus case law in a March filing.

The judge confronted Schwartz with one legal case invented by the computer program. It was initially described as a wrongful death case brought by a woman against an airline only to morph into a legal claim about a man who missed a flight to New York and was forced to incur additional expenses.

鈥淐an we agree that's legal gibberish?鈥 Castel asked.

Schwartz said he erroneously thought that the confusing presentation resulted from excerpts being drawn from different parts of the case.

When Castel finished his questioning, he asked Schwartz if he had anything else to say.

鈥淚 would like to sincerely apologize,鈥 Schwartz said.

He added that he had suffered personally and professionally as a result of the blunder and felt 鈥渆mbarrassed, humiliated and extremely remorseful.鈥

He said that he and the firm where he worked - Levidow, Levidow & Oberman - had put safeguards in place to ensure nothing similar happens again.

LoDuca, another lawyer who worked on the case, said he trusted Schwartz and didn't adequately review what he had compiled.

After the judge read aloud portions of one cited case to show how easily it was to discern that it was 鈥済ibberish,鈥 LoDuca said: 鈥淚t never dawned on me that this was a bogus case.鈥

He said the outcome 鈥減ains me to no end.鈥

Ronald Minkoff, an attorney for the law firm, told the judge that the submission 鈥渞esulted from carelessness, not bad faith鈥 and should not result in sanctions.

He said lawyers have historically had a hard time with technology, particularly new technology, 鈥渁nd it's not getting easier.鈥

鈥淢r. Schwartz, someone who barely does federal research, chose to use this new technology. He thought he was dealing with a standard search engine,鈥 Minkoff said. 鈥淲hat he was doing was playing with live ammo.鈥

Daniel Shin, an adjunct professor and assistant director of research at the Center for Legal and Court Technology at William & Mary Law School, said he introduced the Avianca case during a conference last week that attracted dozens of participants in person and online from state and federal courts in the U.S., including Manhattan federal court.

He said the subject drew shock and befuddlement at the conference.

鈥淲e're talking about the Southern District of New York, the federal district that handles big cases, 9/11 to all the big financial crimes,鈥 Shin said. 鈥淭his was the first documented instance of potential professional misconduct by an attorney using generative AI.鈥

He said the case demonstrated how the lawyers might not have understood how ChatGPT works because it tends to hallucinate, talking about fictional things in a manner that sounds realistic but is not.

鈥淚t highlights the dangers of using promising AI technologies without knowing the risks,鈥 Shin said.

The judge said he'll rule on sanctions at a later date.

CTVNews.ca Top Stories

The British Columbia election campaign is set to officially start today, with Lt.-Gov. Janet Austin issuing the writ for the Oct. 19 vote.

A northern Ontario man is facing a $12,000 fine after illegally shooting a moose near the Batchawan River.

Unusual flippered feet are making their way into the Saint Lawrence River this weekend. Led by underwater explorer and filmmaker Nathalie Lasselin, volunteer divers are combing the riverbed near Beauharnois in Mont茅r茅gie to remove hundreds of tires that have been polluting the aquatic environment for decades.

A sea lion swam free after a rescue team disentangled it near Vancouver Island earlier this week.

Local Spotlight

Cole Haas is more than just an avid fan of the F.W. Johnson Wildcats football team. He's a fixture on the sidelines, a source of encouragement, and a beloved member of the team.

Getting a photograph of a rainbow? Common. Getting a photo of a lightning strike? Rare. Getting a photo of both at the same time? Extremely rare, but it happened to a Manitoba photographer this week.

An anonymous business owner paid off the mortgage for a New Brunswick not-for-profit.

They say a dog is a man鈥檚 best friend. In the case of Darren Cropper, from Bonfield, Ont., his three-year-old Siberian husky and golden retriever mix named Bear literally saved his life.

A growing group of brides and wedding photographers from across the province say they have been taken for tens of thousands of dollars by a Barrie, Ont. wedding photographer.

Paleontologists from the Royal B.C. Museum have uncovered "a trove of extraordinary fossils" high in the mountains of northern B.C., the museum announced Thursday.

The search for a missing ancient 28-year-old chocolate donkey ended with a tragic discovery Wednesday.

The Royal Canadian Mounted Police is celebrating an important milestone in the organization's history: 50 years since the first women joined the force.

It's been a whirlwind of joyful events for a northern Ontario couple who just welcomed a baby into their family and won the $70 million Lotto Max jackpot last month.