Â鶹ӰÊÓ

Skip to main content

New York City defends AI chatbot that advised entrepreneurs to break laws

New York City Mayor Eric Adams speaks during a news conference at City Hall in New York. (Eduardo Munoz Alvarez/AP Photo) New York City Mayor Eric Adams speaks during a news conference at City Hall in New York. (Eduardo Munoz Alvarez/AP Photo)
Share
NEW YORK -

New York City Mayor Eric Adams is defending the city's new artificial intelligence chatbot that has been caught in recent days giving business owners wrong answers or advice that, if followed, would entail breaking the law.

When launched as a pilot in October, the MyCity chatbot was touted as the first city-wide use of such AI technology, something that would give business owners "actionable and trusted information" in response to queries typed into an online portal.

That has not always proved the case: journalists at the investigative outlet The Markup first reported last week that the chatbot was getting things wrong. It wrongly advised that employers could take a cut of their workers' tips, and that there were no regulations requiring bosses give notice of employees' schedule changes.

"It's wrong in some areas, and we've got to fix it," Adams, a Democrat, told reporters on Tuesday, emphasizing that it was a pilot program. "Any time you use technology, you need to put it into the real environment to iron out the kinks."

Adams has been an ardent advocate for deploying untested technology in the city with an optimism that is not always vindicated. He put a 400-pound vaguely ovoid robot in the Times Square subway station last year that he hoped would help police deter crime; it was retired about five months later, with commuters noting that it never appeared to be doing anything, and that it could not use stairs.

The chatbot remained online on Thursday and was still sometimes giving wrong answers. It said store owners were free to go cashless, apparently oblivious to the city council's 2020 law banning stores from refusing to accept cash. It still thinks the city's minimum wage is US$15 per hour, though it was raised to $16 as of 2024.

The chatbot, which relies on Microsoft's Azure AI service, appears to be led astray by problems common to so-called generative AI technology platforms such as ChatGPT, which are known to sometimes make things up or assert falsehoods with HAL-like confidence.

Microsoft declined to say what might be causing the problems, but said in a statement it was working with the city to fix them. The city's Office of Technology and Innovation said in a statement that "as soon as next week, we expect to significantly mitigate inaccurate answers."

Neither Microsoft nor City Hall responded to questions about what was causing the errors and how they might be fixed.

The city has updated disclaimers on the MyCity chatbot website, noting that "its responses may sometimes be inaccurate or incomplete" and telling businesses to "not use its responses as legal or professional advice."

Andrew Rigie, who advocates for thousands of restaurant-owners as the director of the NYC Hospitality Alliance, said he had heard from business owners perplexed by the chatbot's responses.

"I commend the city for trying to use AI to help businesses, but it needs to work," he said, warning that following some of the chatbot's guidance could bring serious legal consequences. "If when I ask a question and then I have to go back to my lawyers to know whether or not the answer is correct, it defeats the purpose."

CTVNews.ca Top Stories

The British Columbia election campaign is set to officially start today, with Lt.-Gov. Janet Austin issuing the writ for the Oct. 19 vote.

Local Spotlight

Cole Haas is more than just an avid fan of the F.W. Johnson Wildcats football team. He's a fixture on the sidelines, a source of encouragement, and a beloved member of the team.

Getting a photograph of a rainbow? Common. Getting a photo of a lightning strike? Rare. Getting a photo of both at the same time? Extremely rare, but it happened to a Manitoba photographer this week.

An anonymous business owner paid off the mortgage for a New Brunswick not-for-profit.

They say a dog is a man’s best friend. In the case of Darren Cropper, from Bonfield, Ont., his three-year-old Siberian husky and golden retriever mix named Bear literally saved his life.

A growing group of brides and wedding photographers from across the province say they have been taken for tens of thousands of dollars by a Barrie, Ont. wedding photographer.

Paleontologists from the Royal B.C. Museum have uncovered "a trove of extraordinary fossils" high in the mountains of northern B.C., the museum announced Thursday.

The search for a missing ancient 28-year-old chocolate donkey ended with a tragic discovery Wednesday.

The Royal Canadian Mounted Police is celebrating an important milestone in the organization's history: 50 years since the first women joined the force.

It's been a whirlwind of joyful events for a northern Ontario couple who just welcomed a baby into their family and won the $70 million Lotto Max jackpot last month.