Â鶹ӰÊÓ

Skip to main content

Use of AI in social sciences could mean humans will no longer be needed in data collection: article

Share

A team of researchers from four Canadian and American universities say artificial intelligence could replace humans when it comes to collecting data for social science research.

Researchers from the University of Waterloo, University of Toronto, Yale University and the University of Pennsylvania published an article in the on June 15 about how AI, specifically large language models (LLMs), could affect their work.

"AI models can represent a vast array of human experiences and perspectives, possibly giving them a higher degree of freedom to generate diverse responses than conventional human participant methods, which can help to reduce generalizability concerns in research," Igor Grossmann, professor of psychology at Waterloo and a co-author of the article, .

Philip Tetlock, a psychology professor at UPenn and article co-author, goes so far as to say that LLMs will "revolutionize human-based forecasting" in just three years.

In their article, the authors pose the question: "How can social science research practices be adapted, even reinvented, to harness the power of foundational AI? And how can this be done while ensuring transparent and replicable research?"

The authors say the social sciences have traditionally relied on methods such as questionnaires and observational studies.

But with the ability of LLMs to pore over vast amounts of text data and generate human-like responses, the authors say this presents a "novel" opportunity for researchers to test theories about human behaviour at a faster rate and on a much larger scale.

Scientists could use LLMs to test theories in a simulated environment before applying them in the real world, the article says, or gather differing perspectives on a complex policy issue and generate potential solutions.

"It won't make sense for humans unassisted by AIs to venture probabilistic judgments in serious policy debates. I put an 90 per cent chance on that," Tetlock said. "Of course, how humans react to all of that is another matter."

One issue the authors identified, however, is that LLMs often learn to exclude sociocultural biases, raising the question of whether models are correctly reflecting the populations they study.

Dawn Parker, a University of Waterloo professor and article co-author, suggests LLMs be open source so their algorithms, and even data, can be checked, tested or modified.

"Only by maintaining transparency and replicability can we ensure that AI-assisted social science research truly contributes to our understanding of human experience," Parker said.

CTVNews.ca Top Stories

The British Columbia election campaign is set to officially start today, with Lt.-Gov. Janet Austin issuing the writ for the Oct. 19 vote.

A northern Ontario man is facing a $12,000 fine after illegally shooting a moose near the Batchawan River.

Unusual flippered feet are making their way into the Saint Lawrence River this weekend. Led by underwater explorer and filmmaker Nathalie Lasselin, volunteer divers are combing the riverbed near Beauharnois in Montérégie to remove hundreds of tires that have been polluting the aquatic environment for decades.

A sea lion swam free after a rescue team disentangled it near Vancouver Island earlier this week.

Local Spotlight

Cole Haas is more than just an avid fan of the F.W. Johnson Wildcats football team. He's a fixture on the sidelines, a source of encouragement, and a beloved member of the team.

Getting a photograph of a rainbow? Common. Getting a photo of a lightning strike? Rare. Getting a photo of both at the same time? Extremely rare, but it happened to a Manitoba photographer this week.

An anonymous business owner paid off the mortgage for a New Brunswick not-for-profit.

They say a dog is a man’s best friend. In the case of Darren Cropper, from Bonfield, Ont., his three-year-old Siberian husky and golden retriever mix named Bear literally saved his life.

A growing group of brides and wedding photographers from across the province say they have been taken for tens of thousands of dollars by a Barrie, Ont. wedding photographer.

Paleontologists from the Royal B.C. Museum have uncovered "a trove of extraordinary fossils" high in the mountains of northern B.C., the museum announced Thursday.

The search for a missing ancient 28-year-old chocolate donkey ended with a tragic discovery Wednesday.

The Royal Canadian Mounted Police is celebrating an important milestone in the organization's history: 50 years since the first women joined the force.

It's been a whirlwind of joyful events for a northern Ontario couple who just welcomed a baby into their family and won the $70 million Lotto Max jackpot last month.