麻豆影视

Skip to main content

Man or machine? Toronto company finds a way to determine how real audio clips are

Yan Fossat of Klick Labs poses for a photo in Toronto on Tuesday, May 14, 2024. Fossat and his team at Klick Labs in Toronto have found a way to determine whether audio clips are voiced by humans or artificial intelligence. THE CANADIAN PRESS/Nathan Denette Yan Fossat of Klick Labs poses for a photo in Toronto on Tuesday, May 14, 2024. Fossat and his team at Klick Labs in Toronto have found a way to determine whether audio clips are voiced by humans or artificial intelligence. THE CANADIAN PRESS/Nathan Denette
Share

Eyes may be the windows to the soul, but at Klick Labs, it's all about the voice.

The Toronto-based research arm of life sciences technology firm Klick Health has found a way to analyze voices in a manner that鈥檚 so granular, it can tell whether it's a person or an artificial intelligence-powered machine.

The capability comes as the number of deepfakes 鈥 AI-produced video, audio clips or photos that appear real 鈥 has exploded with the recent release of several AI chatbots. Everyone from pop star Taylor Swift to U.S. President Joe Biden and the Pope have fallen victim to the phenomenon.

And it鈥檚 not expected to abate any time soon. The European Union鈥檚 law enforcement agency Europol recently predicted as much as 90 per cent of online content may be synthetically generated by 2026 and the Canadian Security Intelligence Service has called the situation "a real threat to a Canadian future."

But Yan Fossat, Klick Labs鈥 senior vice-president of digital health research and development, is hopeful his company can help make the world of AI a bit safer.

"Every technology that's not regulated is dangerous and this is moving a bit faster than a lot of things," he said, while standing in Klick's downtown Toronto lab.

It was in that space 鈥 cluttered with wires, pieces of household electronics and whirring 3D printers 鈥 that Fossat and a team of three started thinking about how their favourite science fiction films could help them tackle deepfakes.

鈥淚n 'Terminator,' they use dogs to smell if the people look like humans and in 鈥楤lade Runner,鈥 there's the Voight-Kampff machine and I've always wanted to make a Voight-Kampff machine,鈥 said Fossat, referencing a fictional test used in the film to measure physiological responses, such as eye motion and reaction time, to determine whether a character was a human or replicant.

For their own project, the Klick team assembled 49 humans with diverse backgrounds and accents, whose audio they fed to a deepfake generator to make synthetic clips.

The clips were analyzed based on their vocal biomarkers 鈥 features embedded in voices that tell us something about the speaker鈥檚 health or physiology.

For example, if someone has just dashed up a flight of stairs, they breathe faster, which can be heard in their voice. Voice can also indicate when someone is just waking or feeling tired.

Klick Labs has identified 12,000 of these biomarkers, but to tell man from machine, Jaycee Kaufman, Klick's lead scientist, said it so far relies on five 鈥 the length and variation of speech, the rates of micropauses and macropauses and the overall proportion of time spent speaking versus pausing.

Micropauses are less than a half second and macropauses are more than that time, she said. They often occur naturally when someone is speaking and simply takes a breath or is grasping for words.

鈥淲e don鈥檛 really pay attention to it, but it鈥檚 happening,鈥 added Fossat.

鈥淲e have a brain and it needs to think and we have lungs and we need to breathe. Machines don't have that, so they don't do it.鈥

So far, Klick Labs鈥 method of identifying deepfakes has an 80 per cent success rate, but it might not last long.

It鈥檚 only getting harder to tell whether a clip is a deepfake or not because AI is constantly evolving and 鈥渂ecoming better and better at sounding like voices from humans,鈥 Fossat said.

鈥淔or example, OpenAI, the company who makes (generative AI chatbot) ChatGPT just came out a couple of weeks ago with a new vocal deepfake voice that is so good it breathes,鈥 he said.

鈥淚t fakes those micro breaths, which is quite amazing.鈥

He insists the development hasn鈥檛 rendered Klick Labs鈥 research useless because there are thousands of other biomarkers, like heart rate, it can test for deepfake detection.

Sixteen other studies on vocal biomarkers and diseases that Klick Labs is conducting could also aid its research.

One of those studies has used vocal biomarkers to diagnose diabetes with 89 per cent accuracy for women and 86 per cent for men.

That research will soon be continued with a study Klick is set to run with Humber River Hospital in Toronto and Fossat said it could eventually form the basis of phone-based tools anyone can use to find out how at risk they are of having the disease.

Every advance in Klick's research means more chances to learn about biomarkers and apply it back to the detection of diseases and deepfakes, which are proving hard to keep up with.

"It moves so fast every time you do something, by the time you're finished 鈥 everything has changed and we have to do it again," Fossat said.

This report by The Canadian Press was first published May 26, 2024. 

CTVNews.ca Top Stories

A body has been found in the vicinity where a woman went missing on the Ottawa River near Pembroke, Ont. while kayaking Tuesday night, according to the Ontario Provincial Police (OPP).

Unusual flippered feet are making their way into the Saint Lawrence River this weekend. Led by underwater explorer and filmmaker Nathalie Lasselin, volunteer divers are combing the riverbed near Beauharnois in Mont茅r茅gie to remove hundreds of tires that have been polluting the aquatic environment for decades.

A man is facing numerous drug trafficking charges after Dufferin OPP seized a large assortment of drugs and weapons in Orangeville earlier this week.

Local Spotlight

Cole Haas is more than just an avid fan of the F.W. Johnson Wildcats football team. He's a fixture on the sidelines, a source of encouragement, and a beloved member of the team.

Getting a photograph of a rainbow? Common. Getting a photo of a lightning strike? Rare. Getting a photo of both at the same time? Extremely rare, but it happened to a Manitoba photographer this week.

An anonymous business owner paid off the mortgage for a New Brunswick not-for-profit.

They say a dog is a man鈥檚 best friend. In the case of Darren Cropper, from Bonfield, Ont., his three-year-old Siberian husky and golden retriever mix named Bear literally saved his life.

A growing group of brides and wedding photographers from across the province say they have been taken for tens of thousands of dollars by a Barrie, Ont. wedding photographer.

Paleontologists from the Royal B.C. Museum have uncovered "a trove of extraordinary fossils" high in the mountains of northern B.C., the museum announced Thursday.

The search for a missing ancient 28-year-old chocolate donkey ended with a tragic discovery Wednesday.

The Royal Canadian Mounted Police is celebrating an important milestone in the organization's history: 50 years since the first women joined the force.

It's been a whirlwind of joyful events for a northern Ontario couple who just welcomed a baby into their family and won the $70 million Lotto Max jackpot last month.