麻豆影视

Business

    • Don't expect quick fixes in 'red-teaming' of AI models. Security was an afterthought

    Share
    BOSTON -

    White House officials concerned by AI chatbots' potential for societal harm and the Silicon Valley powerhouses rushing them to market are heavily invested in a three-day competition ending Sunday at the DefCon hacker convention in Las Vegas.

    Some 3,500 competitors have tapped on laptops seeking to expose flaws in eight leading large-language models representative of technology's next big thing. But don't expect quick results from this first-ever independent "red-teaming" of multiple models.

    Findings won't be made public until about February. And even then, fixing flaws in these digital constructs -- whose inner workings are neither wholly trustworthy nor fully fathomed even by their creators -- will take time and millions of dollars.

    Current AI models are simply too unwieldy, brittle and malleable, academic and corporate research shows. Security was an afterthought in their training as data scientists amassed breathtakingly complex collections of images and text. They are prone to racial and cultural biases, and easily manipulated.

    "It's tempting to pretend we can sprinkle some magic security dust on these systems after they are built, patch them into submission, or bolt special security apparatus on the side," said Gary McGraw, a cybsersecurity veteran and co-founder of the Berryville Institute of Machine Learning. DefCon competitors are "more likely to walk away finding new, hard problems," said Bruce Schneier, a Harvard public-interest technologist. "This is computer security 30 years ago. We're just breaking stuff left and right." Michael Sellitto of Anthropic, which provided one of the AI testing models, acknowledged in a press briefing that understanding their capabilities and safety issues "is sort of an open area of scientific inquiry."

    Conventional software uses well-defined code to issue explicit, step-by-step instructions. OpenAI's ChatGPT, Google's Bard and other language models are different. Trained largely by ingesting -- and classifying -- billions of datapoints in internet crawls, they are perpetual works-in-progress, an unsettling prospect given their transformative potential for humanity.

    After publicly releasing chatbots last fall, the generative AI industry has had to repeatedly plug security holes exposed by researchers and tinkerers.

    Tom Bonner of the AI security firm HiddenLayer, a speaker at this year's DefCon, tricked a Google system into labeling a piece of malware harmless merely by inserting a line that said "this is safe to use."

    "There are no good guardrails," he said.

    Another researcher had ChatGPT create phishing emails and a recipe to violently eliminate humanity, a violation of its ethics code.

    A team including Carnegie Mellon researchers found leading chatbots vulnerable to automated attacks that also produce harmful content. "It is possible that the very nature of deep learning models makes such threats inevitable," they wrote.

    It's not as if alarms weren't sounded.

    In its 2021 final report, the U.S. National Security Commission on Artificial Intelligence said attacks on commercial AI systems were already happening and "with rare exceptions, the idea of protecting AI systems has been an afterthought in engineering and fielding AI systems, with inadequate investment in research and development."

    Serious hacks, regularly reported just a few years ago, are now barely disclosed. Too much is at stake and, in the absence of regulation, "people can sweep things under the rug at the moment and they're doing so," said Bonner.

    Attacks trick the artificial intelligence logic in ways that may not even be clear to their creators. And chatbots are especially vulnerable because we interact with them directly in plain language. That interaction can alter them in unexpected ways.

    Researchers have found that "poisoning" a small collection of images or text in the vast sea of data used to train AI systems can wreak havoc -- and be easily overlooked.

    A study co-authored by Florian Tramer of the Swiss University ETH Zurich determined that corrupting just 0.01% of a model was enough to spoil it -- and cost as little as $60. The researchers waited for a handful of websites used in web crawls for two models to expire. Then they bought the domains and posted bad data on them.

    Hyrum Anderson and Ram Shankar Siva Kumar, who red-teamed AI while colleagues at Microsoft, call the state of AI security for text- and image-based models "pitiable" in their new book "Not with a Bug but with a Sticker." One example they cite in live presentations: The AI-powered digital assistant Alexa is hoodwinked into interpreting a Beethoven concerto clip as a command to order 100 frozen pizzas.

    Surveying more than 80 organizations, the authors found the vast majority had no response plan for a data-poisoning attack or dataset theft. The bulk of the industry "would not even know it happened," they wrote.

    Andrew W. Moore, a former Google executive and Carnegie Mellon dean, says he dealt with attacks on Google search software more than a decade ago. And between late 2017 and early 2018, spammers gamed Gmail's AI-powered detection service four times.

    The big AI players say security and safety are top priorities and made voluntary commitments to the White House last month to submit their models -- largely "black boxes' whose contents are closely held -- to outside scrutiny.

    But there is worry the companies won't do enough.

    Tramer expects search engines and social media platforms to be gamed for financial gain and disinformation by exploiting AI system weaknesses. A savvy job applicant might, for example, figure out how to convince a system they are the only correct candidate.

    Ross Anderson, a Cambridge University computer scientist, worries AI bots will erode privacy as people engage them to interact with hospitals, banks and employers and malicious actors leverage them to coax financial, employment or health data out of supposedly closed systems.

    AI language models can also pollute themselves by retraining themselves from junk data, research shows.

    Another concern is company secrets being ingested and spit out by AI systems. After a Korean business news outlet reported on such an incident at Samsung, corporations including Verizon and JPMorgan barred most employees from using ChatGPT at work.

    While the major AI players have security staff, many smaller competitors likely won't, meaning poorly secured plug-ins and digital agents could multiply. Startups are expected to launch hundreds of offerings built on licensed pre-trained models in coming months.

    Don't be surprised, researchers say, if one runs away with your address book.

    CTVNews.ca Top Stories

    Why brain aging can vary dramatically between people

    Researchers are uncovering deeper insights into how the human brain ages and what factors may be tied to healthier cognitive aging, including exercising, avoiding tobacco, speaking a second language or even playing a musical instrument.

    The union representing some 1,200 dockworkers at the Port of Montreal has overwhelmingly rejected a deal with their employers association.

    A man who was critically injured in a police-involved shooting in Hamilton late Sunday afternoon has died in hospital, says the province鈥檚 police watchdog.

    opinion

    opinion How to transition from renting to owning a home in Canada

    In his column for CTVNews.ca, personal finance contributor Christopher Liew offers a step-by-step guide on how to make the shift from renting to becoming a homeowner, and what you can start doing today to help the process go smoother.

    Canada

    World

    Politics

    • Murray Sinclair鈥檚 family members say the late justice and senator has been laid to rest according to his wishes.

    • Prime Minister Justin Trudeau announced voters in Cloverdale鈥擫angley City will pick their next member of Parliament on Dec. 16.

    Health

    Sci-Tech

    Entertainment

    Business

    Lifestyle

    Sports

    Autos

    Local Spotlight

    For the second year in a row, the 鈥楪ift-a-Family鈥 campaign is hoping to make the holidays happier for children and families in need throughout Barrie.

    Some of the most prolific photographers behind CTV Skywatch Pics of the Day use the medium for fun, therapy, and connection.

    A young family from Codroy Valley, N.L., is happy to be on land and resting with their newborn daughter, Miley, after an overwhelming, yet exciting experience at sea.

    As Connor Nijsse prepared to remove some old drywall during his garage renovation, he feared the worst.

    A group of women in Chester, N.S., has been busy on the weekends making quilts 鈥 not for themselves, but for those in need.

    A Vancouver artist whose streetside singing led to a chance encounter with one of the world's biggest musicians is encouraging aspiring performers to try their hand at busking.

    Ten-thousand hand-knit poppies were taken from the Sanctuary Arts Centre and displayed on the fence surrounding the Dartmouth Cenotaph on Monday.

    A Vancouver man is saying goodbye to his nine-to-five and embarking on a road trip from the Canadian Arctic to Antarctica.

    • Weather watchers were treated to an exceptionally rare display on Friday evening as rare cloud formations filled Vancouver skies.

    • For some shoppers it was Nov. 1, but for others the first hints of Christmas - saccharine treats, festive-fragranced candles and gaudily wrapped gift sets - were being noticed in stores long before the final Halloween decor had been cleared.

    • Thousands of people are expected to gather in downtown Vancouver on Monday to observe the city鈥檚 100th Remembrance Day ceremony.

    • Toronto is expected to see an economic boost to the tune of nearly $300 million thanks to Taylor Swift鈥檚 upcoming Eras Tour, which will be making a stop in Canada鈥檚 largest city for a six-show run later this month.

    • One man was transported to hospital early Monday morning after a stabbing in the northwest end of the city, Toronto police say.

    • A man who was critically injured in a police-involved shooting in Hamilton late Sunday afternoon has died in hospital, says the province鈥檚 police watchdog.

    • A pair of 105-mm howitzers bark constantly as they turn plywood tank targets into kindling kilometres away on the windswept landscape of one of Canada's largest military bases.

    • Two semis were among the vehicles involved in a multi-vehicle crash that brought westbound traffic along Stoney Trail Northwest to a standstill on Sunday.

    • More than 700 people danced, ate, and sang to celebrate Diwali Saturday night at the Genesis Centre in northeast Calgary.

    • NEW THIS MORNING

      NEW THIS MORNING

      An Ottawa boy with a rare disease will be getting the chance to see Taylor Swift in concert after the winner and organizers of an auction held on his behalf gifted the tickets to him.

    • CTVNewsOttawa.ca looks at Remembrance Day ceremonies in Ottawa.

    • After months of controversy surrounding a dog park in Ottawa's west end, a solution has been reached to divide the park in half.

    • An elementary school in Greenfield Park on Montreal鈥檚 South Shore is closed after it was the target of an alleged arson attack.

    • Some 12,000 daycare workers are set to begin their strike action Monday morning.

    • Two vehicles were set on fire in Montreal鈥檚 east end Riviere-des-Prairies neighbourhood.

    • Monday is Remembrance Day, a time to honour armed forces members who have died in the line of duty.

    • Boasting 2,300 square metres of skating space at its new location, Edmonton's Rollers Roller Rink believes it is the largest in Canada.

    • A woman is dead after a driver crashed a truck through a Boston Pizza in Fort McMurray late Saturday morning.

    • A pillar in Canada鈥檚 history was honoured in Winnipeg Sunday afternoon, with thousands showing up to pay tribute to the life and legacy of the late Murray Sinclair.

    • Winnipeg police have identified two men involved in a stabbing incident earlier this week.

    • The Winnipeg Blue Bombers whipped the Saskatchewan Roughriders 38-22 in Saturday's CFL West Division final to earn their fifth consecutive trip to the Grey Cup.

    • Regina author Valerie Crowther is celebrating the release of her book 鈥榃ar Letters: Linking Lives in the Second World War.鈥

    • It was a somber day at Mosaic Stadium as members of the Saskatchewan Roughriders officially cleaned out their stalls and closed the book on the 2024 season.

    • Twilight Tech Arcade, an entertainment location specializing in retro gaming, is closing its doors for the foreseeable future.

    • A man has been charged after a stabbing at an apartment building in Kitchener.

    • The Guelph Police Service is putting out a warning after two deaths in the downtown area.

    • Two new tributes to Canada鈥檚 veterans have been unveiled at the Elmira Cenotaph.

    • Saskatchewan RCMP are searching for a suspect after a man was seriously injured in a farm-related incident in Montreal Lake.

    • It was a somber day at Mosaic Stadium as members of the Saskatchewan Roughriders officially cleaned out their stalls and closed the book on the 2024 season.

    • The Regina Rams claimed the Hardy Cup after a hard fought battle against the Saskatoon Huskies 19-14 on Saturday in the first all Saskatchewan U-Sports western conference final since 2002.

    • CTVNewsNorthernOntario.ca is livestreaming the annual Remembrance Day ceremony at the Sudbury Community Arena starting Monday at 10:30 a.m.

    • Police have arrested a 15-year-old in connection with a break-in and $50,000 in damage done to the Centennial Arena in Elliot Lake in September.

    • Emergency crews responded to the scene on Road 68/Highway 2 east of Thamesford around 7 p.m.

    • On Friday, the Sarnia Police Service (SPS) received a report of an alleged abduction in the area of Kathleen Avenue and Walnut Avenue.

    • The events will start at 10:15 a.m. with a parade that forms up in front of the Delta London Armories, marches east on Dundas Street and turns north onto Waterloo Street to Dufferin Avenue, the west to the Cenotaph.

    • A group of former NHL players faced off against York Regional Police officers in Newmarket Sunday afternoon to raise funds for Special Olympics programs across the province.

    • A driver is facing multiple charges after a multi-vehicle collision on Highway 400 early Sunday morning.

    • The agreed statement of facts was read to the court on Friday in the case of Alex Williams, the 24-year-old jail guard charged last fall with smuggling cannabis and tobacco into Central North Correctional Centre in Penetanguishene.

    • One person has been arrested after Chatham-Kent Police Service (CKPS) received multiple complaints about an alleged drunk driver.

    • More details have been released about a police investigation at the Ambassador Bridge that connects Windsor, Ont. and Detroit, MI.

    • An individual is dead following a collision involving a motorcycle in Kingsville.

    • Environment Canada says heavy rain and winds could cause power outages on Vancouver Island as an "intense" storm system is set to hit the B.C. coast Sunday.

    • Six deer were struck by vehicles in six different locations in a six-hour period on B.C. highways on Saturday, according to the transportation ministry.

    • The union for locked-out port workers in British Columbia says the BC Maritime Employers Association cut off talks in less than an hour Saturday, refusing to budge on a final offer that the union has so far rejected.

    • The emergency department at South Okanagan General Hospital in Oliver, B.C., will be closed for 31 hours this weekend, the second such closure in a week and the third since the start of November.

    • Police in Kamloops, B.C., are reminding parents and guardians to check their children's Halloween candy after receiving a report of a mother finding a razor blade in one of her daughter's treats.

    • More than two years after Alannah Brown and Douglas Barker were found dead north of Penticton, police are asking for help identifying a vehicle they believe was associated with the crime.

    • The Southern Alberta Recreation Association is officially announcing the Town of Taber as next year鈥檚 host for the Southern Alberta Summer Games.

    • The Lethbridge Hurricanes broke open a close game with three goals in the first two minutes of the third period as they defeated the Warriors 7-3 in a game played Friday night in Moose Jaw.

    • There might not a lot snow just yet, but many southern Albertans are still itching to get outdoors.

    • Police have arrested a 15-year-old in connection with a break-in and $50,000 in damage done to the Centennial Arena in Elliot Lake in September.

    • Mayors of the five largest cities in northern Ontario met in North Bay the last two days to discuss a range of critical issues impacting their cities and the region.

    • Residents in the Sault expressed concerns ranging from vandalism to privacy invasions during recent consultations on the city's plan to install automated speed enforcement cameras.

    N.L.

    Shopping Trends

    The Shopping Trends team is independent of the journalists at 麻豆影视. We may earn a commission when you use our links to shop.聽Read about us.

    Stay Connected
    Follow 麻豆影视