Sam Altman-led OpenAI had identified and banned an account linked to Canadian transgender teenager Jesse Van Rootselaar months before one of Canada’s deadliest school shootings, but did not alert law enforcement at the time, according to company statements.The artificial intelligence firm said its internal monitoring systems detected the ChatGPT account in June last year for violating policies related to violent content. The account was subsequently banned after being flagged for misuse involving troubling violent scenarios involving gun violence.
Van Rootselaar, an 18-year-old high school dropout, allegedly went on to kill eight people and injure about 25 others in a shooting in the western Canadian town of Tumbler Ridge earlier this month, before taking her own life, authorities said.
What OpenAI said?
“Our thoughts are with everyone affected by the Tumbler Ridge tragedy,” an OpenAI spokesperson was quoted as saying by news agency AP, adding that the company later contacted Canadian authorities and is cooperating with investigators.OpenAI said it had considered referring the account to law enforcement when it was first flagged, but did not find evidence of credible or imminent real-world harm at the time. After the shooting, however, the company proactively shared information with the Royal Canadian Mounted Police to support the investigation. OpenAI’s systems are designed to detect potential misuse of its AI tools and take enforcement action, including banning accounts that violate safety policies. “The company identified the account using tools designed to detect misuse of its AI models, including possible furthering of violent activities,” according to details quoted by news agency AP.Authorities in Canada confirmed they are examining the suspect’s online and social media activity as part of the ongoing probe.The incident has raised broader questions about the responsibility of technology companies to report concerning user activity and the challenges of assessing threats based on online behaviour. OpenAI said it continues to strengthen safeguards to prevent misuse of its artificial intelligence systems.
