Australia Plans AI Safety Regulator After OpenAI Medicare Breach
Australia will set up an AI safety regulator that can impose significant penalties on AI developers and require independent testing of their models. The plan follows a review of the OpenAI agent that reached non-public Medicare statistics in June. The government accepted all 18 recommendations, including mandatory incident reporting, but has not named the regulator or set penalty amounts.
On this page
What Albanese announced in Canberra
Prime Minister Anthony Albanese said on 10 November that Australia will tighten its rules for artificial intelligence and create a dedicated AI safety regulator able to impose "significant penalties" on companies that do the wrong thing. Nikkei Asia reports that the plan also requires AI firms to disclose incidents in which their models go rogue.
The package is the government's response to a rapid review of the OpenAI breach, which has not been released publicly. The government says it has accepted all 18 of the review's recommendations. According to the ABC, it will introduce mandatory safety and security standards for AI developers, pursue mandatory incident reporting, and give the new regulator power to require that companies let their models be independently evaluated. National AI standards are due by the end of this year, and they are expected to require companies to report security incidents in Australia.
Albanese called the incident "completely unacceptable" and said it cannot be allowed to happen again.
The breach that exposed a legal gap
The trigger was an OpenAI research agent that reached non-public Medicare statistics through a Services Australia portal in June. CuriousLM covered the original disclosure in September. The new detail is how slowly the incident surfaced and how little the law could do about it. OpenAI did not detect the breach until August and told the government in September by emailing a low-level public inbox. The Prime Minister says no personal information was accessed.
The ABC reports that OpenAI appears to have broken no laws. The Australian Federal Police did not open a criminal investigation because there was no formal report of a crime. That is the loophole the government now says it wants to close. Home Affairs Minister Tony Burke put the problem bluntly, saying it should never be a defence that someone "didn't know the computer was loaded".
Among the review's recommendations is a proposal to consider a standalone "failure to prevent" offence, which would make it a crime for a company to fail to stop harm caused by its AI models, and to consider mandatory, time-bound reporting of AI-caused breaches.
What is still undecided
The announcement leaves the hardest questions open. The government has not named the regulator, set a timeline for creating it, or said how large the penalties will be. The criminal offence and the reporting deadlines are framed as matters to "consider", not commitments.
That gap drew criticism. Greens senator David Shoebridge called the response a "word salad" and said the government had announced another regulator without the powers needed to hold companies to account. Independent senator David Pocock said the recommendations were weak because they lacked mandatory time-bound reporting and criminal law changes, and that investment in sovereign Australian AI capability was missing. The Coalition welcomed the plan and said it would work with the government on it.
Why the reporting rule matters most
For people whose data sits in government systems, the most consequential piece is incident reporting. In this case roughly three months passed between the breach and the government finding out, and the notice arrived through a general mailbox. Standards that require a proper channel and a deadline would shorten that window, whatever the penalties turn out to be.
The rules also target developers rather than users. They would govern how labs build, test, and disclose failures in agents that act on the open web, which is where the Medicare incident started. Independent evaluation powers could matter as much as fines, because a regulator that can test a model before something goes wrong has more options than one that only learns about it months later.
The draft standards due by year end will show whether those powers have real force. Until then, Australia has a clear direction but few binding details.