Australia's Teen Social Media Ban Report Used ChatGPT for Editing, Authors Admit

Key points

• A $3.48 million age-verification trial, funded to test technology for Australia's under-16 social media ban, contains citations to academic articles that cannot be found.
• The authors of the report have confirmed they used ChatGPT, an AI chatbot, during the editing process.
• The UK-based Age Check Certification Scheme ran the trial and authored the report.
• Authors deny the missing references are AI hallucinations, the term for when an AI confidently invents facts or sources that do not exist.
• The errors were raised at the Australian Senate.

Australia is pushing ahead with one of the world's strictest social media laws, banning children under 16 from platforms such as Instagram and TikTok. Central to that effort is proving that age-checking technology actually works. So a $3.48 million trial was commissioned to do exactly that.

The problem: the report from that trial appears to cite academic articles that do not exist.

What did the Guardian find?

Analysis by the Guardian found that one section of the report includes references to academic papers that cannot be located. Broken or invented citations matter because policymakers and senators use this research to make real decisions about laws affecting millions of Australian teenagers.

The report was produced by the Age Check Certification Scheme (ACCS), a UK-based organisation that certifies age-verification products. The ACCS ran the trial last year, testing a range of technologies that social media companies could use to verify a user's age under the proposed ban.

Did AI write the dodgy references?

The authors say no, but they have confirmed that ChatGPT was used during editing. That admission matters because AI hallucination, where a chatbot invents plausible-sounding but completely fictional sources, is a well-documented problem with tools like ChatGPT.

Picture asking a very confident assistant to tidy up your bibliography, and that assistant quietly filling gaps with references it made up on the spot. The references look real. They are not.

The ACCS authors deny that is what happened here, but they have not yet provided a clear explanation for why the cited articles cannot be found.

What does this mean for the ban itself?

The social media ban is already law in Australia. The age-assurance trial was meant to help work out how to enforce it, testing which technologies are reliable enough to actually check a child's age at the point of sign-up.

If the research underpinning those technology recommendations contains invented sources, the quality of those recommendations is genuinely in question. Australian senators raised the issue during hearings, suggesting this will not quietly go away.

For parents and teenagers, nothing changes immediately. But the credibility of the evidence base for how the ban gets enforced is now under scrutiny.

What should you take from this?

This is a useful reminder that AI editing tools can introduce errors that look polished and authoritative. Whether you are a student, a small business owner, or a policy researcher, if you use ChatGPT to help write or edit anything containing references, check every single citation yourself before it goes out the door. AI cannot reliably be trusted to keep your sources accurate.

Common questions

What is an AI hallucination?

An AI hallucination is when a chatbot like ChatGPT generates information that sounds credible but is simply made up, including fake quotes, statistics, or references to books and papers that do not exist.

Is ChatGPT free to use?

ChatGPT has a free tier that gives access to its standard model. A paid plan called ChatGPT Plus costs around $20 per month and unlocks faster and more capable versions.

Should I worry about AI errors in government reports?

It is worth knowing they are possible. Reports that inform laws or public policy should always have citations checked by a human expert before publication, regardless of what tools were used to draft them.