Deloitte Australia has announced plans to partially refund 440,000 Australian dollars (approximately $290,000) to the Australian government for a report marred by numerous errors possibly linked to AI miscommunication. The report was provided to the Department of Employment and Workplace Relations and initially published in July.
Deloitte’s Report Errors
The report was scrutinized after Chris Rudge, a health and welfare law researcher at Sydney University, revealed that it contained significant inaccuracies, including:
- A fabricated quote from a federal court judgment.
- References to non-existent academic research papers.
Review and Findings
Upon review, the department confirmed that Deloitte acknowledged the presence of incorrect footnotes and references within the 237-page document. The revised version, released recently, removed the inaccurate quotes and disclosures about the use of Azure OpenAI, a generative AI language tool.
Despite removing these inaccuracies, officials stated that the overall substance and recommendations of the report remained unchanged.
Concerns Raised by Academics
Rudge discovered up to 20 errors in the report’s initial release. One significant mistake involved misattributing a book to Lisa Burton Crawford, a Sydney University professor, which raised doubts about the report’s credibility.
Rudge emphasized that misquoting a judge represented a more substantial concern than academic inaccuracies. He expressed the urgency of standing up for due diligence in cases that impact government decision-making.
Political Reactions
Senator Barbara Pocock from the Australian Greens has criticized Deloitte, stating the firm should refund the entire $290,000 fee. She condemned the misuse of AI, pointing out that such missteps would be unacceptable for a university student.
This incident highlights the potential risks associated with AI-generated content and raises questions about accountability in professional reports relied upon by the government.
