Source: UNSW News

UNSW News highlights the release of a major report titled "GenAI, Fake Law and Fallout" by the UNSW Centre for the Future of the Legal Profession. The research offers a comprehensive analysis of the misuse of generative AI in legal proceedings across ten jurisdictions, documenting 520 instances between January 2023 and September 2025. The data reveals a rapidly intensifying problem, with the United States recording the highest number of cases (319), followed by Australia (87). A significant finding is that self-represented litigants account for more than 78% of the identified misuse cases, often relying on AI to generate submissions that contain fabricated authorities, errors, or omissions.

The report warns that the spread of inaccurate AI-generated material poses a systemic risk to the administration of justice, wasting court time and obscuring real legal issues. It notes that incidents tend to cluster in lower courts and tribunals where self-representation is more common. The study underscores the urgent need for better verification processes and public education regarding the limitations of AI tools in legal contexts. The findings have already been noted by the Chief Justice of New South Wales, indicating that the judiciary is actively seeking strategies to combat the "fake law" phenomenon and maintain the integrity of the court system.