Source: Politico EU

Politico EU reports that Ofcom, the UK's communications regulator, has formally contacted Elon Musk’s social media platform, X, regarding the spread of AI-generated sexualized images of children. This investigation highlights the growing concern among European regulators about the ease with which generative AI tools can be used to create harmful and illegal content. Ofcom’s intervention is part of a broader push to enforce the Online Safety Act, which requires platforms to implement robust systems for detecting and removing such material. Failure to comply could result in massive fines and significant damage to the platform's reputation.

The report emphasizes the complexity of moderating AI-generated content, which often bypasses traditional image-recognition filters. European regulators are calling for greater transparency from tech companies about their moderation algorithms and the steps they are taking to safeguard vulnerable users, particularly children. This case is being closely watched as a major test of the ability of national and regional authorities to hold global social media giants accountable for the outputs of their AI systems. It underscores the urgent need for international cooperation to develop effective legal and technical standards for protecting individuals from the harms of synthetic media.