• Ofcom has launched a formal investigation into X's Grok over concerns of sexualized deepfakes.
• UK Prime Minister called the generated imagery "disgusting" and "unlawful".
• If found in violation, X could face significant fines under UK law.
• The investigation underscores growing international concerns about AI-generated content.
• Grok's AI tool has faced backlash and regulatory scrutiny in multiple countries.

Britain's media regulator Ofcom has initiated a formal investigation into Elon Musk's X concerning the Grok AI chatbot, which has reportedly been used to create and share sexually explicit deepfakes. Ofcom described the reports as "deeply concerning" and indicated that the imagery could amount to "intimate image abuse or pornography" and, in some cases, child sexual abuse material, according to Reuters, South China Morning Post, and India Times.

The scrutiny follows UK Prime Minister Keir Starmer's comments labeling the generated images as "disgusting" and calling for urgent action, underscoring political pressure on tech platforms to manage harmful content effectively. He emphasized that Musk’s X needs to "get a grip" on its technology, according to Le Monde and Al Jazeera.

Under the Online Safety Act, which mandates robust safeguards against illegal content, the investigation seeks to determine if X has complied with legal obligations regarding user safety in the UK. Ofcom holds the authority to impose fines of up to 10% of X’s worldwide revenue in the event of non-compliance, according to Anadolu Agency and Anadolu Agency.

Additionally, the UK government is planning to introduce a new criminal offense targeting the creation of non-consensual intimate images, including those produced by AI technologies. Technology Secretary Liz Kendall described the content generated by Grok as "vile" and illegal, further emphasizing the urgent need for stringent regulations against such abuses, according to South China Morning Post and Le Monde.