• XAI has announced measures to prevent its Grok chatbot from generating sexualized images of real people.
• The restrictions come amid backlash and investigations from California and other jurisdictions.
• Both Indonesia and Malaysia have suspended access to Grok due to the content generated by the AI.
• Grok’s features are now limited to paid subscribers and geoblocked in countries where generating sexualized imagery is illegal.
• Despite measures, reports suggest users can still circumvent restrictions to create inappropriate content.

Elon Musk's platform XAI has announced new measures to prevent its AI chatbot Grok from generating sexualized images of real people, following significant global criticism regarding the potential misuse of the technology. The company confirmed that "we have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis," a move that applies to all users, including paid subscribers, according to Channel News Asia, Business Insider, and Los Angeles Times.

The announcement comes in response to multiple investigations, including one led by California's attorney general, who stated the need for scrutiny over sexually explicit material generated by Grok. The attorney general emphasized that there would be a determination on whether xAI violated state law with the imagery, which has been alarming due to instances where it has resulted in harassment, according to Channel News Asia and South China Morning Post.

In parallel, the European Commission has stated that it will closely review the new measures that xAI claims will safeguard citizens from the production of sexualized imagery, particularly given the uproar surrounding the non-consensual use of AI-generated deepfakes. A spokesperson for the Commission noted the importance of these changes to effectively protect citizens in the EU, according to Le Monde and India Times.

In light of these concerns, both Indonesia and Malaysia have suspended access to Grok entirely, citing the need for immediate action to prevent harmful content. This initiative represents the first wave of government interventions, with India also reporting the removal of numerous posts and accounts linked to the generation of inappropriate images on X, according to South China Morning Post and Los Angeles Times.

Despite these measures, reports indicate that Grok could still be manipulated for generating sexualized images, exemplifying ongoing challenges in implementing effective safeguards. A recent test highlighted that users can still request Grok to create inappropriate content under certain conditions, leading to concerns about the adequacy of xAI's restrictions, as noted by Business Insider.