Elon Musk-owned social media platform X on Wednesday announced a series of measures to prevent its artificial intelligence chatbot Grok from generating or altering images of real people in sexually suggestive ways, following intense global backlash and regulatory scrutiny. The move comes amid growing concerns over the misuse of generative AI tools to create non-consensual, sexualised content involving women and children.
In an official statement, X said it has implemented technical restrictions to stop Grok from editing images of real individuals to depict them in revealing clothing such as bikinis, underwear or similar attire. The platform added that the restrictions will apply to all users, including paid subscribers, and will be enforced based on the legal frameworks of different jurisdictions.
Measures include geoblocking and technical restrictions
According to X’s safety team, the company will “geoblock the ability” of users to create or modify images of people in bikinis or other revealing outfits in regions where such actions are illegal. The platform said the decision was taken to ensure compliance with local laws and to prevent further misuse of its AI tools.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” X’s safety team said in a statement. “This restriction applies to all users, including paid subscribers.”
The company clarified that these safeguards are designed specifically to prevent the creation of non-consensual sexual content and deepfake-style imagery that can cause serious harm to individuals.
Investigation launched in California
The announcement came just hours after California’s attorney general launched an investigation into xAI, the artificial intelligence company founded by Elon Musk that developed Grok. The probe focuses on allegations that Grok was used to generate non-consensual, sexually explicit material over the past few weeks.
Authorities in California are examining whether the platform violated state laws related to deepfakes, privacy, and the distribution of explicit content without consent. Legal experts say the investigation could have significant implications for how AI-generated content is regulated in the United States.
‘Spicy Mode’ draws international criticism
Global pressure on xAI intensified after Grok’s so-called “Spicy Mode” feature came under fire. The mode reportedly allowed users to generate sexualised images of women and children using simple text prompts such as “put her in a bikini” or “remove her clothes”.
Critics argued that the feature made it dangerously easy to create deepfake-style images, blurring the line between fictional content and real individuals. Child rights groups, women’s organisations and digital safety advocates described the feature as irresponsible and harmful, calling for immediate action from both the company and regulators.
Countries move to block or restrict Grok
Several countries have already taken action against Grok in response to the controversy. Indonesia became the first country to block access to Grok entirely on Saturday, citing concerns over sexually explicit content and the protection of minors. Neighbouring Malaysia followed suit on Sunday, restricting access to the chatbot.
India also stepped in, with the government stating on Sunday that X had removed thousands of posts and hundreds of user accounts after authorities raised concerns about inappropriate and illegal content generated or shared using Grok. Officials said further action would be taken if compliance was not sustained.
UK and Europe step up scrutiny
In the United Kingdom, media regulator Ofcom said on Monday that it had opened an investigation into whether X failed to comply with British laws related to online safety and the distribution of sexual images. The probe will assess whether the platform took adequate steps to prevent harm, particularly to children.
In France, commissioner for children Sarah El Hairy said on Tuesday that she had referred Grok-generated images to French prosecutors, the Arcom media regulator and the European Union. She said the creation of sexualised images of minors or real individuals without consent could constitute serious criminal offences under French and EU law.
Growing debate over AI accountability
The Grok controversy has reignited a broader global debate over accountability and safeguards in generative artificial intelligence. Experts warn that as AI tools become more powerful and accessible, platforms must implement strong guardrails to prevent misuse, especially when it comes to deepfakes, sexual exploitation and the erosion of personal privacy.
While X has now moved to restrict Grok’s image-editing capabilities, critics argue that the measures may have come too late and that stronger oversight is needed. Regulators across multiple countries are expected to continue examining the platform’s practices in the coming weeks.
Conclusion
X’s decision to restrict Grok from altering images of real people marks a significant step in response to mounting legal and public pressure. However, with investigations underway in the United States and Europe and outright bans imposed in parts of Asia, the episode highlights the growing challenges faced by tech companies in balancing innovation with responsibility in the age of generative AI.