Elon Musk-owned social media platform X is facing the prospect of severe regulatory action in the United Kingdom, including a possible ban, following allegations that its artificial intelligence chatbot Grok was used to generate sexually explicit images of women and children. The development has triggered a political and regulatory storm, with Prime Minister Keir Starmer reportedly instructing authorities to keep “all options on the table” under the UK’s Online Safety Act.
According to a report by The Telegraph, the controversy erupted after it emerged that Grok, X’s AI chatbot, was allegedly used to create images depicting women and children in undressed or sexualised poses. Some of these images, the report said, were shared on dark web forums and could constitute illegal child sexual abuse material under UK law.
UK government signals tough action
The Prime Minister’s office has reportedly taken a strong stance on the issue. Sources cited by The Telegraph said Keir Starmer has asked the Office of Communications (Ofcom), the UK’s media and technology regulator, to examine every possible enforcement measure available under existing legislation.
“X has got to get a grip of this and get this material down – and we will take action on this because it’s simply not tolerable,” Starmer was quoted as saying. He later reiterated his position in an interview with Greatest Hits Radio, stating, “This is wrong. It’s unlawful. We’re not going to tolerate it. I’ve asked for all options to be on the table.”
The warning is significant because the Online Safety Act grants Ofcom wide-ranging powers, including the authority to impose fines running into billions of pounds or, in extreme cases, to block access to platforms that repeatedly fail to remove illegal content. X is estimated to have around 650 million users globally, with approximately 2 crore users in the UK.
Ofcom’s role and legal powers
Ofcom confirmed this week that it had identified images generated using Grok that may breach UK law. The regulator said it had made “urgent contact” with X after discovering that some of the content could amount to child sexual abuse material, one of the most serious categories of illegal online content.
Under the Online Safety Act, Ofcom can initiate a formal investigation if it believes a platform is failing to meet its duty of care obligations. This process typically involves an assessment, a provisional ruling, and an opportunity for the company to respond and take corrective action. If a platform refuses to comply, Ofcom can seek a court order to block access to the service in the UK by directing internet service providers or app stores to restrict it.
While Ofcom has never yet exercised its power to block a major social media platform, officials have indicated that persistent non-compliance could force the regulator to consider such steps.
Allegations involving Grok AI
The controversy centres on Grok, X’s AI chatbot, which is designed to generate text and images in response to user prompts. According to The Telegraph, thousands of images were created using the tool, depicting women and children undressed or in sexualised scenarios, including bikinis and provocative poses.
On Wednesday, a UK internet watchdog reportedly warned that some of the images found on dark web forums would be illegal to possess or distribute under British law. It is understood that the Prime Minister’s office has raised these concerns directly with X, demanding swift action to remove the content and prevent further misuse of the AI tool.
Musk’s criticism of UK law
Elon Musk has previously criticised Britain’s Online Safety Act, arguing that it amounts to censorship. According to The Telegraph, Musk has claimed that the law’s real purpose is the “suppression of the people,” a position that puts him at odds with UK authorities who argue that the legislation is essential to protect children and vulnerable users online.
The current row highlights the growing tension between governments and technology companies over the regulation of artificial intelligence. While AI tools like Grok offer innovative capabilities, critics argue that inadequate safeguards can enable serious harm, particularly when it comes to deepfake-style imagery and the exploitation of minors.
What happens next
Ofcom has indicated that it is assessing whether to open a formal investigation into X over the alleged failures related to Grok. Such an investigation would examine whether the platform has appropriate systems in place to prevent the generation and spread of illegal content and whether it has responded adequately once concerns were raised.
If X is found to be in breach of the Online Safety Act and fails to take corrective measures, the regulator could escalate enforcement, potentially leading to substantial fines or legal action to restrict access to the platform within the UK.
Conclusion
The unfolding situation places X at a critical juncture in the UK, as authorities weigh the balance between freedom of expression, technological innovation and the protection of vulnerable users. While a nationwide ban remains a last resort, the strong language from Prime Minister Keir Starmer and the involvement of Ofcom underline the seriousness with which the UK government is treating the alleged misuse of AI-generated content. The coming weeks are likely to determine whether X can satisfy regulators or face unprecedented action under Britain’s online safety regime.