X has limited Grok image generation and editing to paying subscribers on its platform, after backlash over the AI tool being used to create sexualised “undressed” images, including of children.
In the UK, Prime Minister Keir Starmer said “all options” are on the table as regulators press X and its xAI unit for answers about whether the platform is meeting legal duties under the Online Safety Act and data protection rules.
The change on X comes after users were able to tag the Grok account and request images, and that access helped fuel a trend where people uploaded photos of clothed individuals and prompted the bot to remove clothing or create sexualised poses.
The Independent reported that the Grok account is now replying to some image requests with a message saying “Image generation and editing are currently limited to paying subscribers,” along with a link to sign up for X’s premium tier.
Grok image tool moved behind a paywall
The Register said Grok “yanked” its image-generation feature from most users after the UK government publicly weighed action over the “undressing” capability.
The Register also reported that previously, anyone could access the system by tagging it in a post and asking for a picture.
X did not respond to questions from The Register about the issue, according to the publication.
UK regulators contact X and xAI
Ofcom, the UK communications regulator responsible for enforcing the Online Safety Act, said it made “urgent contact” with X and xAI to understand what steps they have taken to comply with legal duties to protect UK users.
Ofcom said it would carry out a “swift assessment” to determine whether there are potential compliance issues that warrant an investigation, depending on the response it receives.
The Information Commissioner’s Office (ICO) also said it contacted X and xAI to seek clarity on measures to comply with UK data protection law and protect individuals’ rights, and will assess whether further action is needed after reviewing the response.
Starmer: “All options” on the table
Starmer said the images created using Grok were “unlawful” and that the government would not tolerate them, according to The Independent.
He told Greatest Hits Radio: “It’s unlawful. We’re not going to tolerate it. I’ve asked for all options to be on the table. It’s disgusting. X need to get their act together and get this material down.”
The Independent also quoted Starmer adding: “We will take action on this because it’s simply not tolerable.”
NDTV, citing a Telegraph report, said Starmer asked Ofcom for “all options to be on the table” after it was found that child sexual abuse images had been generated using Grok.
NDTV reported the Telegraph cited Downing Street sources pointing to Online Safety Act powers that include major fines or blocking access to X in Britain, and it stated X has around 650 million users worldwide, including 20 million in the UK.
NDTV also reported that Ofcom warned it could launch an investigation and said it had made “urgent contact” with X.
Claims of child sexual abuse imagery
The Independent reported the Internet Watch Foundation (IWF) confirmed the tool had been used to create “criminal imagery of children aged between 11 and 13”.
The Register reported the IWF said its analysts had witnessed Grok generating child abuse images.
The Register also reported IWF hotline head Ngaire Alexander told Sky News that imagery IWF saw was on a dark web forum where users claimed they used Grok to generate sexualised images, rather than being directly hosted on Grok or X.
What the Online Safety Act could mean for X
The Independent said the Online Safety Act includes powers that, in extreme cases and with court agreement, allow Ofcom to require payment providers, advertisers, and internet service providers to stop working with a site—effectively banning it in the UK.
NDTV, citing the Telegraph, said Ofcom can apply for a court order requiring internet companies or app stores to block offending sites and apps, though it noted the power has not been used so far.
The Register said Online Safety Act violations can lead to fines of up to £18 million or 10 percent of an organization’s qualifying worldwide revenue, whichever is higher.
The Register also cited a lawyer from Simmons & Simmons saying the Online Safety Act explicitly designates sharing intimate images without consent, including AI-generated deepfakes, as a “priority offence,” which requires proactive steps to prevent such content and swift removal when detected.
Separately, The Register reported that the ICO is looking into whether data protection laws were breached, particularly where images of real people were altered without their consent.
