The online network X has provoked major outrage after individuals used its AI chatbot Grok to manipulate photos of women by stripping their clothing.
Numerous examples have surfaced where the tool has been used to virtually strip women to render them in bikinis without permission, as well as to insert them in inappropriate situations.
Developer Response and Legal Stance
XAI, the company behind Grok, did not respond to requests for comment, other than an auto-reply response stating "legacy media lies".
A Home Office representative stated that legislation is being brought forward to prohibit nudification software. Under a proposed law, anyone who provided such tools would "face a jail term and significant penalties".
"The platform could prevent these forms of misuse if they chose to," said a law professor, adding they "operate with a lack of consequences."
Regulator Position and Platform Capabilities
The communications watchdog Ofcom said platforms must "evaluate the danger" of people seeing illegal content on their platforms, but did not specify whether it was at this time investigating X or Grok in concerning artificial intelligence images.
Grok is a free AI assistant—with some premium functions—which answers X users' queries when they mention it in a message.
It is frequently used to give reactions or additional background to other posters' comments, but people on X are also able to alter an uploaded picture through its AI image editing feature.
Background of Controversy and Policy
The tool has been criticised for enabling users to produce pictures and videos with nudity and sexually suggestive content, and it was in the past accused of creating sexually explicit content of public figures.
"X has been allowing the production and sharing of these pictures for months without taking any action and we have yet to see any action by regulators," the expert added.
XAI's own usage rules prohibits "showing likenesses of persons in a pornographic way".
In a statement, Ofcom said it was unlawful to "generate or circulate private pictures or illegal content" and clarified this included explicit AI images made with AI.
It said services such as X were required to take "necessary actions" to "reduce the danger" of users viewing unlawful content on their platforms and to remove it quickly when they learn of it.
