LONDON & SAN FRANCISCO
X, the social media platform owned by Elon Musk, has imposed new restrictions on its AI chatbot Grok after mounting pressure from UK regulators and global authorities over the creation of sexually explicit and non‑consensual deepfake images. The move comes after widespread criticism and an ongoing investigation by the UK’s communications watchdog, Ofcom, into potential violations of the Online Safety Act.
According to reports, thousands of AI-generated images depicting women and in some instances minors in sexualized or revealing contexts were circulating on X, sparking public outrage. UK officials condemned the content, emphasizing that free speech does not extend to the distribution of non-consensual or abusive imagery. British Prime Minister Sir Keir Starmer called the circulation of such content “disgusting” and demanded immediate action by the platform.
In response, X announced that Grok’s image-generation and editing features would be restricted, particularly limiting the creation of sexually explicit images of real individuals. The platform has implemented technological safeguards to prevent AI from producing inappropriate content, including undressing or manipulating images into sexualized forms. These measures apply across all users, including paid subscribers, and are tailored to comply with local legal frameworks where the creation of such content is clearly illegal.
Ofcom has launched a formal probe to determine whether X failed to mitigate risks associated with Grok. The regulator is examining compliance with its statutory duties to protect users from illegal and harmful content. Potential enforcement actions include fines of up to 10 percent of global turnover and, in extreme cases, the ability to restrict platform operations within the UK.
The backlash is not limited to the UK. Other countries, including Malaysia and Indonesia, have restricted access to Grok due to similar concerns over deepfake misuse. In the United States, California authorities have also begun investigating the tool, especially regarding the creation and distribution of sexualized deepfake images involving minors.
Critics have argued that X’s initial responses such as limiting free access and providing certain features only to paying users were insufficient and risked monetizing access to potentially illegal content. Legal experts stress that platforms must proactively build safeguards into AI systems rather than reacting after harmful content emerges.
The controversy has renewed debates over AI regulation, with UK lawmakers pushing for reforms that criminalize the creation of non-consensual sexualized AI imagery. Ofcom’s investigation remains ongoing, and officials have warned that stronger measures may follow if X’s interventions fail to adequately protect users, particularly women and children, from exploitation.
As AI technology evolves faster than existing legal frameworks, the Grok case serves as a high-profile test of how governments and platforms can collaborate to address risks from artificial intelligence while balancing freedom of expression and user safety.
Discover More US Suspends Immigrant Visas for 75 Selected Nations
Discover more from VyvyDaily
Subscribe to get the latest posts sent to your email.
