LONDON, United Kingdom
The UK’s communications regulator Ofcom has launched a formal investigation into Elon Musk’s social media platform X, following reports that its AI chatbot, Grok, has been used to generate sexually explicit deepfake content, including material involving minors. The probe underscores growing concerns about the potential misuse of generative AI and the responsibility of tech platforms to protect users.
According to Ofcom, the investigation focuses on whether X complied with its obligations under the Online Safety Act, particularly in preventing the spread of harmful and illegal content. Authorities said they reached out to X in early January, demanding information on the measures the platform has taken to mitigate risks associated with Grok’s image generation and editing functions.
The concerns stem from reports that Grok allowed users to create or manipulate images into sexualized forms, including depictions of real people without consent and potentially illegal child sexual abuse material (CSAM). Ofcom described the allegations as “deeply concerning” and emphasized that safeguarding minors is a central aspect of the Online Safety Act.
In response to the backlash, X limited Grok’s image editing features to paying subscribers, a move intended to restrict access to the tool. However, British officials and advocacy groups have criticized this approach as insufficient, arguing that hiding potentially harmful features behind a paywall does not adequately prevent misuse.
Prime Minister Keir Starmer condemned the reported content as “disgusting” and unlawful, reinforcing government support for Ofcom’s investigation. The Online Safety Act gives regulators broad powers, including fines of up to 10% of a company’s global revenue and the authority to order internet service providers to block access to non-compliant platforms.
The controversy is not limited to the UK. Malaysia and Indonesia have already blocked access to Grok, citing concerns over sexually explicit deepfakes and insufficient safety controls. Other governments, including those in France, India, and within the European Commission, have also expressed alarm and initiated preliminary inquiries into the platform.
Experts say the situation highlights a broader challenge facing AI and social media companies. While Grok’s capabilities allow creative and analytical applications, they also enable the rapid production of harmful content. Critics argue that X’s safeguards, including content moderation and user enforcement policies, have been ineffective at preventing abuse.
X has maintained that it actively removes illegal material, suspends offending accounts, and cooperates with law enforcement. Elon Musk has publicly warned users that prompting the AI to generate illegal content could carry consequences similar to uploading such material themselves. Nonetheless, regulators maintain that proactive prevention, not just reactive enforcement, is essential.
Ofcom’s investigation will examine whether X conducted sufficient risk assessments before releasing Grok’s image capabilities, whether appropriate age verification measures were in place, and whether the platform responded adequately once harmful content was reported. The regulator called the matter an urgent priority given the potential harm to vulnerable users.
The outcome of the probe could have far-reaching consequences for AI regulation, platform accountability, and online safety policies. Ofcom’s findings may result in significant fines, mandatory compliance measures, or even restrictions on access to X services in the UK, signaling increased government oversight in the era of generative AI.
This case marks one of the highest-profile regulatory challenges facing AI-driven platforms to date, with officials closely monitoring developments as evidence and responses from X are evaluated.
Discover More Manchester Ranked 3rd Most Stressful Airport Globally
Discover more from VyvyDaily
Subscribe to get the latest posts sent to your email.
