Malaysia and Indonesia have temporarily blocked access to Elon Musk’s AI chatbot Grok after authorities raised concerns over its misuse in generating sexually explicit and non-consensual images, including those involving minors. The move marks the first global action against the tool, highlighting growing concerns over AI-generated deepfakes and insufficient content safeguards.
Regulatory Concerns. Indonesian authorities called non-consensual sexual deepfakes “digital-based violence” and a violation of human rights. Meutya Hafid, Indonesia’s Minister of Communications and Digital Affairs, said the government acted to protect women, children, and the broader community from fake pornographic content. In Malaysia, the Communications and Multimedia Commission criticized X Corp and xAI for relying mainly on user reporting mechanisms instead of implementing robust safeguards, calling the restriction a “preventive and proportionate measure” until effective protections are in place.
Grok Features and Alledged Misuse. Launched in 2023 on Musk’s social media platform X, Grok allows users to ask questions and generate images from text prompts via its Grok Imagine feature. A recent update made it easier to create and share images, including sexually explicit content in “spicy mode.” These updates triggered widespread misuse, including manipulated images of real people, sparking public outrage and regulatory intervention.
Global Scrutiny & Respons. The actions in Southeast Asia come amid growing concern worldwide. Authorities in the UK, EU, India, and Brazil have launched probes into Grok’s potential role in facilitating obscene deepfakes. UK Technology Secretary Liz Kendall said regulators could block Grok for failing online safety laws, stating: “If Ofcom decides to block the service, we will give full support.”
In response to the controversy, xAI restricted image generation and editing features to paying users. Elon Musk emphasized that users creating illegal content would face consequences equivalent to posting it directly on X. Authorities in Malaysia and Indonesia stressed that access will remain blocked until stronger safeguards are implemented to prevent harm, particularly to women and children.
The Southeast Asian restrictions underscore the broader global debate over generative AI, highlighting the tension between innovation and digital safety. As regulators worldwide examine Grok and similar tools, companies developing AI face mounting pressure to implement effective protections and prevent misuse.