Indonesia takes the lead in banning Grok, AI-generated pornographic images raise global governance warnings

Elon Musk’s AI chatbot Grok has recently come under international scrutiny due to issues related to pornographic images. Indonesia’s Ministry of Communication and Information Technology made a significant decision in early January—temporarily taking this tool offline, becoming the first country in the world to explicitly ban such AI applications. Behind this move is a deep concern over the misuse risks of emerging artificial intelligence technologies.

The Emergence of AI Tool Abuse Risks

As an emerging AI chatbot, Grok has attracted attention for its strong generative capabilities and natural interactions, but it also exposes regulatory gaps. Users can generate harmful content, including pornographic images, using this tool, which has raised alarms among governments and regulators in Europe, Asia, and other regions. The misuse of non-consensual deepfake technology has become a major challenge facing digital security today.

Indonesia’s “Zero Tolerance” Policy and International Benchmark

Indonesian Minister of Communication and Information Technology Mutiya Hafid stated in an official release that the government will not allow any technology to be used to generate harmful content such as pornographic images, as this severely infringes on individual rights, citizen dignity, and the security and environmental safety of the digital space. To thoroughly address the issue, the department subsequently summoned executives from X Corporation for in-depth discussions on how to improve product safety mechanisms.

Accelerating Global AI Regulation

This incident reflects a growing consensus among countries worldwide on AI governance—that uncontrolled development of new technologies cannot be tolerated. From the EU’s AI Act to individual national actions, restricting the generation of pornographic content has become a priority in AI regulation. Indonesia’s proactive move sets a benchmark for other countries and indicates that international regulatory frameworks for AI tool misuse may tighten further. Enterprises and governments need to find a balance between protecting innovation and preventing risks to ensure that artificial intelligence truly benefits society.