Social media platform X, formerly known as Twitter, has blocked around 3,500 posts and taken down nearly 600 accounts following strong action by the Indian government over the circulation of obscene and explicit content on the platform, government sources confirmed. The move comes after the Ministry of Electronics and Information Technology (MeitY) issued a formal notice to X Corp, warning against the misuse of artificial intelligence tools such as Grok to generate and spread objectionable material.
The Centre’s intervention highlights growing concerns over the misuse of AI-generated content on social media platforms and reinforces India’s stance on enforcing strict compliance with its digital and IT laws.
Government Flags Obscene Content on X
According to officials, MeitY observed multiple instances where users misused Grok, the AI assistant developed by Elon Musk’s xAI, to create and circulate obscene images and videos. Much of the flagged content reportedly involved the derogatory and indecent depiction of women, raising serious legal and ethical concerns.
The ministry issued a notice to X last week, directing the platform to take immediate action to stop the hosting, generation, and dissemination of obscene, indecent, and sexually explicit content. X was also asked to submit an “action taken report” within 72 hours, detailing the steps it had taken to comply with Indian regulations.
Following the notice, X blocked thousands of posts and removed hundreds of accounts found violating content guidelines.
X Assures Compliance With Indian Laws
Government sources said that X has assured authorities of its commitment to comply with Indian laws and strengthen safeguards to prevent the recurrence of such content. The platform reportedly acknowledged the seriousness of the issue and pledged cooperation with regulators.
The company’s response comes amid increased scrutiny of global tech firms operating in India, particularly over content moderation, user safety, and the misuse of emerging AI technologies.
MeitY Orders Review of Grok’s Design and Safeguards
In its communication, MeitY directed X to conduct a comprehensive review of Grok’s technical design, governance framework, and moderation mechanisms. The ministry stressed that AI tools integrated into social media platforms must strictly enforce user policies and ensure that prohibited content is neither generated nor amplified.
The notice also instructed X to suspend or terminate accounts found repeatedly violating platform rules, especially those involved in generating or circulating explicit content using AI prompts, image manipulation, or synthetic media.
Officials clarified that the issue extends beyond fake or anonymous accounts. Even users uploading their own images or videos and manipulating them using AI tools fall under the scope of violations if the content targets women in a derogatory or obscene manner.
Warning Over Safe Harbour Protection
MeitY warned that continued non-compliance could result in the withdrawal of “safe harbour” protection under Section 79 of the Information Technology Act. Safe harbour provisions protect digital platforms from liability for user-generated content, provided they follow due diligence and act promptly on government orders.
Loss of this protection could expose X and its officials to criminal liability and legal action under multiple Indian laws.
Possible Legal Action Under Multiple Laws
The ministry cautioned that violations related to obscene and indecent content could invite penal action under several statutes, including:
The Bharatiya Nyaya Sanhita (BNS)
The Indecent Representation of Women (Prohibition) Act
The Protection of Children from Sexual Offences (POCSO) Act
The Information Technology Act, 2000
Officials emphasized that misuse of AI technologies to create explicit content represents a serious offence, particularly when it involves women or minors.
AI Misuse Raises Broader Concerns
The action against X underscores the growing challenge governments face in regulating AI-generated content. Tools like Grok, while designed to enhance user interaction, can be misused to create harmful, misleading, or illegal material if robust safeguards are not in place.
MeitY noted that such incidents reflect “serious lapses in platform-level checks” and warned against the unchecked deployment of artificial intelligence systems without adequate governance and accountability.
India has repeatedly stressed that technology platforms must balance innovation with responsibility, especially as AI tools become more powerful and accessible.
India’s Tough Stance on Digital Regulation
Over the past few years, India has taken a firm approach toward regulating digital platforms to ensure user safety and legal compliance. The government has issued multiple advisories and notices to social media companies, asking them to act against misinformation, deepfakes, and explicit content.
The latest action against X aligns with India’s broader efforts to create a safer digital ecosystem and prevent the misuse of technology to harass or demean individuals.
What Lies Ahead for X
While X has taken immediate corrective steps, authorities are expected to closely monitor the platform’s compliance in the coming weeks. Any further violations could lead to stricter enforcement measures, including financial penalties or additional legal proceedings.
The episode also serves as a warning to other social media and AI-driven platforms operating in India to strengthen their content moderation systems and ensure adherence to local laws.
