xAI has swiftly deactivated the media generation capability in its Grok chatbot following widespread condemnation over users generating non-consensual explicit deepfake images of women and minors, with India at the epicenter of the uproar. Social media erupted as individuals tagged Grok to transform uploaded photos into sexually provocative depictions, flouting the platform’s strict content moderation rules.
The controversy escalated rapidly when Indian professionals and legal authorities called for official intervention. They branded the exploitation as “the worst use case of AI being abused by bad actors,” and labeled it “AI-enabled sexual violence.” Experts pointed out that India’s Information Technology Act and Bharatiya Nyaya Sanhita offer legal remedies, though implementation lags considerably.
Grok responded promptly, announcing it “quickly disabled the media tab” and is enhancing user safeguards and consent protocols. Digital rights specialists caution that vulnerabilities persist, allowing image manipulation via alternative routes. Detractors highlight Grok’s relatively permissive protections, notably its “spicy mode” image feature launched in mid-2025, as factors heightening susceptibility to misconduct.
This episode has fueled renewed discussions on AI oversight and corporate responsibility in technology deployment. In the interim, recommendations urge X users to tweak privacy options under “Grok and Third-Party Collaborators” to curb data sharing pending robust security upgrades.
