Grok’s sexual deepfakes almost got it banned from Apple’s App Store. Almost.

Apple threatened to remove Elon Musk's Grok AI chatbot from its App Store in January due to the proliferation of nonconsensual sexual deepfakes being created and shared on X, according to NBC News. The ultimatum was delivered privately, representing a rare enforcement action by Apple against one of the world's most prominent tech figures. The threat highlighted growing concerns about AI tools enabling the creation of explicit synthetic media without consent.

Grok's developers responded to Apple's pressure by implementing new safeguards designed to prevent the generation of sexual deepfakes. These measures appear to have satisfied Apple's requirements, as the app remained available on the App Store following the negotiations. The incident underscores the tension between AI innovation and content moderation, with Apple leveraging its control over app distribution to enforce stricter standards.

The situation illustrates both the power and limitations of app store gatekeeping in addressing AI-related harms. While Apple's intervention prevented the tool from being completely removed, critics argue that behind-the-scenes negotiations lack transparency and may not fully address the underlying problem. The case also raises questions about whether platform-specific restrictions can effectively contain deepfake proliferation across multiple services and technologies.