San Francisco Demands Apple and Google Delete AI ‘Nudify’ Apps From App Stores

San Francisco's City Attorney's Office has escalated enforcement efforts against artificial intelligence applications designed to generate non-consensual intimate imagery. This week, the city sent cease-and-desist letters to Apple and Google, demanding they remove 13 "face-swap" applications from their respective app stores. These tools, collectively known as "nudify" apps, leverage AI technology to create fake explicit images by superimposing users' faces onto nude bodies, predominantly targeting women and girls without consent.

The cease-and-desist action represents a significant regulatory response to a growing digital exploitation problem. San Francisco's legal action holds major tech platforms accountable for distributing applications that facilitate image-based sexual abuse. The City Attorney's Office argues that both Apple and Google profit from these applications through commission-based revenue models, making them complicit in the proliferation of non-consensual intimate imagery.

The enforcement action underscores increasing pressure on technology companies to police harmful content on their platforms, particularly applications that abuse AI capabilities to create deepfakes and synthetic pornography.

• Tech platforms face heightened legal liability for distributing apps that enable sexual harassment and exploitation
• Regulators are expanding oversight of AI applications beyond content moderation to include app curation and distribution
• App stores may implement stricter vetting procedures for AI-powered tools, particularly those with face or body manipulation capabilities
• Companies distributing such apps could face significant financial penalties and reputational damage
• International jurisdictions will likely follow San Francisco's precedent with similar regulatory measures

This enforcement action signals a critical turning point in how major technology platforms will be held responsible for AI-enabled abuse tools. As artificial intelligence becomes increasingly accessible, regulatory bodies worldwide are establishing that app stores cannot remain neutral marketplaces for technology that facilitates non-consensual intimate imagery. The outcome of San Francisco's action will likely influence how Apple, Google, and other platforms approach AI application governance moving forward, potentially setting standards for responsible AI distribution across the industry.