Apple banned ‘nudify’ apps that pose as ordinary apps to sneak past App Store review

Apple has written a ban on “nudify” apps that pose as ordinary apps to sneak past App Store review into its developer rules. In an Oct. 16 post, the company said apps that misrepresent their purpose during review and only reveal harmful capabilities after approval, a tactic known as bait-and-switch, are prohibited. The update touches three parts of the App Review Guidelines: 1.2, 2.5.19 and Section 5.

AI, explained every day: The Deep View is the go-to daily newsletter for 600,000+ founders, knowledge workers and professionals who want to stay up to date with artificial intelligence.

Get The Deep View →

We may earn a commission if you sign up.

Apple stresses that the underlying prohibitions are not new. Pornographic material has long been barred from the store, and so have apps that hide features from reviewers, and the changes spell out how those rules apply to AI tools that generate sexualized images of real people.

Guideline 2.5.19 and the bait-and-switch tactic

Apple’s developer news post, titled “Strengthening App Review Guidelines against nonconsensual intimate imagery and bait-and-switch apps,” says guideline 2.5.19 now clarifies the longstanding prohibition on apps misrepresenting what they do during App Review and then changing after approval, for example by adding features or functionality that were not in the version submitted for review. Apps found doing so are subject to removal from the App Store and from the Apple Developer Program. In its introduction, the post names ‘nudification’ as the example of a harmful capability that some developers conceal until an app is live.

TechCrunch’s report on the change, by Ivan Mehta, said Apple tightened the guidelines over the weekend and described the new wording as aimed at apps that hide a nudify feature and switch it on after approval. Apple’s own date for the post is Oct. 16, a Friday, so the weekend description appears to reflect when the change was noticed rather than when Apple published it. Either way, the company says apps that add features not present in the submitted version face removal.

Guideline 1.2 and nonconsensual intimate imagery

The second change is to guideline 1.2, which covers user-generated content. Apple says its content moderation requirements now explicitly cover nonconsensual intimate imagery, including imagery generated with AI tools, as content that apps must proactively prevent and remove. Developers who fail to put adequate safeguards in place, or who do not fix violations after notice, risk breaching the Developer Code of Conduct and being removed from the App Store.

The post restates what apps that host user-generated content already owe the store: filtering objectionable material, giving users a way to report offensive content, and letting users block abusive accounts. It describes nudification apps as ones that create sexually explicit images of real individuals without their consent. Apple’s published App Review Guidelines are the reference for the full text of each rule; the page is long, and the wording above is taken from Apple’s post rather than from that page.

Section 5 received a smaller edit. Apple says the store has always prohibited apps that facilitate human trafficking or the exploitation of children, including child sexual abuse material, and that Section 5 now makes clear such apps will be removed from the App Store and blocked from alternative distribution.

Pressure that preceded the rule change

Apple gives its own enforcement numbers in the post: last year it prevented over 150,000 apps with safety issues from reaching customers, and it terminated over 193,000 developer accounts for fraud and abuse. The company adds that violations often involve bad actors concealing harmful content that activates only after approval, and that its review tools are evolving to catch such cases faster. Those totals cover all safety issues, not nudify apps alone, and the post does not give a nudify-specific count.

Outside pressure had been building. According to TechCrunch’s July 17 report, San Francisco City Attorney David Chiu sent letters to Apple and Google asking them to remove nudify apps, saying the companies were profiting off apps that exploit women and girls by generating nonconsensual intimate deepfakes. The city asked for a response within 28 days and warned of possible civil penalties. TechCrunch reported that Apple had removed three apps, was terminating their developer accounts, and was contacting four others about policy violations.

The Tech Transparency Project had documented the problem earlier. In its April 15 report, the group found that 18 of 46 apps surfaced by its App Store searches could nudify or undress women, and that Apple’s ads and autocomplete suggestions led users to such apps. Apple removed 15 apps after the group and Bloomberg News shared them, and the group found 31 nudify apps rated suitable for minors across both stores. Apple does not link the October update to any of those outside reports, but the timing places the new text after a spring of documented findings and a summer legal demand, and the company says enforcement will rely on review tools that spot concealed features sooner. Whether that catches apps that behave normally during review remains the open test.

This article was produced with the assistance of AI and reviewed by Morning Overview editors prior to publication.

AI, explained every day: Get The Deep View →

We may earn a commission if you sign up.