Google Updates Play Store AI App Guidelines

Google Introduces New Guidelines for AI Apps on Play Store to Combat Inappropriate Content
Google has updated its Play Store policies with new guidelines aimed at developers creating and distributing AI apps, in an effort to clamp down on inappropriate and prohibited content. The tech giant now requires AI apps to actively prevent the generation of restricted content, including sexual material and violence, and mandates the inclusion of features that allow users to report offensive content.
Developers are also obligated to conduct rigorous testing of their AI tools and models to ensure they comply with standards of user safety and privacy. Google has indicated it will take action against apps that promote inappropriate use cases in their marketing, such as those claiming the ability to undress people or create non-consensual nude images, potentially banning them from the Play Store.
The move comes in response to a rise in the marketing of AI undressing apps on social media platforms, with instances of ads on Instagram promoting apps capable of generating deepfake nudes. Notably, one app used an image of Kim Kardashian with the provocative slogan “Undress any girl for free.” Despite Apple and Google’s efforts to remove such apps from their stores, the problem persists.
The guidelines also aim to address issues in U.S. schools, where there have been reports of students sharing AI-generated deepfake nudes of classmates and teachers, leading to bullying and harassment. A recent incident involving a racist AI deepfake of a school principal in Baltimore even led to an arrest, highlighting the seriousness of the issue.
Google’s policy changes underscore the importance of protecting users from harmful AI-generated content on the Play Store. The company emphasizes the need for AI apps to prevent the generation of restricted content, facilitate user reports of inappropriate material, and actively monitor and prioritize user feedback, especially in apps where user interactions significantly influence content and experience.