Ethical Hacking News
The tech giants' profiteering from face-swapping apps that create AI-generated non-consensual nude images has raised concerns about responsibility, moderation, and regulation in the industry. San Francisco's cease-and-desist letters to Apple and Google mark a significant escalation in the fight against this form of online harassment.
San Francisco has sent cease-and-desist letters to Apple and Google demanding removal of 13 face-swapping apps from their app stores. The apps, which can create AI-generated non-consensual nude images, have generated millions of dollars in profits for Apple and Google despite being banned on their platforms. Apple and Google's developer policies prohibit pornography, abuse, and harassment, but these policies seem to be ineffective in preventing the spread of such content. The issue of AI-generated non-consensual nude images has been a growing concern, with estimated 480 million downloads and $120 million in combined revenues. San Francisco's actions highlight the need for greater accountability and responsibility in the creation and distribution of AI-generated content.
San Francisco has taken a bold step towards combating the proliferation of non-consensual deepfakes, which have been increasingly used to target women and girls. In a move that marks a significant escalation in the fight against this form of online harassment, the City Attorney's Office has sent cease-and-desist letters to Apple and Google, demanding that they remove 13 face-swapping apps from their app stores. These apps, which can create AI-generated non-consensual nude images, have been widely used to facilitate sexual abuse and bullying.
According to the letters sent by San Francisco city attorney David Chiu, these apps have generated millions of dollars in profits for Apple and Google, despite being banned on their platforms. Chiu has stated that it is imperative for these companies to take responsibility for ensuring that their platforms do not facilitate sexual abuse. He believes that they should improve their moderation processes to prevent such harmful content from appearing on their stores.
The issue of AI-generated non-consensual nude images has been a growing concern in recent years. Researchers have repeatedly found and reported apps on Apple's App Store and Google's Play Store that allow people to generate sexual images using AI, including some apps being rated as suitable for use by children. Despite the existence of laws and bans aimed at tackling this scourge, technology and social media companies continue to direct millions of people towards harmful tech.
Both Apple and Google have developer policies that prohibit pornography, abuse, and harassment on their platforms. However, these policies seem to be ineffective in preventing the spread of such content. In January and April this year, the Tech Transparency Project uncovered around 100 apps across both the App Store and Play Store, as well as some advertisements for nudifying technology on the platforms. These apps are estimated to have been collectively downloaded around 480 million times and may have made around $120 million in combined revenues.
The problem of AI-generated non-consensual nude images is deeply concerning. It can have a horrific impact on one's reputation, mental health, loss of autonomy, and even lead to suicidal thoughts among victims. The fact that some of the world's largest and most established technology companies are facilitating this has to stop.
Chiu believes that Apple and Google should take immediate action to remove these apps from their stores and strengthen their screening systems to prevent such content from appearing in the future. He also hopes that these companies will do the right thing but warns that if they don't, his office will have to consider all legal options.
This is not the first time that Chiu's office has taken action against deepfake websites. In 2023, they took legal action against 16 popular deepfake websites and are still pursuing this issue today.
The issue of AI-generated non-consensual nude images raises important questions about responsibility, moderation, and regulation in the tech industry. While Apple and Google have policies in place to prevent such content, it seems that these policies are not being enforced effectively.
In order to address this problem, there needs to be a more coordinated effort from technology companies, law enforcement agencies, and regulatory bodies to develop effective solutions. This includes improving moderation processes, increasing transparency, and holding companies accountable for their actions.
The case of San Francisco's cease-and-desist letters to Apple and Google serves as a wake-up call for the tech industry. It highlights the need for greater accountability and responsibility in the creation and distribution of AI-generated content. If left unchecked, this form of harassment can have serious consequences for victims and perpetuate a culture of online abuse.
In conclusion, the spread of AI-generated non-consensual nude images is a growing concern that requires immediate attention from technology companies, law enforcement agencies, and regulatory bodies. San Francisco's actions against Apple and Google serve as a necessary step towards combating this form of harassment and promoting a safer online environment for all.
Related Information:
https://www.ethicalhackingnews.com/articles/The-Dark-Side-of-AI-Generated-Nudity-How-Apple-and-Googles-Profits-Are-Fueling-the-Spread-of-Non-Consensual-Deepfakes-ehn.shtml
https://www.wired.com/story/san-francisco-demands-apple-and-google-delete-ai-nudify-apps-from-app-stores/
Published: Fri Jul 17 05:16:22 2026 by llama3.2 3B Q4_K_M
