Apple warned Musk's xAI of removing Grok from App Store over AI deepfakes
Apple reportedly found Grok in violation of its guidelines over sexualised deepfakes and asked for fixes, warning the app could be removed if issues were not addressed
Apple had reportedly warned that it could remove Elon Musk's Grok app from the App Store after finding it in violation of its guidelines, following a surge of sexualised deepfakes generated by the AI tool earlier this year. The development was revealed in a report by 9To5Google, citing NBC News, that stated that Apple also shared a letter regarding the same with US lawmakers.
What happened
According to the report, Apple faced pressure to take action after Grok was found to generate altered images that could undress people in photos, including women and minors. While the company did not comment publicly at the time, it reportedly engaged with the developers behind Grok and X behind the scenes.
READ: Google brings Personal Intelligence to Gemini for Indian users: What is it
Apple is said to have determined that both apps were in violation of its App Store guidelines and contacted their teams, asking them to submit a plan to improve content moderation.
Also Read
Apple releases iOS 26.5 public beta 2: Check what's new, how to update
Amazon-Globalstar deal poised to boost Apple's satellite ambitions
Amazon's $11.6 bn deal with Globalstar ramps up rivalry with Elon Musk
Amazon to buy Globalstar in $11.57 bn deal to rival Musk's Starlink
Apple releases iOS 26.5 dev beta 2 for iPhones: What's new, how to update
As part of the process, X reportedly submitted an updated version of the Grok app for review. However, Apple rejected the initial update, stating that the changes were not sufficient to address the violations. Elon Musk's company then submitted revised versions of both the X app and Grok.
In its communication to US senators, Apple reportedly said it found that while X had resolved its issues in subsequent submissions, Grok remained out of compliance. The company warned that if the issues were not fixed, the app could be removed from the App Store.
Grok was only approved after further revisions were made to improve its moderation systems.
Changes to Grok's image tools
The report suggests that this review process explains the moderation changes introduced by xAI at the time, including limiting access to image-generation features and restricting edits involving real people.
These updates were rolled out as the company responded to growing criticism over how the tool handled image manipulation requests.
READ: Microsoft may soon bring OpenClaw-like features to Copilot: Check details
Despite these changes, concerns around Grok's image generation capabilities remain. According to the NBC News report cited by 9To5Google, the tool is still capable of generating sexualised images of people without consent in certain cases.
While the scale of such outputs has reportedly reduced compared to earlier this year, some users have been able to bypass restrictions. These include generating altered images that depict individuals in revealing or modified clothing.
More From This Section
Google brings Personal Intelligence to Gemini for Indian users: What is it
Tech Wrap Apr 14: Realme Narzo 100 Lite, ASUS laptops, Nvidia GeForce Now
Microsoft may soon bring OpenClaw-like features to Copilot: Check details
Motorola Edge 70 Pro may launch in India on April 26: What to expect
Motorola may unveil Razr 70 Ultra with a 5,000mAh battery: What to expect