Apple nearly removed the Grok chatbot app developed by xAI from its App Store following concerns over the generation of non-consensual deepfake content, according to reports.
The issue arose earlier this year after users exploited the AI tool to create sexualised images of individuals without consent, prompting backlash from regulators and lawmakers.
Apple reportedly contacted the developers behind Grok and its parent platform X, requiring them to improve content moderation. Initial updates submitted for review were rejected for failing to meet App Store guidelines.
Subsequent revisions eventually addressed the concerns, allowing the app to remain available. Apple indicated that failure to comply could have resulted in its removal from the platform.
The controversy also drew scrutiny from U.S. lawmakers, who urged both Apple and Google to take action against apps facilitating harmful content.
The incident underscores increasing regulatory pressure on AI platforms to implement stricter safeguards, particularly as generative AI tools become more widely accessible and capable of misuse.
