Grok Generating Flood of Sexualized Images of Women and Minors
AI Forensics finds Grok’s weak guardrails enable mass sexualized images (women, some minors) plus illegal Nazi/ISIS content.
Project overview

We shows how a lack of guardrails around Grok’s AI image generation is producing a large volume of sexualized imagery, primarily of women but also minors, as well as illegal Nazi and ISIS materials.
By analyzing over 20k images generated by Grok and 50k requests made by users we found that:
- 53% of images generated by @Grok contained individuals in minimal attire of which 81% were individuals presenting as women
- 2% of images depicted persons appearing to be 18 years old or younger, as determined by Google's Gemini vision model
- 6% of images depicted public figures, approximately one-third of whom were political figures
- We identified Nazi and ISIS propaganda material generated by @Grok
The generation of Nazi and ISIS content raises legal concerns, as its distribution is strictly regulated in multiple jurisdictions, including France and Germany. Furthermore, this data comes as France has just launched an investigation into the spread of Grok-generated deepfakes on X and other countries may soon follow.
Featured On
AI Forensics is proud to be trusted by















