Google Gemini Download Feature Reportedly Delivered Images Its Safety Filters Had Blocked
- Severity
- Medium
- Sources
- 2
What happened
Fog Security reports that Google Gemini's web app download path could deliver images that safety filters had refused, while the chat preview showed an allowed image; no jailbreak was required. Affected links use lh3.googleusercontent.com with signed-in session tokens, inline links ending =s1024-rj and download links ending =s0-d-I. Fog suspects a state-management error across generation, safety checks and cleanup, which is unconfirmed. Google closed the report on 23 October, citing maintenance and no internal ticket. Fog recommends binding each download to its approved preview and purging files from refused or failed generations.
For security analysts · Written by AI from 2 sources · Wrong?
What to do
- AI developers should bind each download to its approved preview and remove files from refused or failed generations, as Fog Security recommends.
- Test AI safety controls across stored files and download links, not only chatbot replies.
Written by AI from the sources, checked against them
Full story timeline · 2 updates
Who reported · 2 outlets
Who and what is in it
Companies
Products