AI-Generated Misinformation on X

The X platform (formerly Twitter) is at the center of new controversy due to the spread of artificial intelligence (AI) generated content related to the conflict in Iran. In particular, Grok, the AI developed by X, has failed to accurately verify video footage from the region and has shared self-generated images about the war.

This raises serious concerns about the reliability of information disseminated on the platform, especially in crisis contexts where fact-checking is crucial. The ability of an AI model to distinguish between real and synthetically generated content is critical to prevent the spread of misinformation and propaganda.

The incident highlights the risks associated with using AI for news curation and dissemination, especially when models are not adequately trained or monitored to prevent the generation of false or misleading content.