Cautionary Tale: Weaponizing AI-Generated Imagery

Cautionary Tale: Weaponizing AI-Generated Imagery


Earlier today, claims began to spread widely on Twitter that an explosion took place near the Pentagon. Accompanied by these claims was a single photo purportedly showing smoking rising near a building, however, this photo was fake and a key example of weaponized AI generated imagery.

We can conclude from a thorough image analysis that the image is false and likely AI developed. A closer look at the image reveals that a number of the objects are out of place and clip through the background.

The lamp post that clips through the lower part of the fencing and into it, which is the best illustration of this. As you progress from left to right, the fencing itself becomes a distorted tangle of lines and loses quality. Similar to this, if you look at the building, you can see the places where the image was not fully formed, leading to significant inconsistencies.

This was also backed by photo forensics of the picture, which shows discrepancies in the pixels.

As with most developing stories, one tries to look for other photos or videos to confirm something is happening. Not only was the post unable to be geolocated (as it was AI generated), there was no other evidence of the alleged blast through open source. To top it all off, we reached out to people we know from the area who confirmed there was no smoke or presence of emergency services.

The post appeared to have originated from a Qanon page on Facebook, but when it hit Twitter, it was quickly spread by bots and “OSINT” accounts known for spreading unverified information. Due to the success of many OSINT accounts on Twitter in covering the war in Ukraine, many mainstream outlets have begun to rely on open source reporting to get a jump on stories. With a large influx of OSINT accounts and fake “verified” accounts of more reputable news outlets spreading “initial reports” of the alleged blast, mainstream outlets began to run headlines without verifying the information for themselves. Twitter accounts for the Russian state-media outlet RT, as well as several other foreign media services, began to tweet out the claims, spreading it even further.

The claim was eventually confirmed to be false by local authorities and officials, however, there was a solid 45 minutes to an hour that this claim spread uncontrolled on social media. By now, the damage was done and fear was spread, not only amongst the public, but also the markets. The S&P 500 briefly fell at least 30 points after the post hit Twitter, resulting in a $500 billion market cap swing.

Coming from someone who covers news and conflicts on a daily basis, this was the first time I have ever seen an AI-generated disinformation go viral to the extent that this one did. As AI-generated content gets more mainstream, we will see more instances of this. While AI content can be fun, such as memes of Biden and Trump playing Minecraft, they can easily be weaponized. This is why it is important to not only triple check everything you read online, but also teach yourself ways to detect AI generated content through open source tools and try to geolocate content if possible. We all live in an information environment that has shifted into a digital war zone meant to mislead people and shift perspectives. This article is a cautionary tale for what is to come.

Unbiased & Unfiltered News Reporting for 12+ years. Covering Geo-Political conflicts, wartime events, and vital Breaking News from around the world. Editor-In-Chief of Atlas News.
- Sponsor -spot_img
- Sponsor -spot_img

Week's Top Stories

More In This Category

Germany Denies Participating in Genocide by Arming Israel

Germany stated that the nation has not participated in...

Clashes Continue Between Colombian Authorities and the FARC

Clashes between Colombian authorities and the Revolutionary Armed Forces...

Belarusian Army Colonel Dies in Prison After Insulting President Lukashenko

Aleksander Kulinich, a lieutenant colonel in the Belarusian Reserves...

Former Taiwanese President Meets Chinese Leader Xi Jinping In Beijing

On April 10th, former Taiwanese President Ma Ying-jeou met...