Meta finds AI-generated content on Israel-Gaza used ‘deceptively’ on Facebook, Instagram; takes action
Israel-Gaza conflict published below posts from global news organisations and US lawmakers, the social media company said in its quarterly security report. The social media accounts posted as Jewish students, African Americans, and other concerned citizens are targeting the US and Canadian audiences.
The campaign was attributed to Tel Aviv-based political marketing firm STOIC, Reuters reported. While Meta has encountered AI-generated basic profile photos in influence operations since 2019, this report is the first to reveal the use of text-based generative AI technology, which has existed since late 2022.Researchers warned that generative AI could lead to more effective disinformation campaigns and sway elections as it can quickly and cheaply produce human-like text, images, and audio.
Meta security executives reported that they swiftly dismantled the Israeli campaign and did not believe that advanced AI technologies hindered their capacity to disrupt influence networks, which are organized efforts to propagate specific messages.They added that the executives had not seen such networks deploying AI-generated imagery of politicians realistic enough to be confused for authentic photos. Meta head of threat investigations Mike Dvilyanski said, “There are several examples across these networks of how they use likely generative AI tooling to create content."“Perhaps it gives them the ability to do that quicker or to do that with more volume.
But it hasn't really impacted our ability to detect them," Mike said as quoted by Reuters. Besides the STOIC network, Meta also shut down an Iran-based network focused on the Israel-Hamas conflict.
Read more on livemint.com
