The Intersection of AI, Islamophobia, and Financial Scams on Social Media
September 2023 marked the beginning of a troubling trend observed by researchers at the Center for the Study of Organized Hate, a think tank based in Washington, D.C. With the election season underway, they noted a surge of inflammatory, AI-generated content on X (formerly Twitter) that preyed on negative sentiments toward Muslims.
Inspiring Alarming Content
Among the posts identified were several troubling examples. One featured a Muslim family with a caption claiming they were leaving America due to a lack of respect for their culture. Similarly, another post provocatively asked whether followers would give away their dogs to please a Muslim individual. A third image depicted women in niqabs holding a sign proclaiming, “Stop saying Merry Christmas or we will leave.” Such posts not only generated extensive engagement but also attracted thousands of comments.
Scam Operations Under the Veil of Political Allegiance
Many accounts associated with these posts bore names suggesting affiliations with prominent political figures such as Donald Trump and JD Vance. However, investigations revealed no actual connection. While these accounts claimed to be based in the United States, platform tools indicated their actual origins were abroad, raising suspicions about their credibility.
Followers of these inflammatory accounts soon began receiving messages warning them of an imminent global financial crisis. These troubleshooting messages included instructions to avert financial fallout by relocating their assets, effectively serving as bait for scam operations.
Exploiting Fear for Profit
Raqib Naik, executive director and founder of the study center, noted the clear understanding among perpetrators of the demand for such content in the current political climate. “It’s very clear that they understand that there is a demand for this kind of content in the country right now,” he stated. This indicated a calculated approach where inflammatory content surrounding Muslims is utilized as bait to direct individuals toward scam schemes.
In fact, Naik’s team identified over 220 accounts engaged in scams related to financial schemes or sexual exploitation, most predominantly emanating from Africa, South Asia, Italy, and Japan.
The Scammers’ Methodology
It became apparent that these scammers were targeting right-wing users with conspiracy-related beliefs, including followers of QAnon. Instead of traditional scamming methods that require building trust, these operators were leveraging the social media algorithms to identify their audience, ensuring maximum efficiency in reaching potential victims.
Through their posts, they effectively reached users predisposed to accept their narratives. Mahdhi stated, “By pushing this content they are reaching exactly the type of people who support these Q conspiracy theories, and that are more likely to lose their money for a cause they believe in.”
Conspiracy Theories and Financial Manipulation
The scammers often cloak their offers in terminology associated with conspiracy theories about financial resets. These scams suggested that individuals could avoid impending economic collapse by following the scammer’s advice, often through the purchase of cryptocurrencies like XRP and XLM.
Mike Rothschild, an expert on conspiracy theories, highlighted the psychological manipulation involved, stating, “It’s all playing on people’s need to feel like they know what’s going on.” By claiming insider knowledge about financial schemes, scammers exploit the fear and uncertainty existing within certain communities.
Social Media’s Response
X has recently taken steps to combat low-quality content, including suspending over 13,000 accounts linked to suspected foreign influence during the ongoing political climate. Nonetheless, many accounts have continued to operate, raising questions about the effectiveness of the platform’s moderation policies.
Furthermore, scammers have successfully leveraged the former president’s association with cryptocurrency and right-wing conspiracies to enhance their credibility among users. “It’s not out of the realm of possibility that a member of the Trump family would be associated with some sort of dodgy-sounding crypto investment,” Rothschild added, illustrating the blurred lines between legitimate political discourse and financial manipulation.
