Detecting Influence Campaigns on X with AI and Network Science – Information Sciences Institute

By Taaza Facts

Published on:

Detecting Influence Campaigns on X with AI and Network Science – Information Sciences Institute

In the age of generative-AI and large language models (LLMs), massive amounts of inauthentic content can be rapidly broadcasted on social media platforms. As a result, malicious actors are becoming more sophisticated, hijacking hashtags, artificially amplifying misleading content, and mass resharing propaganda. 

These actions are often orchestrated by state-sponsored information operations (IOs), which attempt to sway public opinion during major geopolitical events such as the US elections, the Covid-19 pandemic, and more. 

Combating these IOs has never been more crucial. Identifying influence campaigns with high-precision technology will significantly reduce the misclassification of legitimate users as IO drivers, ensuring social media providers or regulators do not mistakenly suspend accounts while trying to curb illicit activities. 

In light of this, USC Information Sciences Institute (ISI) researcher Luca Luceri is co-leading an effort funded by the Defense Advanced Research Project Agency (DARPA) to identify and characterize influence campaigns on social media. His most recent paper “Unmasking the Web of Deceit: Uncovering Coordinated Activity to Expose Information Operations on Twitter” was presented at the Web Conference on May 13, 2024. 

“My team and I have worked on modeling and identifying IO drivers such as bots and trolls for the past five to ten years,” Luceri said. “In this paper, we’ve advanced our methodologies to propose a suite of unsupervised and supervised machine learning models that can detect orchestrated influence campaigns from different countries within the platform X (formerly Twitter).” 

A fused network of similar behaviors 

Drawing from a comprehensive dataset of 49 million tweets from verified campaigns originating in six countries – China, Cuba, Egypt, Iran, Russia, and Venezuela – Luceri and his team have honed in on five sharing behaviors on X that IO drivers participate in. 

These include co-retweeting (sharing identical tweets), co-URL (sharing the same links or URLs), hashtag sequence (using an identical sequence of hashtags within tweets), fast retweeting (quickly re-sharing content from the same users), and text similarity (tweets with resembling textual content). 

Previous research focused on building networks that mapped out each type of behavior, examining the similarities between individual users on X. However, Luceri and his team noticed that these accounts often employ many strategies at the same time, which meant that monitoring one behavioral trace was not enough. 

“We found that co-retweeting was massively used by campaigns in Cuba and Venezuela,” Luceri explained. “However, if we only examine co-retweeting without considering other behaviors, we would perform well in identifying some campaigns, such as those originating from Cuba and Venezuela, but poorly where co-retweeting was used less, such as in Russian campaigns.” 

To capture a broader range of coordinated sharing behaviors, the researchers constructed a unified similarity network called a Fused Network. Then, they applied machine learning algorithms fed by topological properties of the fused network to classify these accounts’ similarities and predict their future participation in IOs.

Luceri and his team found that this method could be applicable to campaigns across the world. Multiple X users within the same campaign, no matter where they are from, exhibited remarkable collective similarity in their actions. 

“I consider our work a paradigm shift in research methods, giving a new perspective in the identification of influence campaigns and their drivers,” said Luceri. 

Unlocking new opportunities 

The unsupervised machine learning model leverages well-known, yet underutilized network features achieving a 42% higher precision than other traditional approaches to detect influence campaigns. Luceri views this paper as a starting point that could open the way to further avenues of research.

“We can train models on the topological features of this similarity network, and make them work in complex scenarios: for instance, if different users from different countries interacted with each other, or more challenging situations where we have limited information about the campaigns,” Luceri remarked. 

Luceri also presented another paper “Leveraging Large Language Models to Detect Influence Campaigns in Social Media” at the Web Conference, which received the best paper award from the International Workshop on Computational Methods for Online Discourse Analysis (BeyondFacts’24). The paper examines the potential of using LLMs to recognize the signs of AI-driven influence campaigns. This is particularly crucial in the current climate, where AI-created media is pervasive. 

“These coordinated activities have consequences in real life,” said Luceri. “They have the power to spread misinformation and conspiracy theories that might lead to protests or attacks on our democracy, such as the interference of Russian trolls in the 2016 US election.” 

Luceri and his team are committed to continuing the search for alternative strategies to identify influence campaigns and protect users susceptible to influence.

Published on May 14th, 2024

Last updated on May 16th, 2024

Taaza Facts

I am a multifaceted content creator with expertise in blogging, Finance, and Cryptocurrency reviews. My creative journey involves weaving captivating stories in blogs, designing aesthetically pleasing and functional websites, and dissecting the nuances of cinema. We are dedicated to sharing our passion and insights with a global audience.

Related Post

Freshers Jobs Vacancy – Data Scientist 1 Job Opening at Swiggy

Swiggy is hiring for the role of Data Scientist 1 for the Remote location. Please read the entire information carefully and apply if you are eligible for the Data ...

Trojans celebrate resilience and being ‘Free to Live Out Loud’ at virtual Juneteenth event

When the Rev. Brandon Harris took the stage to open Wednesday’s Juneteenth celebration, he shared with the audience of more than 150 students, faculty, alumni and ...

Freshers Jobs Vacancy – Developer Job Opening at Barclays

Barclays is hiring for the role of  Developer for the Pune location. Please read the complete information carefully and apply if you are eligible for a Developer Job Opening ...

Freshers Jobs Vacancy – Junior Data Analyst Job Opening at BCG

Boston Consulting Group is hiring for Junior Data Analyst for New Delhi location. Interested people can read the entire information carefully and apply if you are eligible Junior Data ...

Leave a Comment

Actor John Abraham Purchases Bungalow In Mumbai For Rs 75.83 Crore Ankita Lokhande: From TV Stardom to Bollywood Dreams | Inspiring Journey Ayesha Khan Lifestyle, Bigg Boss 17 Wild Card, Boyfriend, Family, Munawar faruqui, Age, Biography Kalki 2898 AD – 100 Times Bigger Than Salaar Prabhas Film Bigg Boss 17: Salman Khan scolded Ayesha badly, got angry on Munawar-Ayesha matter