skip to Main Content

Introducing: The X (Twitter) Search Network 3.0 (beta) Data Importer for NodeXL Pro

The new X (Twitter) Search Network Data Importer (released August 2023) in NodeXL Pro collects posts (tweets) via the official X (Twitter) Search. That means the entire history of posts (tweets) since 2006 is available from the search importer.

NodeXL users need to be logged into their own X (Twitter) account in order to get the data. Heavy usage of the importer bears the potential risk of a blocked account, so we recommend creating a research account before you get started. But so far we have no reports of blocked accounts.

Getting Started:

To open the X (Twitter) Search Network importer, select Excel > NodeXL > Data > Import> From X (Twitter) Search Network 3.0 (beta)…

Enter your search query into the dialog box and select a time frame for the data collection. You find detailed information about the wide range of available search operators on the official documentation page and in this blog post.

List of NodeXL Pro data importers
NodeXL Pro Data Import Menu
NodeXL Pro X (Twitter) Search Network Data Importer

Login:

When you click the “OK” button, you will be presented with a browser window pointed at X (Twitter) login page. After you successfully login, X (Twitter) will send a cookie to your computer. NodeXL uses this cookie to authenticate with X (Twitter). After that the data collection begins.

Please note that NodeXL does not handle or store your X (Twitter) username and password. When you type them, you are directly communicating with X (Twitter). Furthermore, the cookie is temporarily stored in memory for the duration of the import session so it can not be used later. NodeXL will then search X (Twitter) for posts (tweets) containing the search term you provided.

Data Collection:

The NodeXL Pro X (Twitter) Search importer collects posts (tweets) going backwards in time from the set end date. It stops when either the post (tweet) limit or the start date is reached.

Edge Creation:

The following edge relationships are created from the data:

RelationshipDescription
TweetThis relationship is created if an author does not include any mentions of other users in a tweet/post. Thus a self-loop is generated in which the author name is Vertex 1 and Vertex 2 at the same time.
MentionsIf an author mentions another user in a tweet/post, an edge is created from the author (Vertex 1) to the mentioned user (Vertex 2). If several users are mentioned, one edge is created to each of the mentioned users.
RetweetWhen a user retweets/reposts a tweet/post, an edge is created from the retweeting user (Vertex 1) to the retweeted user (Vertex 2).
MentionsInRetweetIf the retweeted tweet/post contains mentions of other users, an edge is created from the retweeting user (Vertex 1) to each of the mentioned users (Vertex 2).
Replies ToIf a tweet/post starts with a @username, the tweet is regarded as a reply. An edge is created from the author (Vertex 1) to the first user in the tweet/post (Vertex 2).
MentionsInReplyToIf further users are mentioned in a reply, edges are created from the author (Vertex 1) to each of the mentioned users in the reply (Vertex 2).
QuoteA user can quote a tweet/post. An edge is created from the author (Vertex 1) to the quoted user (Vertex 2).
MentionsInQuoteIf the quote contains mentions of other users, an edge is created from the quoting user (Vertex 1) to each of the mentioned users (Vertex 2).
MentionsInQuoteReplyIf the quote starts with a @username, an edge is created from the quoting user (Vertex 1) to each of the mentioned users (Vertex 2).

Limitations:

X (Twitter) rate limits API calls to their web site. You can get a maximum of 20 tweets per API call. After 50 API calls a 15 minute wait window starts. NodeXL will display a status message when the rate limit is reached and when the collection is scheduled to restart. So roughly, for every 1000 tweets you have to wait 15 min, meaning that the collection of 10,000 tweets will take about 2.5 hours.

Reposts (Retweets) are only available from the past seven days. If you are interested in historical retweet data, you will receive that via the commercial data providers mentioned here.

Apparently there is no difference in the rate limit for verified (X Blue) or unverified users.

Data Analysis:

Learn about the key feature “Task Automation” to easily perform a social network and content analysis on the collected data with just a few clicks.

NodeXL Pro Workbook Overview

Get Started with NodeXL Today!

Whether you’re an academic researcher diving into the intricate world of online interactions or a business aiming to unravel the vast web of social connections relevant to your brand, NodeXL with its diverse importers is your go-to solution. Experience the power of network analysis tailored to your needs.


Feedback and Support: We continuously strive to enhance our tools. Should you have feedback or require assistance, contact our support team.

NodeXL Pro Quick Start Guide

Twitter Data Recipes

Create a complete social network and content analysis with the NodeXL Pro Twitter network importers. Click here for NodeXL Pro Twitter Data Recipes that can be used to automate your analysis of Twitter network data.

YouTube Video Network

YouTube Data Recipes

Create user network and video network analyses with the NodeXL Pro Youtube network importer. Click here for Youtube data recipes that can be used to automate your analysis of YouTube network data.

Wikipedia Page Network Graph

Wikipedia Data Recipes

Create Wikipedia article network as well as user network analyses with the NodeXL Pro MediaWiki network importer. Click here for Wikipedia data recipes that can be used to automate your analysis of Wikipedia network data.

Flickr Data Recipes

Create user network and tag network analyses with the NodeXL Pro Flickr network importers. Click here for Flickr data recipes that can be used to automate your analysis of flickr network data.

Back To Top