[SentiSteem #3] Twitter popularity analysis of word "superbowl" between 2013-01-01 and 2018-12-31

in #science5 years ago (edited)

sentiment.png

Hello world! Welcome to report where I'm using machine learning to analyze tweets about specified topic and present results in form of various and easy to understand charts. The sentiment analysis algorithm has been developed as part of my Master Thesis in 2017/2018.

This report is currently being published exclusively here on Steemit and Whaleshares.

Power House Creatives Logos FINAL.png

Parameters

Today's analysis has been executed on tweets which contain word "superbowl" and were published between 2013-01-01 and 2018-12-31. Detailed specification of the data is shown in the following list:

  • Keyword: superbowl
  • From: 2013-01-01
  • To: 2018-12-31
  • Number of analyzed tweets: 25000
  • Tweets per week: 79
  • Language: en
  • Geographical location: Not specified

text16.png

Results

Sentiment

After downloading 25000 tweets between the specified dates, sentiment analysis has been executed on each and every one of those tweets. Sentiment score has been then aggregated over weeks and months, to lower the granularity of results on the time axis and then plotted as a following linechart.

sentiment.png

Sentiment of tweets for keyword "superbowl"

My subjective comment on the chart:Well the score has been pretty consistent and not really oscilating much. It's losing a bit of popularity in the last years, who knows why. I don't really follow NFL so can't say..

Aggregation using heatmaps


To show the general trend/pattern in the sentiment, linechart works great. We can see the bigger timeframe and estimate the long-term direction. But if you're interested in particular month or week, it's hard and in case of weeks actually impossible to see the change. Has an athlete put the great performance in particular match? Has the brand/company released a new line of product? So see such low lever changes, following 2 heatmaps are to be used.

heatMap.png

Chart shows average sentiment per month where 0.55 is the worst and 0.76 the best achieved score

My subjective comment on the chart:I loooove this. Do you see that huge spike in February 2015? Just google what happened back then. I did and Im once again stunned how cool sentiment analysis can be. There was a huuuge melee between players in the last minute of superbowl that year.

Most frequently used words


Another very interesting aspect to look into are the repeatedly used words using wordclouds. Even more interesting is to compare two wordclouds generated from different time - usually before and after some event/change happened. If you give this a second though, the problem here is that many short words (like "and", "or", "with" and so on) are used almost in every sentence and would also show up in wordclouds. To mitigate this, I've removed list of 153 so called stopwords. Additionally I've also removed words typical for this area listed in the end of the report*.

CommonWords.png

Most often used words in tweets containing word "superbowl" before and after 2015-12-31.

My subjective comment on the chart:Interesting to see word Patriot popping up after 2015. I guess it's Tom Brady's team right? They win all the time, right?

Most frequently used UNIQUE words

As we can see in the previous worldcloud, there are many words which are actually shared in both wordclouds. That makes all the sense as there are many areas which will be forever connected with superbowl. But I went one step further and decided to create wordclouds which contain only unique words with don't appear in the opposite wordcloud.

UniqueWords.png

Most often UNIQUE used words in tweets containing word "superbowl" before and after 2015-12-31.

My subjective comment on the chart:Well I'm really lost in this one as I dont recognize half of the words. Could maybe someone explain this to me? :D I just noticed the word "football" stopped being used so much. Also, doest QB mean quarterback? Did they become somehow more important in the game?

BONUS - shaped wordcloud from all words!

This one is just for fun :) It's generated from 1000 most popular words in all tweets, not divided into before and after groups. Click it to open!

shapedWords.png

Power House Creatives Logos FINAL.png

About project

This series of posts shows the power of machine learning and it's application in the real life. It also makes kind of symbolical point of analyzing Twitter and publishing it here on Steemit. Technology of the future is being used on the social media of the future ;)

Get your report


Twitter sentiment analysis reports are being sold for quite some dollars in the world outside of Steemit. In our tiny word of Steemit, such price would be way too much - that's why I'm offering to generate& send you a report with your chosen keyword and dates for a laughable price - 10 STEEM. Order 3 and get the fourth one for free :)

Interested in how's you favorite coin doing on Twitter? Or favorite athlete? Politician, actor or clothes company? . Just DM me and you'll get the full report under 48 hours :)

Power House Creatives Logos FINAL.png

Hope you enjoyed! Matko.

Sort:  

Haha cool!

Imagine what google huge learning engines are doing with the data we all pump into social media!

Do non Americans care about the super bowl?

Posted using Partiko iOS

Not at all :D Ive just decided to always let it run on whatever is a "hot" topic :D I only know patriots and tom brady :D

No vida, už ti to šlape ;-)

Hah to hej, len to nikoho nezaujima :D

Congratulations! Your post has been selected as a daily Steemit truffle! It is listed on rank 14 of all contributions awarded today. You can find the TOP DAILY TRUFFLE PICKS HERE.

I upvoted your contribution because to my mind your post is at least 3 SBD worth and should receive 128 votes. It's now up to the lovely Steemit community to make this come true.

I am TrufflePig, an Artificial Intelligence Bot that helps minnows and content curators using Machine Learning. If you are curious how I select content, you can find an explanation here!

Have a nice day and sincerely yours,
trufflepig
TrufflePig

Hi, @matkodurko!

You just got a 0.56% upvote from SteemPlus!
To get higher upvotes, earn more SteemPlus Points (SPP). On your Steemit wallet, check your SPP balance and click on "How to earn SPP?" to find out all the ways to earn.
If you're not using SteemPlus yet, please check our last posts in here to see the many ways in which SteemPlus can improve your Steem experience on Steemit and Busy.

Keep it coming ... most folks in here love graphs.

Congratulations @matkodurko! You have completed the following achievement on the Steem blockchain and have been rewarded with new badge(s) :

You made more than 5000 comments. Your next target is to reach 5500 comments.

Click here to view your Board
If you no longer want to receive notifications, reply to this comment with the word STOP

To support your work, I also upvoted your post!

Support SteemitBoard's project! Vote for its witness and get one more award!

Hi @matkodurko!

Your post was upvoted by @steem-ua, new Steem dApp, using UserAuthority for algorithmic post curation!
Your UA account score is currently 3.606 which ranks you at #5840 across all Steem accounts.
Your rank has improved 8 places in the last three days (old rank 5848).

In our last Algorithmic Curation Round, consisting of 223 contributions, your post is ranked at #88.

Evaluation of your UA score:
  • You're on the right track, try to gather more followers.
  • The readers like your work!
  • Good user engagement!

Feel free to join our @steem-ua Discord server

@matkodurko You have received a 100% upvote from @botreporter because this post did not use any bidbots and you have not used bidbots in the last 30 days!

Upvoting this comment will help keep this service running.

Coin Marketplace

STEEM 0.31
TRX 0.11
JST 0.034
BTC 64060.81
ETH 3129.62
USDT 1.00
SBD 4.17