Uploaded February 2018 | Updated September 2026, 2 weeks ago

---

I have made some web scrappers before. You can check it out here:
- youtube.com/watch?v=-vYiAfLDEVw
- youtube.com/watch?v=oQkIp1Bk_vg
- youtube.com/watch?v=pqAdxZWFkTM
and more.

It was so easy and fun work by using Beautiful Soup and Selenium.

This time I going to build a powerful Twitter scanner. Twitter provide three main APIs: the REST API, Streaming API, and the Ads API.

I will use Twitter Streaming API for gathering all related by a keyword tweets in real time. Yes - in real time!


First of all before all the work you must to create an application in your Twitter account. Then you will generate your Consumer ID, Secret keys, Token key and Token secret keys. You have to obtain credentials to be able to collect data from Twitter.

Before coding I recommend install requests-oauthlib 0.8.0 module from here: pypi.python.org/pypi/requests-oauthlib to your default Python directory.

Good is that my code will write the real time tweets to output csv file after each tweet is come to the pocket.

Next step: implement sentimental analysis for tweets. Still searching for solutions.

Vytautas Bielinskas
LinkedIn: linkedin.com/in/bielinskas