This section is designed to contain the packages I create as well as the code I used for my research (most often, after the paper is accepted in a journal). I will also provide a curated list of packages that I found to be particulary useful in the past.
Packages:
- random-scraper: Tools for Web-Scraping
This package provides simple methods for scraping data anonymously and avoid getting your IP blocked by web servers. In particular, a better approach consists in using proxy servers to change IP addresses over time as well as user agents. There are both free and paid proxy servers available online. Unfortunately, the free proxies may be slow and unreliable which may result in missing data.
This package automatically collects and updates available free proxies online. It also provides a list of user agents and a user-friendly tool to request a page anonymously.
[GitHub] [PyPI]
- Tools for Social Network Analysis
In Construction
Most of my papers are currently in the review process. I will release the code once they are accepted.
Useful Packages:
- NetworkX
This package contains most tools required to handles social networks on Python.
- DyNetx
Built upon NetworkX, this package extends the analysis to dynamic networks.