Steps to use Assuming git, ruby are installed and configured correctly. Build from source: git clone https://github.com/a2un/crawlpy.git cd crawlpy python __init__.py Type the url(with http://):https://about.gitlab.com #<url>