Skip to content

Web scrapper with the power of spiderman intuition

License

Notifications You must be signed in to change notification settings

mhilmyh/spiderman

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spiderman

There are many kinds of spiderman. But this spiderman will help you scrap the web.

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.

Prerequisites

What things you need to install the software and how to install them

PHP v5.3 or above

Installing

A step by step series that tell you how to get a development env running :

git clone [this repo]

Set env variable and do migration please:

php migration.php

And run the spiderman from runner:

php runner.php

Actually, you could edit the runner.php or any file as you want. I'm not providing any formal ways to do it.

Contributing

Please read CONTRIBUTING.md which is none. Sorry for that. Big thanks to every open source project that i used. Spiderman is nothing without them. Please also check their repos !

Authors

  • (only) me - Muhamad Hilmy Haidar

License

This project is licensed under the MIT License. Because it is automatically choosen as common permissive license.