Skip to content

crawley-project/crawley3-toolbox

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Crawley3 Toolbox

Crawley Toolbox implementation for python3 using asyncio.

###Requirements

  • python >= 3.3
  • asyncio
  • aiohttp

###Example

from src.crawlers import BaseCrawler

class PyCrawler(BaseCrawler):

    start_urls = ["http://python.org"]

if __name__ == "__main__":
    crawler = PyCrawler(debug=True)
    crawler.start()

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%