Skip to content

Using scrapy library to crawl in Google Play and scrap apps information.

Notifications You must be signed in to change notification settings

mark-lvl/googleplay_crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

googleplay_crawler

This crawler was written in Python by Scrapy framework in order to scrape content of Android applications which are published in Google Play store.

You can deploy it on ScrapingHub or easily set a daemon in your personal machine by scrapyd and start to scraping items.

How to Run

First, make sure you are in project directory and then easily run the crawler by following command:

scrapy crawl gapps -o OUTPUTFILENAME.EXT

For example, if you're going to export your data in csv format in your current directory, you can run:

scrapy crawl gapps -o apps_data.csv

Note

This repository is under development. Upcoming features:

  • Implementing tags support in order to toggle fields in output
  • Configuring AutoThrottle feature
  • Setting USER-AGENT and corresponding settings

About

Using scrapy library to crawl in Google Play and scrap apps information.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages