Skip to content

Speedy, lightweight web scrapper for Shutterstock.

License

Notifications You must be signed in to change notification settings

mouthoftiger/shutterscrape

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 
 
 

Repository files navigation

ShutterScrape

ShutterScrape is a web scrapper for bulk downloading images and videos from Shutterstock with speed. ⚡
It implements Selenium for browser automation and Beautiful Soup for parsing.


Setting up

  1. Install Python 2.7.

  2. Open terminal and enter the following lines:

pip install beautifulsoup4
pip install selenium
pip install lxml
  1. Install ChromeDriver.

  2. (Optional) Configure environment variables paths for python.exe and chromedriver.exe.


Running

Open terminal in the directory of shutterscrape.py and enter:

python shutterscrape.py

Go grab a cup of coffee while waiting... oh wait, it's already done!


Definitions

  • Search mode: Enter i for scraping images and v for scraping videos .
  • Number of search terms: For example, if you want to search for drone single person, enter 3.
  • Search term: Keyword(s) for searching on Shutterstock.
  • Number of pages to scrape: Higher number of pages means greater quantity of content with lower keyword precision.

Updates

4/26/2019
Updated for new shutterstock page layout as of 4/26/2019.

10/1/2018
Added GUI for save directory selection.

07/31/2018
More stability fixes.

07/25/2018
Added gettyscrape.py for scraping videos from Getty Images.

07/23/2018
Stability fixes.

About

Speedy, lightweight web scrapper for Shutterstock.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%