Skip to content

Teshager21/online-sales-data-scrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

61 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Amazon Best Selling Products Data Scraper

In this project, I wrote a script that scrapes data from Amazon webpage using ruby. The main goal of this project is to create an effective ruby code that solves real life problem. The project is used to demonstrate a complete project building skill utilizing git-flow, unit-testing, file organisation and leverage of best practices while underscoring softskills like the ability to mulittask and transform a business requirement into a software solution.

Built With

  • Ruby-2.5.1p57
  • nokogiri
  • httparty

screenshot screenshot

How to use this scrapper

  1. Make sure you have ruby installed Type ruby --version and see if you get the version number. If you don't have ruby installed use this link to know how to install it.
  2. Type install bundle and press enter to install dependencies 3.From the bin folder right click on the main file and select the open with the terminal option
  3. Type ruby main to run it
  4. Select the catergory of product you will like to scrap by typing the shortcuts within the parenthesis
  5. Press e to exit or stop scrapping

How to install using Command line

1. Click on the install or download button under the repository name and grab the url
by clicking on the clipboard icon

Step-1

2.open your terminal

3.Navigate to the location in your computer where you want the repo to be cloned

4. Type git clone  and paste the url you copied on step one.

    $ git clone https://github.com/YOUR-USERNAME/YOUR-REPOSITORY

5. Press Enter. Your local clone will be created.

            $ git clone https://github.com/YOUR-USERNAME/YOUR-REPOSITORY
            > Cloning into `Spoon-Knife`...
            > remote: Counting objects: 10, done.
            > remote: Compressing objects: 100% (8/8), done.
            > remove: Total 10 (delta 1), reused 10 (delta 1)
            > Unpacking objects: 100% (10/10), done.

Authors

👤 Author

🤝 Contributing

Contributions, issues and feature requests are welcome!

Feel free to check the issues page.

Show your support

Give a ⭐️ if you like this project!

Acknowledgments

📝 License

This project is MIT licensed.

About

This scrapper scrappes sales product data from Amazon for comparison against other sales sites

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages