Web Scraper

This project implements the use of Ruby Language to execute basic web scraping functionalities. The project scrapes through the Stack Overflow websites and gathers the job listing available on the website, orders them into a CSV file using the Job Title, Job tag, Company and Duration it was posted.

It allows for user to define a query based on any of Title, tag and company and receive a CSV file generated based on the results of the query.

Built With

• Ruby
• Nokogiri gem
• Open-URI
• CSV

Prerequisites

Run the following command:

• Run gem install bundler to install bundler.
• Run bundle install to install Nokogiri gem

Setup

• Clone the project to your local machine by running git clone https://github.com/crappypapa/Scraper.git in your terminal
• Cd into the project directory;

Usage

• Run ruby bin/main.rb.
• Navigate to the project directory and there will be a file called StackOverflow.csv
• Use the data for your needs.!

Run tests

To run tests:

• Run bundle install to install RSpec and Nokogiri.
• Run rspec in Command Line.

Authors

👤 Olaoluwa Soladoye

• Github: @crappypapa
• Twitter: @_laoluwa
• Linkedin: Olaoluwa

🤝 Contributing

Contributions, issues and feature requests are welcome!

Feel free to check the issues page.

Show your support

Give a ⭐️ if you like this project!

Acknowledgments

• Microverse.

📝 License

This project is MIT licensed.