Web Scraping using Python, Data mining , Data Analyzing & Data Visualization of the collected Data.
These instructions will get idea of the project up and running on your local machine for development and Execution purposes. See deployment for notes on how to deploy the project on a live system.
The python script is written to fetch all the individual categories from the website (http://www.xyz.com ), The code is written for fetching the data from the first page and it iterates to each and every pages of website ( activities, categories, count of bought), and I used statistical techniques for mathematically analysis and presenting the data into visualization
What things you need to install the software and how to install them
Python2/Python3
- requests - The Web site Requests: HTTP for Humans
- Pandas - The Web site Pandas
- bs4 - The Web site beautifulsoup4 4.6.0
- Matplotlib - The Web site Matplotlib
- RegularExpression - The Web site RegularExpression
A step by step have to get a development env running
step 1. python2 or python3
step 2. pip install bs4
step 3. pip install requests
step 4. pip install re
step 5. pip install pandas
step 6. pip install matplotlib
Enter terminal or console windows/Linux/mac.
Like : python filename
- Documents - Complete Project details ppt
python Filename
- Niranjan Kumar G S - Complete work - Github
- Email : niranjan4@outlook.in