Skip to content

This app allows you to extract data from web pages by specifying the URL and selecting HTML classes to scrape. No coding skills required!

Notifications You must be signed in to change notification settings

zuhaibbutt786/automatic-web-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 

Repository files navigation

#Web Scraping App Welcome to the Web Scraping App! This app allows you to extract data from web pages by specifying the URL and selecting HTML classes to scrape. No coding skills required!

#About Web scraping is a technique used to extract data from websites. This app simplifies the process and lets you scrape data easily. It uses the BeautifulSoup library for parsing HTML content and provides a user-friendly interface powered by Streamlit.

#How It Works Enter the URL of the website you want to scrape data from in the text box above. The app will fetch the available classes from the provided URL and display them as options. Select the classes you want to scrape data from using the multi-select dropdown. Click the 'Scrape' button to extract the data from the selected classes. The scraped data will be displayed in a table below. You can download the scraped data as a CSV file using the 'Download CSV' button.

#Tips for Successful Scraping Make sure you have proper permissions to scrape data from the website. Respect the website's terms of service and robots.txt file. Be considerate of the website's resources and avoid aggressive scraping. Test the app with different websites to ensure it works as expected. Regularly check and update the scraping code, as website structures may change.

#Contact for data science projects

✔ Email: zuhaibbutt3@gmail.com

✔ Linkedin: https://www.linkedin.com/in/zuhaib-hussain-butt-6628141a4/

✔ Whatsapp: +923167609216

About

This app allows you to extract data from web pages by specifying the URL and selecting HTML classes to scrape. No coding skills required!

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages