This is the code repository for Hands-On Web Scraping with Python - Second Edition, published by Packt.
Extract quality data from the web using effective Python techniques
Web scraping is a powerful tool for extracting data from the web, but it can be daunting for those without a technical background. Designed for novices, this book will help you grasp the fundamentals of web scraping and Python programming, even if you have no prior experience.
This book covers the following exciting features:
- Master web scraping techniques to extract data from real-world websites
- Implement popular web scraping libraries such as requests, lxml, Scrapy, and pyquery
- Develop advanced skills in web scraping, APIs, PDF extraction, regex, and machine learning
- Analyze and visualize data with Pandas and Plotly
- Develop a practical portfolio to demonstrate your web scraping skills
- Understand best practices and ethical concerns in web scraping and data extraction
If you feel this book is for you, get your copy today!
All of the code is organized into folders. For example, Chapter02.
The code will look like the following:
source.find(‘a:contains(“Web”)’) # [<a.menuitm>, <a>, <a>, <a>,
<a>]
source.find(‘a:contains(“Web”):last’).text()
# ‘Web Scraper’
source.find(‘a:contains(“Web”):last’).attr(‘href’) # ‘#’
Following is what you need for this book: This book is for beginners who want to learn web scraping and data extraction using Python. No prior programming knowledge is required, but a basic understanding of web-related concepts such as websites, browsers, and HTML is assumed. If you enjoy learning by doing and want to build a portfolio of web scraping projects and delve into data-related studies and application, then this book is tailored for your needs.
With the following software and hardware list you can run all code files present in the book (Chapter 1-12).
| Chapter | Software required | OS required |
|---|---|---|
| 1-12 | Python 3.11 | Windows, macOS, or Linux |
| 1-12 | Google Chrome or Mozilla Firefox | Windows, macOS, or Linux |
| 1-12 | Visual Studio Code or JetBrains PyCharm Community Edition | Windows, macOS, or Linux |
Anish Chapagain is a software engineer with a passion for data science, and artificial intelligence, its processes and Python programming, which began around 2007. He has been working with web scraping, data analysis, visualization and reporting-related tasks, projects for more than 10 years, and is also working as freelancer. Anish previously worked as a trainer, web/software developer, team leader, and as a banker, where he was exposed to data and gained further insights into topics like data mining, data analysis, reporting, information processing and knowledge discovery. He has an MSc in computer systems from Bangor University (United Kingdom), and an Executive MBA from Himalayan Whitehouse International College, Kathmandu, Nepal.