Sample Repository with basic web scrapping
I'm Sumanth,
-
Python 3 🐍
-
The below mentioned Python Packages 📦
pip install lxml
pip install Scrapy
pip install requests
pip install gTTS
(Optional)
LXML:
lxml is a Pythonic, mature binding for the libxml2 and libxslt libraries. It provides safe and convenient access to these libraries using the ElementTree API.
Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
Requests is a simple, yet elegant, HTTP library. Requests allows you to send HTTP/1.1 requests extremely easily. There’s no need to manually add query strings to your URLs, or to form-encode your
PUT
&POST
data — but nowadays, just use thejson
method!
gTTS:
gTTS (Google Text-to-Speech), a Python library and CLI tool to interface with Google Translate's text-to-speech API. Write spoken
mp3
data to a file, a file-like object (bytestring) for further audio manipulation, orstdout
. Or simply pre-generate Google Translate TTS request URLs to feed to an external program.