A Devtools driver for web automation and scraping
-
Updated
May 6, 2024 - Go
A Devtools driver for web automation and scraping
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
The unix-way web crawler
Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Go cascadia package command line CSS selector
Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
Golang Crawling and scraping framework
fast cmd-line app that quickly request millions of urls and save/echo the results
Yet Another Streaming Tool
Get Links (URL) of Instagram Stories in Go
A tutorial for building a web scraper in Golang
Learn how to scrape web content from HTML and see how web scraping differs to web crawling
DataHen useragent tool is a Golang package and standalone tool that generates a random combination of millions of user-agents strings. Currently used in production at DataHen to crawl/scrape through billions of pages.
DevRead - ứng dụng tổng hợp kiến thức cho developer
web scrape facebook post and extract data
Add a description, image, and links to the web-scraping topic page so that developers can more easily learn about it.
To associate your repository with the web-scraping topic, visit your repo's landing page and select "manage topics."