#
crawling
Here are 39 public repositories matching this topic...
[READ-ONLY] A word extractor for Wikipedia articles.
-
Updated
Apr 8, 2024 - Go
This is a really simple link crawler for pages with sitemap.xml available.
-
Updated
Apr 18, 2023 - Go
Turn any website into an API with BrowserBro.
go
api
golang
scraper
automation
chrome-devtools
devtools
crawling
web-scraping
webscraping
browserbro
-
Updated
May 16, 2024 - Go
Another personal website indexer, this time in Golang and using Selenium webdriver. Please note: This is the new official repo for the project, old C++ and Rust versions are now closed, please follow this repo for updates.
golang
search-engine
crawler
automation
scraping
crawling
indexing
indexer
cybersecurity
cyber-security
content-discovery
content-detection
cybersecurity-tools
-
Updated
May 26, 2024 - Go
Improve this page
Add a description, image, and links to the crawling topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the crawling topic, visit your repo's landing page and select "manage topics."