I like to read web articles using an e-reader. But certain webpages, like the one of http://www.noahzender.com/ideas make it hard to export everything to a single page. I couldn't find any existing plugins/tools that can do this for me, so I wrote a tool.
Download the jar file from dist/scraper-*.jar and execute it or get the whole repository
and build it using lein uberjar.
$ java -jar scraper.jar <URL> <LINK CLASS> <TITLE CLASS> <CONTENT CLASS> [OUTPUT FILE]
Concrete example: $ java -jar scraper.jar "http://www.noahzender.com/ideas" "essay-link"
"page-title" "prose-site" "/tmp/ideas.md"
If you don't set an output file the default is /tmp/pages.md
- There's no error handling, because I don't like exceptions
- The tests were automatically generated by an LLM
Copyright © 2026 Sakis Kasampalis
This program and the accompanying materials are made available under the terms of the Eclipse Public License 2.0 which is available at http://www.eclipse.org/legal/epl-2.0.
This Source Code may also be made available under the following Secondary Licenses when the conditions for such availability set forth in the Eclipse Public License, v. 2.0 are satisfied: GNU General Public License as published by the Free Software Foundation, either version 2 of the License, or (at your option) any later version, with the GNU Classpath Exception which is available at https://www.gnu.org/software/classpath/license.html.