Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

web4agent

Web reader CLIs built on Camoufox (anti-detect Firefox).

murl — markdown url

Fetch a webpage with Camoufox and print it as Markdown, curl-style:

$ murl https://en.wikipedia.org/wiki/Markdown

# Markdown

| Markdown |  | 
|---|---|
| [Filename extensions](https://en.wikipedia.org/wiki/Filename_extension) | `.md` ,`.markdown` ... |
| [Internet media type](https://en.wikipedia.org/wiki/Media_type) | `text/markdown` ... |
...

Options:

  • --raw — print raw HTML instead of extracted Markdown
  • --js JS — run a JS function/expression in the page before extraction (repeatable)

If less than 200 chars can be extracted, murl warns and exits non-zero — try --raw.

Install

pip install web4agent

Python >= 3.10. Extraction is done by trafilatura in Markdown mode with links.

License

MIT — see LICENSE.

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages