MathJax Rendering

[ashish01]

Thanks for creating this tool and selecting a great name!. In the time where everything is in cloud, its great to know that I can avoid surprises when I want to read something later.

I found an issue with pages containing math notations. e.g. https://lilianweng.github.io/lil-log/2021/05/31/contrastive-representation-learning.html contains text which is rendered as

But in the saved monolith file its rendered as

Does it fall within the scope of this tool to be rendered correctly?

Thanks!

[snshn]

Hi there @ashish01!

It looks like MathJax.js gets pulled from cloudflare, and it has JS sub-modules that must be loaded later. Basically inside the browser it happens when you render the page and execute JS, but monolith doesn't feature a JS engine, it never renders the page, only parses the DOM, so the main JS file gets pulled while its sub-modules fail to get retrieved.

There are a few ways around that:

1. Save page as file+dir via your browser, then use monolith on that locally saved HTML file... the locally saved HTML should have HTML altered by JS, with JS sub-modules linked via DOM. Basically monolith -I /tmp/non-monolithic-web-page.html -o monolithic-web-page.html && rm -rf /tmp/non-monolithic-web-page.html /tmp/non-monolithic-web-page_files.
2. Attempt to use the -b option, e.g. monolith http://remote-resource.com/page.html -o temp.html && monolith -b http://cloudflare.com/lib/some-lib/modules/ temp.html -o final-result.html && rm temp.html. Will still require internet connection to load those JS sub-modules, but not require saving it via browser first.

SingleFile could do a better job, since that one has a built-in JS/HTML engine that renders the page.

[ashish01]

Thanks for taking time to give such a detailed reply. I did try SingleFile and it worked just fine. Thanks!

[snshn]

@ashish01

Here you go dear sir:

chromium --headless --disable-gpu --dump-dom https://lilianweng.github.io/lil-log/2021/05/31/contrastive-representation-learning.html | monolith - -b https://lilianweng.github.io/lil-log/2021/05/31/contrastive-representation-learning.html -o mathjax.html -Ij