Mtlarchive.com parser

[TheFirstProgenitor]

Can you please create a parser for mtlarchive.com

[Kiradien]

Looks like this page is also under cf and has the same 403 issues creating a parser as Fanfiction.net currently has.

Generic parameters look like they would have worked fine if w2e could open the page.

The fix for #1306 might need to be a bit more far-reaching than originally intended.

[dteviot]

@Kiradien

Actually, looking at the site, it would need a custom parser. The content for the chapters is not in the HTML pages, instead it's JSON that is obtained by a REST call. (So I don't know why they're bothering with CF.)

[dteviot]

Also, duplicate #1310

[dteviot]

@TheFirstProgenitor @Kiradien

Test versions for Firefox and Chrome have been uploaded to https://drive.google.com/drive/folders/1B_X2WcsaI_eg9yA-5bHJb8VeTZGKExl8?usp=sharing. Pick the one suitable for you, follow the "How to install from Source (for people who are not developers)" instructions at https://github.com/dteviot/WebToEpub/tree/ExperimentalTabMode#user-content-how-to-install-from-source-for-people-who-are-not-developers and let me know how it goes.
Tested with:

• https://mtlarchive.com/novel/invincible-god-of-killing-system, chapters 1 to 4 (story with 690 chapters)
• https://mtlarchive.com/novel/i-starting-from-celestial-dragons-infinite-summons, chapter 1, (story with 190 chapters, i.e. 2. ToC pages)
• https://mtlarchive.com/novel/navigation-start-with-celestial-dragons-and-take-down-hancock, chapter 1. (Story with 65 chaters. i.e. 1 ToC page)

Note, did not try to fetch above chapter 100, that required a subscription.

For my notes: 171 minutes work
Some time lost dealing with bug with Clouldflare cookies when site doesn't have cookies.
But mostly due to difficulty in REST calls to get Chapters.
Having to search array of objects for novel ID was ugly.

[1k-7]

[1k-7]

Already logged in

[1k-7]

@dteviot it doesn't work?

[dteviot]

@1k-7
You're using firefox? You might need to open a chapter normally to trigger the Cloudflare "are you a human" page.
I just tested desktop version. Got chatpers 1 to 3. (Which is all I tried for)

[dteviot]

Did have to make a fix for https://mtlarchive.com/novel/i-can-copy-talent-novel. Novel ID was in position 23 of the array. Updated test versions on Google Drive.

[1k-7]

@1k-7 You're using firefox? You might need to open a chapter normally to trigger the Cloudflare "are you a human" page. I just tested desktop version. Got chatpers 1 to 3. (Which is all I tried for)

It works...

[dteviot]

@TheFirstProgenitor

Updated version (0.0.0.160) has been submitted to Firefox and Chrome stores.
Firefox version is available now.
Chrome might be available in a few hours to 21 days.