Batoto downloads failing

[GatesDA]

Probably related to #112. Checking seems to work, though.

[sureyeaah]

Two problems are arising with the new changes:

1. The list of chapters isn't shown for any manga.
2. The HTML parser isn't able to get the image links for the chapters. But once the image links have been generated, the downloading doesn't face any issues since the images are still accessible by member & non-members alike.

[japzone1]

It seems Batoto has put older chapters behind a login wall. So you now need to login with a free account before getting proper access to the chapters. This means FMD will need to have some kind of login ability added if Batoto is to still be supported.

[corpse69]

even with a log on ability i think it wont work unless we have some way to make it look like we are reading without it resulting in a ban now

[sureyeaah]

A ban is the least of our worries since we can create a new account. Until the problem is fixed, download managers are the only viable option besides hakuneko maybe(it sucks on low internet speed/unstable internet connection).

[nille02]

corpse69 why should they ban simple users? i doubt that they ban users that has a high view frequency on some manga. fmd is not a crawler that catch everything that it can get.

plus, new pages should also seen by guest users, but only older pages are for registered users. e.g. i can see (and view) new pages (new after the change) even as a unregistered user.

So. fmd has first only to take care of the new way like pages are displayed.

[corpse69]

i see, i was worried big time over almost nothing it was sad to see i couldnt download from batoto

[MarcusGHub]

Not working for me either, I had to resort to MangaFox and MangaHere, both have poor qualities.

[Tenome]

FMD hasn't been touched in 2 months, so this may very well be abandoned.

[yuushin51]

you know what's more sad to me ? instead of them abandon without a word, they may have gotten into accident and passed away, first akarink, now riderkick

[corpse69]

i hope not, FMD is the best out there by FAR.

im getting alittle edgy by not being able to download from batoto, and to a lesser extent mangafox

[nille02]

corpse69 the fastest way is to learn a bit about pascal and fix it.

Most parts like scanning for new pages, the list etc are still working. but get the pages seems to be broken now. after a first look its now all build in js

[Wolfpup67]

I might try to help work on getting the issue corrected but I could not even get the build environment set up properly. I could get the ide installed on my system but the other requirements would not install to the ide.

[corpse69]

i wouldnt know where to begin, on top of that a total nub ill give learning a go though

[mikazuki7]

-you know what's more sad to me ? instead of them abandon without a word, they may have gotten into accident and passed away, first akarink, now riderkick

wait, did akarink died in accident?

[R-Jimenez]

FYI, Kissmanga loads incredibly fast, and for the vast majority of series is identical to bato.to's pulls, so I've been shuffling favorites over to them where I can (Their selection is not /as/ robust as Bato's, especially for brand-new series).

Hoping rider is doing well and comes back to us soon. We're missing our messiah. [-|-]/

PS. If anyone can point me to the actual file that does the pulling, that'd be much appreciated. Don't have time or willpower to dive through all of the code, but wouldn't be against spending some time over lunch if I had a starting point.

[yuushin51]

@mikazuki7 "may have", i'm not sure, just guessing
@R-Jimenez currently the program can still get the chapter url but not the page url, and the old page url is something like chapterurl, chapterurl/2, chapterurl/3, ... but now it's chapterurl, chapterurl_2, chapterurl_3 so I'm guessing it's FMD/baseunits/modules/Batoto.pas
if DownloadThread.GetPage(TObject(Parse), FillHost(Module.RootURL, URL) +
'/' + IntToStr(DownloadThread.workCounter + 1)
change, '/' into '_' and we're good (or so I think), but I can't set up the environment to compile it

[R-Jimenez]

@yuushin51 Huh, I see. Don't know why I was thinking it was a core engine problem and not simply in the Batoto file. When I get off work I'll see if I can't get the environment set up, and try the fix.

[R-Jimenez]

Synapse is broken under MacOS, and it doesn't seem supported for Win64. Lazarus is strange but manageable so I'd be fine with tinkering with it, but with this issue I don't know if I want to break out a new linux environment during my weekend for this. May pass it off to someone more readily available.

[corpse69]

well guys kiss manga still works with domdomsoft it also works with batoto for now

[Nandaka]

Anyone able to setup a dev environment Win7 using Lazarus? For some reason, I cannot add the library for Virtual Tree View and InternetTools.

[Ianunaut]

Holy shit -- riderkick, you're back? You're my favorite person on the face of this planet!

[sureyeaah]

Please fix the Batoto issue Riderkick!!

[riderkick]

I added cookies to advanced.ini
you can use it as workaround for ba toto.
login to batoto. in your browser use inspect element>network look for root page, there is cookies in there.
put your cookies and user-agent of your browser in config/advanced.ini. Do not log out from your browser.

[UserAgent]
Batoto=your browser user agent

[Cookies]
Batoto=your account cookies

[Nandaka]

@riderkick

What is the format for the cookie? is it from the password hash or from session? what is the format? or just paste the value?

[Tenome]

Seems to work, as far as downloading goes, but it only seems to display the most recent uploads.

http://puu.sh/lxWxT/07db4d3261.png

[riderkick]

http://srv01.hulkimge.com/i/00000/libkhoqtasu4.jpg

[Tenome]

Ah, right, Batoto has that "you can only view the most recent chapter" thing now, which means I probably didn't log in correctly with advanced.ini.

[sureyeaah]

What files do I need to move from the previous previous to the new one to retain my previous settings?

[InstallShieldWizard]

Thanks!

[riderkick]

All of them.

[Tenome]

Seems to be working, I'll test some downloads.

[woddenlock]

Can you give me a step by step?I put both user agent and session id but it still only loaded the most recent chapters.

[nille02]

If you use firefox. Press F12 and the developer tools open. Go on the Tap Network and press the load or reload button.

The first entry should be "200 GET / bato.to".
Klick on it and on the right side there is now a list with iormations. In this are the 2 needed strings.

And look in you config folder. i had to create the config file first.

[woddenlock]

Can you put a screenshot of .ini files.This is mine

[nille02]

You comment the lines out. Remove the ; and write it like riderkick
e.g. this are my config.

[UserAgent]
Batoto=Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:42.0) Gecko/20100101 Firefox/42.0

[Cookies]
Batoto=member_id=bla; pass_hash=blub; rteStatus=rte; session_id=foo

[corpse69]

woo got it working thanks nille02now my next problem is getting a current list of new manga x.x

[woddenlock]

it works thanks a lot guys

[lazypete365]

I've tried it with a few manga and it generally works, but "A Fairytale for the Demon Lord" fails for some reason. After copying the cookie and user agent it gets the whole chapter list without a hitch, but when I try to download a chapter (any chapter) it prepares to download a single page and then says "Failed, try resuming this task" (which doesn't work).

I suspect it's an issue with long-strip format manga, because Onepunch-man (the original version) gives the same error.

[SilentNN]

I'm not 100% certain that I have my advanced.ini right, though I believe it is. I can see the full chapter lists, but downloading doesn't work even with recent chapters. I tried this on Kingdom, Horimiya, and RPG.

[Ianunaut]

riderkick, I love you and I want you to know that I love you.

That said, I'm still having issues with some manga -- namely, Happy if You Died, Koi Inu, ReLIFE, and Tomo-chan wa Onna no ko! The downloads keep failing no matter what. Everything else on my favorites list and any new manga I pick up work fine. I can't really see the reason behind those four manga failing, such as sharing a certain string or anything.

[lazypete365]

@Ianunaut Those do have one thing in common: they are long-strip format manga. And so are RPG and at least one version of Horimiya, as pointed out by @SilentNN. Kingdom isn't, but it seems to be working fine for me.

I think we have hit the same bug, at least in part. The web reader works in a slightly different way for long-strip format manga. @riderkick probably fixed FMD to account for any changes in the normal viewer, but if they did something different to the long-strip viewer then those fixes don't work there.

[Ianunaut]

Ah right, totally missed your comment a week ago. That would certainly explain it.