Cant crawl, it print "-Only few posts" always

[s1011448]

User has more than 12 posts but after running the program, only print out -Only few posts

[timgrossmann]

@s1011448 Hi, I'm really sorry you're encountering this issue...
However, right now I unfortunately cannot put time into this project.
I'll try to fix all the persisting bugs as soon as I'm back in university and have more time to spare.

If you want to fix it yourself, I'm pretty sure myself and a lot of people would be interested in having this merged into this repository.

Thank you

[icebergyy]

I am getting the same issue. Any idea what could be causing the problem? I will take a look at the code

looks like there is an error going on in
https://github.com/timgrossmann/instagram-profilecrawl/blob/0a4415e3b76538401b326b87a265c217c1013645/util/extractor.py#L94

[s1011448]

@timgrossmann Sorry for bothering you. I am trying to fix it myself but still suffer problems, it seems that there's no load_button this element in the web page and some class name has changed. I would appreciate it very much if you have time to take a look at this project and give me some advice.

Thank you~

[deniskrafczyk]

same issue for me :/

[hadifar]

same issue here :(

[justdvl]

Hey guys, I fixed the bug, I'll try to contribute to it now (it is my first time working with GitHub so let me figure out how to do that).
The prev_divs needs to be changed to: prev_divs = browser.find_elements_by_tag_name('main')
Also the loading of page needs to be changed.
Then it works.

[justdvl]

What took me 2 hours to figure out is, that Instagram always only displays 30 pictures in it's code at the same time, that's the reason why I was only getting 30 links (and in InsaPy, the like by user feature also only do 30 likes).
I fixed it by getting links every time you move the page down, to get all of them line by line.

[justdvl]

Everything is working flawlessly,
I managed to do a Pull Request
It si my first time ever so hope I did all correctly 0-)

[guifelix]

@justdvl since you managed to fix it, did you do a pull request just in this project or in instapy as well?
btw, tnx for the fix!

[justdvl]

They already fixed it in Instapy, just pull requests take longer to get through as they want to make sure all is fine. Just be patient.
But honestly, this fix is super simple and I don't see what can go wrong there.
Meanwhile I also figured out even shorter way to write it..