Parse descriptions from HTML commented out

[elvispoz]

Crawler does not download event descriptions...

[DaWe35]

You may only need one xpath correction in

Facebook-event-crawler/Crawlr.py

Line 260 in cac0845

event_description = tree.xpath('//div[@id="unit_id_886302548152152"]/div[2]/text()')

[elvispoz]

I know, but what is correct ?

[elvispoz]

Im testing with new selector but still does not effects...

event_description = tree.xpath('//div[@id="unit_id_886302548152152"]/section[1]/text()')

Have you got any idea?

[DaWe35]

section[1]

That's weird, section[1] need to work. Anyway, I think there is a Facebook release slipping - in my old facebook account <div> works, in my new account <section>, so we need to support all of them. Cool....

Can you try out event_description = tree.xpath('//div[@id="unit_id_886302548152152"]/section/text()') ? Anyway I don't understand why section[1] not works...

[elvispoz]

Descriptions in mysql are still empty :(

[elvispoz]

Have you got any idea and solution... ?

[DaWe35]

Have you got any idea and solution... ?

Sorry @elvispoz, today I have no time, I'll check it out later. Sometimes I need to work for money also :)

[DaWe35]

@elvispoz I just registered a new Facebook account, and everything works fine. Can you give me your Facebook account to have a try? If you followed my guide, you registered one only for FB crawler, so there is no personal data.
You can find me here: https://discord.gg/69SZC4v (I'm DaWe)

[elvispoz]

Hi,
Have you got any time for this? I see thet fb make some change in code and put description to:
<!-- xxx -->

[elvispoz]

Maybe it will be some solution...
https://stackoverflow.com/questions/44506990/getting-encoded-text-while-scraping-the-data-from-url-using-beautifulsoup-python

[DaWe35]

Is there anyone having the same issue?

[XinminHu]

Is there anyone having the same issue?

Hello, I followed all your guidances, and the crawler worked smoothly.
But there are no records downloaded, the 'events' table is always empty...
I am not sure which part went wrong...

[oblab]

Same here, the crawler is working, but 'events" table still empty...

[oblab]

python3 Crawlr.py                                                                                                                                                         
Logging in to facebook...                                                                                                                                                                     
0 old row deleted                                                                                                                                                                             
Pages are already updated less than an hour ago, no new events queried