Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Profile Scraper #183

Closed
tahakorkmazTGA opened this issue Mar 16, 2021 · 5 comments
Closed

Profile Scraper #183

tahakorkmazTGA opened this issue Mar 16, 2021 · 5 comments

Comments

@tahakorkmazTGA
Copy link

I have made a profile scraper with same tools, but it's only been for the front page posts of the profile. After implementing the scrape for other pages and media links can we add this to the project.

Thanks

@neon-ninja
Copy link
Collaborator

neon-ninja commented Mar 29, 2021

This tool works for posts made by user profiles already

@tahakorkmazTGA
Copy link
Author

wait really? i couldn't manage to make it work and developed it myself though mine wasn't this complex

@neon-ninja
Copy link
Collaborator

Yes, you just need to pass cookies generally. For example, the code:

posts = list(get_posts("joe.trinder", pages=10, cookies="cookies.txt"))
print(len(posts))

returns

100

@tahakorkmazTGA
Copy link
Author

by cookies.txt do you mean the chrome's cookies after i login to the facebook?

@neon-ninja
Copy link
Collaborator

Yes, in Netscape format. See #28 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants