Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Site support: twitpic.com #1155

Closed
nisehime opened this issue Sep 1, 2019 · 8 comments
Closed

Site support: twitpic.com #1155

nisehime opened this issue Sep 1, 2019 · 8 comments

Comments

@nisehime
Copy link

nisehime commented Sep 1, 2019

This is the part of twitter. Examples: https://twitter.com/saishow/status/338316793921806336

https://twitter.com/search?q=from:saishow%20since:2012-12-01%20until:2013-06-01%20filter:media&src=typd

This appears on old tweets. Most of those links are just direct links to images, so I guess shouldn't be big problem. Many of them also are dead, but still.

@KurtBestor
Copy link
Owner

Try the test version: https://github.com/KurtBestor/Hitomi-Downloader-issues/releases/tag/Technical-Preview

It may fixes most of the problems.

@nisehime
Copy link
Author

nisehime commented Sep 4, 2019

Thanks so much! And sorry, I forgot to add that not all twitpic urls are searched with filter:~ operator or on /media page. So it needs a separate search with query like that from:user twitpic.com. (https://twitter.com/search?f=tweets&vertical=default&q=from:saishow%20twitpic.com&src=typd)

I tested the same artists as the last time and everything is ok, some of them have even more because of twitpic. No errors occured.

@nisehime
Copy link
Author

nisehime commented Sep 7, 2019

So, could you do it? Just add this search query to the end of the grabbing process, so it would work like that: 1. media 2. from:x filter:media 3. from:x twitpic.com

@KurtBestor
Copy link
Owner

No, it doesn't work. What i'm currently doing is:

  1. Search in /media with &max_position=xxxx
  2. Search by from:xxxx max_id:xxxx exclude:retweets filter:media -filter:periscope
  3. Search by from:xxxx max_id:xxxx exclude:retweets filter:media -filter:periscope with &max_position=xxxx

There is no result in the search by from:xxxx twitpic.com from the beginning.
I could try search in every single periods, but it takes too many requests and time.

@nisehime
Copy link
Author

nisehime commented Sep 8, 2019

There is no result in the search by from:xxxx twitpic.com from the beginning.

What do you mean? I try this https://twitter.com/search?f=tweets&vertical=default&q=from:saishow%20twitpic.com&src=typd and there are results present.

@KurtBestor
Copy link
Owner

image

Twitter behaves very strangely.
It returns different results vary depending on whether it has referer or not, vary from user agent to user agent, and even vary from IP to IP.
It's really hard to understand how it works.

@nisehime
Copy link
Author

nisehime commented Sep 8, 2019

@KurtBestor
That's true. I had this bug(?) too. It worked for me after I reload the page a few times.

@stale
Copy link

stale bot commented Dec 7, 2019

This issue has been automatically marked as stale because it has not had recent activity. It will be closed after 30 days if no further activity occurs, but feel free to re-open a closed issue if needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants