Skip to content
This repository has been archived by the owner on Feb 28, 2023. It is now read-only.

Only 50 latest conversations are downloaded in "All conversations" mode #8

Closed
Mincka opened this issue Nov 8, 2016 · 2 comments
Closed
Assignees
Labels

Comments

@Mincka
Copy link
Owner

Mincka commented Nov 8, 2016

From #7:

I think I may have an idea why all the threads have not been downloaded the first time. I've counted all the threads in your previous message and found exactly 50 conversations. Currently, to find "all" the conversation IDs, the script loads the conversations available on the "first" "Messages" page but do not simulate scrolling to load more. I though that all the conversations were listed directly.

My guess is that when you scroll down through all the conversations, at the bottom, Twitter loads the next 50 conversations. I did not identify this case because I have a lot less than 50 conversations on Twitter! But it's an interesting case and I'm going to open a new ticket to improve the "all threads" mode which is in fact a "latest 50 conversations" mode it seems.

@Mincka Mincka added the bug label Nov 8, 2016
@Mincka Mincka self-assigned this Nov 8, 2016
@Mincka
Copy link
Owner Author

Mincka commented Nov 8, 2016

I need help for this one. I don't know which HTTP request is done by Twitter to load the next 50 private conversations in the "Messages" popup.

@Mincka Mincka removed the help wanted label Nov 9, 2016
@Mincka
Copy link
Owner Author

Mincka commented Nov 9, 2016

Ok, so the flow is:

  1. https://twitter.com/messages (min_entry_id=XX1 & has_more=True)
  2. https://twitter.com/messages?max_entry_id=XX1 (min_entry_id=XX2 & has_more=True)
  3. https://twitter.com/messages?max_entry_id=XX2 (min_entry_id=XX3 & has_more=True)
    ...
  4. https://twitter.com/messages?max_entry_id=XXY (missing min_entry_id & has_more=False)
  5. End

@Mincka Mincka closed this as completed in 04d8b5e Jun 27, 2017
Mincka pushed a commit that referenced this issue Jun 27, 2017
Images and GIFs are prefixed with a timestamp
All the conversations are now retrieved (not only the 20 or 50 latest). The number of found threads is displayed.
The path of the written conversation is displayed in the console
Emojis are now written as Unicode instead of their description
Dedicated behavior for macOS (Darwin) for emojis is removed
Description (alt text) of stickers is written in the log
Update of all dependencies
Binaries are built with Python 3.4 (downgrade from 3.5) to improve compatibility
Version and Python version and platform are displayed at startup
Refactoring (pep8, lint)
Mincka added a commit that referenced this issue Jun 27, 2017
Images and GIFs are prefixed with a timestamp
All the conversations are now retrieved (not only the 20 or 50 latest). The number of found threads is displayed.
The path of the written conversation is displayed in the console
Emojis are now written as Unicode instead of their description
Dedicated behavior for macOS (Darwin) for emojis is removed
Description (alt text) of stickers is written in the log
Update of all dependencies
Binaries are built with Python 3.4 (downgrade from 3.5) to improve compatibility
Version and Python version and platform are displayed at startup
Refactoring (pep8, lint)
Mincka added a commit that referenced this issue Jun 27, 2017
Images and GIFs are prefixed with a timestamp
All the conversations are now retrieved (not only the 20 or 50 latest). The number of found threads is displayed.
The path of the written conversation is displayed in the console
Emojis are now written as Unicode instead of their description
Dedicated behavior for macOS (Darwin) for emojis is removed
Description (alt text) of stickers is written in the log
Update of all dependencies
Binaries are built with Python 3.4 (downgrade from 3.5) to improve compatibility
Version and Python version and platform are displayed at startup
Refactoring (pep8, lint)
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant