Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Contents of tweets are not complete #105

Closed
mcolemann opened this issue Aug 23, 2021 · 7 comments
Closed

Contents of tweets are not complete #105

mcolemann opened this issue Aug 23, 2021 · 7 comments

Comments

@mcolemann
Copy link

Hi!

I downloaded the .csv file but the text is not complete, somehow the application cut the text.
Do you know where is the problem?

Thanks a lot!
@igorbrigadir
Copy link

Are you perhaps looking at retweets? In that case, the original text is in retweeted_status and is truncated set to true?

@mcolemann
Copy link
Author

Thanks a lot for your answer.
Yes, I have problems with the retweets...
I don't have a variable called retweeted_status... Is it normal?
What should I do?

@edsu
Copy link
Member

edsu commented Aug 23, 2021

Yes, the CSV generation should be updated to use .retweeted_status.full_text when available. I can update that.

edsu added a commit that referenced this issue Aug 23, 2021
@edsu
CSV improvements
b2f3592 
This release adds the full text of retweets (using
.retweeted_status.full_text rather than .full_text). It also adds a
quote_id column for tweets that are quoting another tweet.

refs #105
@edsu
Copy link
Member

edsu commented Aug 23, 2021

Please give v0.3.0 a try. It should have the full text from the retweet. Thanks for noticing the problem and taking the time to enter an issue here.

@edsu edsu closed this as completed Aug 23, 2021
@mcolemann
Copy link
Author

Hi!
Thanks for your answer!
Should I rerun everything? Or can I somehow use the .jsonl files that I have so save time?

@edsu
Copy link
Member

edsu commented Aug 24, 2021 •
edited
Loading

@mcolemann I think you should be able to use the existing .jsonl files if your Hydrator app can still see them.

@mcolemann
Copy link
Author

Thanks for the very quick answers!
So, should I install the new version of the app and hope that it can read the "old" .jsonl files?
Are the .jsonl files complete or also there the content is cut?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@edsu @igorbrigadir @mcolemann