Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect values of stored objects #13

Open
minamotorin opened this issue Jul 20, 2022 · 1 comment
Open

Incorrect values of stored objects #13

minamotorin opened this issue Jul 20, 2022 · 1 comment
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed

Comments

@minamotorin
Copy link
Owner

When outputting the result to CSV etc., the value will be corrupted in some keys.
The cause of this issue is twint doesn't keep up completely with update to (unofficial) Twitter API spec.
For output to the database, an error occurs and it does not work.

This is the meaning of that fixing of twintproject#1335 is incomplete.

For fixing this, it is necessary to compare the previous Tweet objects (I think this is same as Tweet objects of user timelines) and the current Tweet objects and make the structure the same.
There will be differences between Tweet objects of Twitter search and Tweet objects of user timelines.

@minamotorin minamotorin added bug Something isn't working help wanted Extra attention is needed good first issue Good for newcomers labels Jul 20, 2022
minamotorin added a commit that referenced this issue Jul 20, 2022
@Tortar
Copy link

Tortar commented Jul 20, 2022

I checked the Tweet object and these are its attributes

['__class__', '__delattr__', '__dict__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', '__weakref__', 'cashtags', 'conversation_id', 'datestamp', 'datetime', 'geo', 'hashtags', 'id', 'id_str', 'lang', 'likes_count', 'link', 'mentions', 'name', 'near', 'photos', 'place', 'quote_url', 'replies_count', 'reply_to', 'retweet', 'retweet_date', 'retweet_id', 'retweets_count', 'source', 'thumbnail', 'timestamp', 'timezone', 'trans_dest', 'trans_src', 'translate', 'tweet', 'type', 'urls', 'user_id', 'user_id_str', 'user_rt', 'user_rt_id', 'username', 'video']

The relevant ones are all already included in write_meta.py for storage, so I think that the structure is actually the same. I also tested search and timeline command which work. I think then that #11 could be merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants