Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Not able to get all the tweets from 21st March 2006 to till date #118

Closed
NileshJorwar opened this issue Jun 1, 2018 · 10 comments
Closed

Not able to get all the tweets from 21st March 2006 to till date #118

NileshJorwar opened this issue Jun 1, 2018 · 10 comments

Comments

@NileshJorwar
Copy link

I dont get all the tweets for the given period. Sometimes i get very less say 300 , sometimes 1100 though there are total over 10000 tweets. Why so???
@lapp0
Copy link
Collaborator

lapp0 commented Jun 2, 2018

Can you post the query?

@NileshJorwar
Copy link
Author

As of now there are 27.6K tweets of Amazon and i provided below query
twitterscraper amazon -l 28000 -bd 2006-03-21 -ed 2018-06-02 -o amazontweets.json
and it returned me with 368 tweets along with errors and also please find the below console output....

INFO: Got 0 tweets (0 new).
INFO: Got 0 tweets (0 new).
INFO: Got 0 tweets (0 new).
INFO: Got 0 tweets (0 new).
INFO: Got 8 tweets (8 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
INFO: Got 8 tweets (0 new).
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16731009854-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init_.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16731009854-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102566603182081-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102566603182081-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730947989-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102566603182081-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102566603182081-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730887702-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102566603182081-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730827593-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102372134313985-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730769833-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730718687-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730718687-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730633410-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730633410-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730633410-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730614859-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730579148-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730579148-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730551732-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730551732-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-675102169364832256-675102692721762305&q=amazon%20since%3A2015-05-03%20until%3A2015-12-11&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Giving up.
INFO: Got 108 tweets (100 new).
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730551732-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730551732-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730551732-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730495417-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730495417-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730495417-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730495417-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Failed to parse JSON "Expecting value: line 1 column 1 (char 0)" while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=TWEET-16730458419-16731044816&q=amazon%20since%3A2009-11-12%20until%3A2010-06-22&l=None".
Traceback (most recent call last):
File "c:\users\niles\anaconda3\lib\site-packages\twitterscraper\query.py", line 46, in query_single_page
json_resp = response.json()
File "c:\users\niles\anaconda3\lib\site-packages\requests\models.py", line 892, in json
return complexjson.loads(self.text, **kwargs)
File "c:\users\niles\anaconda3\lib\json_init.py", line 354, in loads
return _default_decoder.decode(s)
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "c:\users\niles\anaconda3\lib\json\decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR:root:Giving up.
INFO: Got 368 tweets (260 new).

@NileshJorwar
Copy link
Author

In addition to that I always get random tweets for the given period sometimes i will get few hundreds sometimes in thousands

@lapp0
Copy link
Collaborator

lapp0 commented Jun 3, 2018

What do you mean by random tweets? You mean tweets which you wouldn't expect to be in the results because they don't have a matching string? Does their username match?

@lapp0
Copy link
Collaborator

lapp0 commented Jun 3, 2018

Seems possible that you are getting the issue discussed here #115

Could you try running it using the branch mentioned here? #115 (comment)

@lapp0
Copy link
Collaborator

lapp0 commented Jun 3, 2018 •
edited

FYI, I ran it locally using that branch, I and I have 497475 tweets between 2006-03-20 and 2009-08-30 mentioning Amazon.

taspinar added a commit that referenced this issue Jun 13, 2018
@taspinar
query.py : remove fake_useragent
a1055d9 
useragents will no longer be generated with the fake_useragent package.
At the moment seven of the most popular useragent strings are written hardcoded in query.py
In later stages this should be done via a separate module.

This fixes #118,
#115,
#90
@taspinar
Copy link
Owner

I believe that most of the 'not being able to get all tweets' issues are caused by the useragent provided by fake_useragent.
I have removed fake_useragent as an dependency all together. See PR #119

Once this PR is merged, the newest versions should no longer have these issues.

Can you guys have a look at the PR?

@NileshJorwar
Copy link
Author

Though, the fake useragent is removed and provided with 200000 as count to retrieve the tweets , gives me around 100000 tweets. Is this ration would be always be there??

@lapp0
Copy link
Collaborator

lapp0 commented Jun 20, 2018

@NileshJorwar are you saying that with one useragent produces 200000 results and another useragent produces 100000 results for the same query?

@NileshJorwar
Copy link
Author

@lapp0
No, as a whole when I am giving 200000 as LIMIT parameter it only gives me 100000 tweets.

@lapp0 lapp0 mentioned this issue Jun 20, 2018
Closed
meticulousfan added a commit to meticulousfan/scraping-site that referenced this issue Aug 19, 2022
@meticulousfan
Remove fakeuseragent (#119)
514a056 
* query.py : remove fake_useragent, move separate try / except

- useragents will no longer be generated with the fake_useragent package.
At the moment seven of the most popular useragent strings are written hardcoded in query.py
In later stages this should be done via a separate module.
-By removing the separate try / except for the JsonDecodeError, each process now also continues with retrying to get the data instead of exiting.

This fixes taspinar/twitterscraper#118,
taspinar/twitterscraper#115,
taspinar/twitterscraper#90
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@lapp0 @taspinar @NileshJorwar