Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loop Detected with Seemingly Valid Cookie #36

Closed
RelativePrime opened this issue Mar 13, 2020 · 2 comments · Fixed by #37
Closed

Loop Detected with Seemingly Valid Cookie #36

RelativePrime opened this issue Mar 13, 2020 · 2 comments · Fixed by #37

Comments

@RelativePrime
Copy link

Hello,

I'm having an issue similar to issue #24 though not had luck getting the exported, edited, cookie to auth to a private group (no _ORG) and when running tests/test.sh receive a Loop Detected warning.

cookie was exported using chrome cookies.txt extension, has been modified using fix_cookies.sh and appears correct

envs are exported as

export _WGET_OPTIONS="--verbose --load-cookies $HOME/google-group-crawler/tests/fixed_cookies.txt --keep-session-cookies"
export _GROUP='my-group'

tests/test.sh ends with

:: Creating './my-group//threads/t.1' with 'categories/my-group'
:: Fetching data from 'https://groups.google.com/forum/?_escaped_fragment_=categories/my-group'...
--2020-03-13 18:04:49--  https://groups.google.com/forum/?_escaped_fragment_=categories/my-group
Resolving groups.google.com (groups.google.com)... 2607:f8b0:4001:c02::8a, 74.125.70.101, 74.125.70.138, ...
Connecting to groups.google.com (groups.google.com)|2607:f8b0:4001:c02::8a|:443... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://accounts.google.com/ServiceLogin?service=groups2&passive=1209600&osid=1&continue=https://groups.google.com/forum/?_escaped_fragment_%3Dcategories/my-group&followup=https://groups.google.com/forum/?_escaped_fragment_%3Dcategories/my-group&authuser=0 [following]
--2020-03-13 18:04:50--  https://accounts.google.com/ServiceLogin?service=groups2&passive=1209600&osid=1&continue=https://groups.google.com/forum/?_escaped_fragment_%3Dcategories/my-group&followup=https://groups.google.com/forum/?_escaped_fragment_%3Dcategories/my-group&authuser=0
Resolving accounts.google.com (accounts.google.com)... 2607:f8b0:4009:816::200d, 172.217.9.77
Connecting to accounts.google.com (accounts.google.com)|2607:f8b0:4009:816::200d|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]

-                              [ <=>                                   ]  71.80K  --.-KB/s    in 0.09s   

2020-03-13 18:28:28 (760 KB/s) - written to stdout [73522]

:: ==================================================
:: Loop detected. Your cookie may not work correctly.
:: You may want to generate new cookie file
:: and/or remove all '#HttpOnly_' strings from it.
:: ==================================================

Any suggestions what I might try?

Cheers,

@icy
Copy link
Owner

icy commented Apr 9, 2020

Hi @RelativePrime , I have some sample cookie files here https://github.com/icy/google-group-crawler/tree/master/tests. Can you please have a look if you have the same file format? Thanks

icy added a commit that referenced this issue Apr 13, 2020
@icy icy mentioned this issue Apr 13, 2020
Merged
@icy icy closed this as completed in #37 Apr 13, 2020
@icy
Copy link
Owner

icy commented Apr 13, 2020

The problem should be fixed in the latest version 2.0.0 (using curl). Please have a look if it's better. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants