Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Before u continue to Google #1053

Closed
anoo2niem opened this issue Aug 16, 2023 · 54 comments · Fixed by #1054
Closed

[BUG] Before u continue to Google #1053

anoo2niem opened this issue Aug 16, 2023 · 54 comments · Fixed by #1054
Labels
bug Something isn't working

Comments

@anoo2niem
Copy link

Describe the bug
Just since now, i'm not able to use whoogle anymore. The google 'consent' page is popping up to allow or decline cookies.

To Reproduce
Steps to reproduce the behavior:
Search any keywoard

Deployment Method
Proxmox in lxc container

Version of Whoogle Search
8.2.0 (installed with script https://tteck.github.io/Proxmox/, which i guess uses pip, not sure)

Additional context
Tried changing vpn location where my instance is routed through

image

@anoo2niem anoo2niem added the bug Something isn't working label Aug 16, 2023
@anoo2niem anoo2niem changed the title [BUG] <brief bug description> [BUG] Before u continue to Google Aug 16, 2023
@Hydranet
Copy link

Hydranet commented Aug 16, 2023

I'm also getting the same with Whoogle running in a container, running the same version(v0.8.2 ). Earlier today this wasn't a problem so Google must have changed something?

@rickykresslein
Copy link

rickykresslein commented Aug 16, 2023

Same. This is a duplicate of #243, but that was from a couple of years ago. It seems this is a bug that keeps popping up when Google changes things.
Also, in the other post it seems this was an EU-only issue, and I am in the EU.

@anoo2niem
Copy link
Author

Yeah the cause is surely on google's end. Probably it was/is a EU-only issue because of GDPR.
Hopefully this can be bypassed in some way.

@seirdotexe
Copy link

Getting the same thing

@Syrox94
Copy link

Syrox94 commented Aug 16, 2023

same here

@cpu2910
Copy link

cpu2910 commented Aug 16, 2023

+1
Ubuntu Server 22.04 , Whoogle Docker v0.8.2

@anoo2niem
Copy link
Author

Current workaround; i've got my whoogle working again by routing it through a non EU vpn.

@helsingi
Copy link

same issue

@NoCodeFromMe
Copy link

Same, also located in the EU.
Debian 11, Pip, Whoogle Search v0.8.2

@imTHAI
Copy link

imTHAI commented Aug 16, 2023

Same here, from France

@chocology
Copy link

same here from Bern

@JiriVitner
Copy link

JiriVitner commented Aug 16, 2023

I can confirm same issue from Brno (Czech)

@Procuria
Copy link

Can confirm too from Germany

@imTHAI
Copy link

imTHAI commented Aug 16, 2023

Current workaround; i've got my whoogle working again by routing it through a non EU vpn.

Indeed. Thanks, it It will do the job in the meantime.

@fabi321
Copy link
Contributor

fabi321 commented Aug 16, 2023

'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(

It looks like, the current style uses consent yes. However, If I try it out in a browser window, it always sets it to Pending+###, and also sets another cookie, SOCS, to CAISHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg (this is consistent across private browser sessions) Setting both of these resolved the issue in my case. (replace # with any digits, using 900 all the time seems to do fine)

@cpu2910
Copy link

cpu2910 commented Aug 16, 2023

Current workaround; i've got my whoogle working again by routing it through a non EU vpn.

May I ask how and where to do this ?
My whoogle runs in a docker container on a ubuntu server nginx reverse proxy...

@anoo2niem
Copy link
Author

Current workaround; i've got my whoogle working again by routing it through a non EU vpn.

May I ask how and where to do this ? My whoogle runs in a docker container on a ubuntu server nginx reverse proxy...

I have a separate container running wireguard, and i point my whoogle container it's gateway to the ip of the wireguard container. So set up a wireguard container and configure it according to your vpn provider, then make sure your iptables are set up right, so all network traffic comming in that container is forwarded properly.

@anoo2niem
Copy link
Author

'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(

It looks like, the current style uses consent yes. However, If I try it out in a browser window, it always sets it to Pending+###, and also sets another cookie, SOCS, to CAISHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg (this is consistent across private browser sessions) Setting both of these resolved the issue in my case. (replace # with any digits, using 900 all the time seems to do fine)

Would u mind explaining how to set these?
I want to try it aswell but i'm not sure how to modify that line.

@Imaskiller
Copy link

Imaskiller commented Aug 16, 2023

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            }

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            } 

fixes the problem.

edit fix typo

@anoo2niem
Copy link
Author

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

Thanks, seems to have solved it indeed.

@C8opmBM
Copy link

C8opmBM commented Aug 16, 2023

hopefully an update will be pushed soon. I have no idea how to edit those cookies lines :)

@jniggemann
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

Thanks, seems to have solved it indeed.

I confirm.

@bjornberfelo
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

Confirm that it solves the problem, but i needed to remove the ) on the end :-) otherwise i got a error: SyntaxError: closing parenthesis ')' does not match opening parenthesis '{' on line 309

@mztiq
Copy link

mztiq commented Aug 17, 2023

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

Confirm that it solves the problem, but i needed to remove the ) on the end :-) otherwise i got a error: SyntaxError: closing parenthesis ')' does not match opening parenthesis '{' on line 309

Can confirm.

@LANTaverne2
Copy link

Hi, same error. I fix it with the workaround to modiy the request.py

        'CONSENT': 'PENDING+987',
        'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 

Thanks

@Sebastix
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

@Tubeman-cell
Copy link

Getting the same thing

@C8opmBM
Copy link

C8opmBM commented Aug 17, 2023

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

@cpu2910
Copy link

cpu2910 commented Aug 17, 2023

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

You may edit your running container:
docker exec -it <container_id> /bin/sh
edit the 'cookies'-line in ./app/request.py
exit the container and restart with 'docker restart <container_id>

That fixed the problem for me.

@bjornberfelo
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

Anyone who what's a temp image to use :-)
blivius92/temp-whoogle:latest

@cemkur
Copy link

cemkur commented Aug 17, 2023

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

Anyone who what's a temp image to use :-) blivius92/temp-whoogle:latest

you need to remove the fourth line on the replacing block which is just a )
than it works.

@nagyrobi
Copy link

And how about the rest of us who installed by pip?

@heinxyze
Copy link

Same behaviour
latest Whoogle docker image running on QNAP NAS, Germany

@be-root
Copy link

be-root commented Aug 17, 2023

And how about the rest of us who installed by pip?

nano /usr/local/lib/python3.11/dist-packages/app/request.py

Line 297:

297 cookies = {
298 'CONSENT': 'PENDING+987',
299 'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg'
300 }

@imTHAI
Copy link

imTHAI commented Aug 17, 2023

And how about the rest of us who installed by pip?

If it is confirmed that it solves the problem, why don't we apply the modification in the official branch ? Some extra tests must be performed ?

@fabi321
Copy link
Contributor

fabi321 commented Aug 17, 2023

@imTHAI I already created #1054, it's just waiting to be merged

@fusrohdan
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

You may edit your running container: docker exec -it <container_id> /bin/sh edit the 'cookies'-line in ./app/request.py exit the container and restart with 'docker restart <container_id>

That fixed the problem for me.

Hey, thanks for your fix. I went to do this fix in my docker container, but there is no text editor available. I tried vim and nano. What text editor did you use? I tried to see if the container has a volume mounted so I can edit from host but that is not the case.
Thanks!

@JiriVitner
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

You may edit your running container: docker exec -it <container_id> /bin/sh edit the 'cookies'-line in ./app/request.py exit the container and restart with 'docker restart <container_id>
That fixed the problem for me.

Hey, thanks for your fix. I went to do this fix in my docker container, but there is no text editor available. I tried vim and nano. What text editor did you use? I tried to see if the container has a volume mounted so I can edit from host but that is not the case. Thanks!

In the container is available "vi", not "vim"

@baerenmarke90
Copy link

Workaround works, thank you!

@fusrohdan
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

You may edit your running container: docker exec -it <container_id> /bin/sh edit the 'cookies'-line in ./app/request.py exit the container and restart with 'docker restart <container_id>
That fixed the problem for me.

Hey, thanks for your fix. I went to do this fix in my docker container, but there is no text editor available. I tried vim and nano. What text editor did you use? I tried to see if the container has a volume mounted so I can edit from host but that is not the case. Thanks!

In the container is available "vi", not "vim"

Thank you, I have edited the cookies line now but the container won't start. I will troubleshoot later after work

@GusGus68
Copy link

Replacing

        cookies = {
            'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
                now.year, now.month, now.day
            )

with

       cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg' 
            ) 

fixes the problem.

This change also fixed it for me and I've manually build the Docker image (see https://github.com/benbusby/whoogle-search#manual-docker) to start a new container with it.

Could you share your docker image until the official one is updated? I've never built an image and Im sure this will come handy for a lot of other users. In advance, thanks

You may edit your running container: docker exec -it <container_id> /bin/sh edit the 'cookies'-line in ./app/request.py exit the container and restart with 'docker restart <container_id>
That fixed the problem for me.

Hey, thanks for your fix. I went to do this fix in my docker container, but there is no text editor available. I tried vim and nano. What text editor did you use? I tried to see if the container has a volume mounted so I can edit from host but that is not the case. Thanks!

In the container is available "vi", not "vim"

Thank you, I have edited the cookies line now but the container won't start. I will troubleshoot later after work

The reason it won't start is the last bracket. If you remove it it will work.

For any other noobs like me, the way to do this in docker is as per the instructions above. ssh into your server. then type
docker exec -it <container_id> /bin/sh
cd app
vi request.py

then replace
cookies = {
'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(
now.year, now.month, now.day
)

with the following
cookies = {
'CONSENT': 'PENDING+987',
'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg'

note the last bracket is removed

Then exit and restart container with
docker restart <container_id>

@imTHAI
Copy link

imTHAI commented Aug 18, 2023

It works for me too

@IvanVojtko
Copy link

Not the nicest one, but for my fellow kubernetes folks out there, update your deployment with

command: ["/bin/sh"]
args: ["-c", "sed -i '312d' app/request.py && sed -i \"s|'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(|'CONSENT': 'PENDING+987',|g\" app/request.py && sed -i \"s|now.year, now.month, now.day|'SOCS': 'CAESHAgBEhIaAB'|g\" app/request.py && misc/tor/start-tor.sh & ./run"]

@Luxumbra27
Copy link

Little correction:

args: ["-c", "sed -i '312d' app/request.py && sed -i \"s|'CONSENT': 'YES+cb.{:d}{:02d}{:02d}-17-p0.de+F+678'.format(|'CONSENT': 'PENDING+987',  |g\" app/request.py && sed -i \"s|now.year, now.month, now.day|'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg'|g\" app/request.py && sed -i \"s|            )||g\" app/request.py && misc/tor/start-tor.sh & ./run"]

@Drallas
Copy link

Drallas commented Aug 18, 2023

I run a LXC with Whoogle and struggled a bit, with whoogle.service service not starting.

This is how I did it.

systemctl stop whoogle.service

vi /usr/local/lib/python3.11/dist-packages/app/request.py

Then replaced the complete 'cookies block' for:

        # view is suppressed correctly
        now = datetime.now()
        cookies = {
            'CONSENT': 'PENDING+987',
            'SOCS': 'CAESHAgBEhJnd3NfMjAyMzA4MTAtMF9SQzIaAmRlIAEaBgiAo_CmBg'
        }

systemctl start whoogle.service
systemctl status whoogle.service

@Hydranet
Copy link

Anyone who what's a temp image to use :-)
blivius92/temp-whoogle:latest

I just tried @bjornberfelo's temp image and it works, thank you! Which means that if you are running the official image and change the lines manually in your image that your container needs a restart which means you need to be using persistent storage for your container or else your container will revert to the image you are using when you restart your container.

@malyyigor34
Copy link

Confirm issue, I am from Poland

@HeavyTobi
Copy link

same issue for me,

Germany
Whoogle v0.8.2
Server: Docker @ Ubuntu LTS
Clients tested: Firefox on macOS and Safari on iOS

@hs6666
Copy link

hs6666 commented Aug 21, 2023

same issue here....

@Deedikjupijn
Copy link

Same issue here,
Just installed whoogle,
Server: Docker debian 11

@DrMatschhirn
Copy link

Same Issue with latest Docker Image.

@peternrdstrm
Copy link

I have the same issue but with Heroku. Can somebody help me do the workaround?

@martyn-meister
Copy link

Latest docker image works for me. Remember to do a docker pull, or in k8s ImagePullPolicy: Always or you won't get the newest.

@sorcer1122
Copy link

Had the same problem in Amsterdam. The following fixed it:
docker pull benbusby/whoogle-search
docker stop [container_id]
docker rm [container_id]
docker run --publish 5000:5000 --detach --name whoogle-search benbusby/whoogle-search:latest

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.