Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exception: No usable Wget+At found. #70

Open
Scott-St opened this issue Apr 11, 2023 · 16 comments
Open

Exception: No usable Wget+At found. #70

Scott-St opened this issue Apr 11, 2023 · 16 comments

Comments

@Scott-St
Copy link

Latest docker container breaks wget again.

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 736, in start_selected_project
    (project, pipeline, config_values) = self.load_pipeline(
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 686, in load_pipeline
    exec(pipeline_str, local_context, global_context)
  File "<string>", line 56, in <module>
Exception: No usable Wget+At found.
@Jshanks
Copy link

Jshanks commented Apr 18, 2023

Seeing the same behavior here.

2023-04-18 15:58:50,296 - seesaw.warrior - DEBUG - Start selected project reddit (reinstall=False)
2023-04-18 15:58:50,296 - seesaw.warrior - DEBUG - Check project has update reddit
2023-04-18 15:58:50,305 - seesaw.warrior - DEBUG - git fetch
2023-04-18 15:58:50,637 - seesaw.warrior - DEBUG - False
2023-04-18 15:58:50,639 - seesaw.warrior - DEBUG - Clone project reddit /home/warrior/projects/reddit
2023-04-18 15:58:50,645 - seesaw.warrior - DEBUG - Cloning version 7f4db17
2023-04-18 15:58:50,646 - seesaw.warrior - DEBUG - Load pipeline /home/warrior/data/projects/reddit-7f4db17/pipeline.py
2023-04-18 15:58:50,647 - seesaw.warrior - DEBUG - Pipeline has been read. Begin ConfigValue collection
2023-04-18 15:58:50,647 - seesaw.warrior - DEBUG - Executing pipeline
2023-04-18 15:58:50,666 - seesaw.warrior - ERROR - Error loading pipeline
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 736, in start_selected_project
(project, pipeline, config_values) = self.load_pipeline(
File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 686, in load_pipeline
exec(pipeline_str, local_context, global_context)
File "<string>", line 56, in <module>
Exception: No usable Wget+At found.
2023-04-18 15:58:50,668 - seesaw.warrior - WARNING - Project reddit did not install correctly and we're ignoring this problem.

@0xEmma
Copy link

0xEmma commented Apr 23, 2023

Also having this issue

@trentwiles
Copy link

Same issue with the imgur project.

@tech234a
Copy link
Member

tech234a commented May 9, 2023

The Reddit and Imgur projects should be working on the Warrior now.

@ziggo0
Copy link

ziggo0 commented Jun 7, 2023

Also happening to me as of today. Latest warrior image, both in VMware and VirtualBox.

@AJO-Python
Copy link

AJO-Python commented Jun 7, 2023

Happening to me for all projects.
I have watchtower keeping the warrior image on latest.

2023-06-07 14:16:25,428 - seesaw.warrior - DEBUG - Start selected project pastebin (reinstall=False)
2023-06-07 14:16:25,428 - seesaw.warrior - DEBUG - Install project pastebin
2023-06-07 14:16:25,428 - seesaw.warrior - DEBUG - git clone
2023-06-07 14:16:26,165 - seesaw.warrior - DEBUG - git operation: Cloning into '/home/warrior/projects/pastebin'...

2023-06-07 14:16:26,166 - seesaw.warrior - DEBUG - Install complete Cloning into '/home/warrior/projects/pastebin'...

2023-06-07 14:16:26,167 - seesaw.warrior - DEBUG - Result of the install process: True
2023-06-07 14:16:26,167 - seesaw.warrior - DEBUG - Clone project pastebin /home/warrior/projects/pastebin
2023-06-07 14:16:26,173 - seesaw.warrior - DEBUG - Cloning version b421d0c
Cloning into '/home/warrior/data/projects/pastebin-b421d0c'...
done.
2023-06-07 14:16:26,195 - seesaw.warrior - DEBUG - Load pipeline /home/warrior/data/projects/pastebin-b421d0c/pipeline.py
2023-06-07 14:16:26,196 - seesaw.warrior - DEBUG - Pipeline has been read. Begin ConfigValue collection
2023-06-07 14:16:26,196 - seesaw.warrior - DEBUG - Executing pipeline
2023-06-07 14:16:26,211 - seesaw.warrior - ERROR - Error loading pipeline
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 736, in start_selected_project
    (project, pipeline, config_values) = self.load_pipeline(
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 686, in load_pipeline
    exec(pipeline_str, local_context, global_context)
  File "<string>", line 55, in <module>
Exception: No usable Wget+At found.
2023-06-07 14:16:26,213 - seesaw.warrior - WARNING - Project pastebin did not install correctly and we're ignoring this problem.

@Arkiver2
Copy link
Member

Arkiver2 commented Jun 7, 2023

This happens when there is a mismatch between the Wget-AT version in the warrior and the Wget-AT version required in the project.

This can happen because either

  1. warrior-dockerfile was updated and the Warrior now holds a newer version of Wget-AT than is supported by the project, or
  2. the project is updated and requires a newer version of Wget-AT than what the Warrior holds

How this can be fixed?

  1. In the case of the first issue, we will release an update to the project to support the new Wget-AT, and your Warrior will automatically update the project after up to an hour.
  2. In the second case, your Warrior will have to be updated. If you run using the VM image this should be done automatically (after some time), but if you don't you have to make sure you are running using watchtower, as is noted in the README of this repo. Watchtower will then make sure the newest version is pulled after some time (up to an hour).

That means that you have to manually update this if

  • you run without VM, or
  • you run directly using Docker without watchtower

@Arkiver2
Copy link
Member

Arkiver2 commented Jun 7, 2023

For specifically this case, warrior-dockerfile was updated to include the new Wget-AT. We're moving all projects to using this new Wget-AT as only supported version.

@AJO-Python
Copy link

@Arkiver2 thanks for the quick reply and explanation!
I have watchtower managing the warrior container so will just wait for the updates to roll through.

@Arkiver2
Copy link
Member

Arkiver2 commented Jun 7, 2023

Thank you @AJO-Python , if it is still not running in, say, 3 hours, please ping us here again! (We're in the process of moving all projects still to the new Wget-AT.)

@ziggo0
Copy link

ziggo0 commented Jun 7, 2023

@Arkiver2 it appears to be working for me now. All of my refreshed warriors are up and running. Thank you.

A work around I did find was to click the regular Reddit project, stop that, then back to ArchiveTeam’s Choice.

@Arkiver2
Copy link
Member

Arkiver2 commented Jun 7, 2023

@ziggo0 yeah, that will initialize project again, including pulling the newest version. So indeed a speed up.

@Arkiver2 Arkiver2 added wontfix and removed wontfix labels Jun 17, 2023
@szymmirr
Copy link

szymmirr commented Dec 9, 2023

Periscope

2023-12-09 04:24:47,923 - seesaw.warrior - DEBUG - Select project periscope
2023-12-09 04:24:47,931 - seesaw.warrior - DEBUG - Start selected project periscope (reinstall=False)
2023-12-09 04:24:47,933 - seesaw.warrior - DEBUG - Install project periscope
2023-12-09 04:24:47,948 - seesaw.warrior - DEBUG - git clone
2023-12-09 04:25:01,068 - seesaw.warrior - DEBUG - git operation: Cloning into '/home/warrior/projects/periscope'...

2023-12-09 04:25:01,069 - seesaw.warrior - DEBUG - Install complete Cloning into '/home/warrior/projects/periscope'...

2023-12-09 04:25:01,071 - seesaw.warrior - DEBUG - Result of the install process: True
2023-12-09 04:25:01,071 - seesaw.warrior - DEBUG - Clone project periscope /home/warrior/projects/periscope
2023-12-09 04:25:01,076 - seesaw.warrior - DEBUG - Cloning version f63acd1
2023-12-09 04:25:01,092 - seesaw.warrior - DEBUG - Load pipeline /home/warrior/data/projects/periscope-f63acd1/pipeline.py
2023-12-09 04:25:01,094 - seesaw.warrior - DEBUG - Pipeline has been read. Begin ConfigValue collection
2023-12-09 04:25:01,094 - seesaw.warrior - DEBUG - Executing pipeline
2023-12-09 04:25:01,328 - seesaw.warrior - ERROR - Error loading pipeline
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 736, in start_selected_project
    (project, pipeline, config_values) = self.load_pipeline(
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 686, in load_pipeline
    exec(pipeline_str, local_context, global_context)
  File "<string>", line 52, in <module>
Exception: No usable Wget+At found.
2023-12-09 04:25:01,332 - seesaw.warrior - WARNING - Project periscope did not install correctly and we're ignoring this problem.

VK

2023-12-09 04:26:30,879 - seesaw.warrior - DEBUG - Select project vkontakte
2023-12-09 04:26:30,881 - seesaw.warrior - DEBUG - Start selected project vkontakte (reinstall=False)
2023-12-09 04:26:30,881 - seesaw.warrior - DEBUG - Install project vkontakte
2023-12-09 04:26:30,882 - seesaw.warrior - DEBUG - git clone
2023-12-09 04:26:37,230 - seesaw.warrior - DEBUG - git operation: Cloning into '/home/warrior/projects/vkontakte'...

2023-12-09 04:26:37,232 - seesaw.warrior - DEBUG - Install complete Cloning into '/home/warrior/projects/vkontakte'...

2023-12-09 04:26:37,233 - seesaw.warrior - DEBUG - Result of the install process: True
2023-12-09 04:26:37,234 - seesaw.warrior - DEBUG - Clone project vkontakte /home/warrior/projects/vkontakte
2023-12-09 04:26:37,251 - seesaw.warrior - DEBUG - Cloning version 5a4111a
2023-12-09 04:26:37,274 - seesaw.warrior - DEBUG - Load pipeline /home/warrior/data/projects/vkontakte-5a4111a/pipeline.py
2023-12-09 04:26:37,275 - seesaw.warrior - DEBUG - Pipeline has been read. Begin ConfigValue collection
2023-12-09 04:26:37,275 - seesaw.warrior - DEBUG - Executing pipeline
2023-12-09 04:26:37,298 - seesaw.warrior - ERROR - Error loading pipeline
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 736, in start_selected_project
    (project, pipeline, config_values) = self.load_pipeline(
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 686, in load_pipeline
    exec(pipeline_str, local_context, global_context)
  File "<string>", line 54, in <module>
Exception: No usable Wget+At found.
2023-12-09 04:26:37,299 - seesaw.warrior - WARNING - Project vkontakte did not install correctly and we're ignoring this problem.

Stack Exchange

2023-12-09 04:29:15,732 - seesaw.warrior - DEBUG - Select project stack-exchange
2023-12-09 04:29:15,734 - seesaw.warrior - DEBUG - Start selected project stack-exchange (reinstall=False)
2023-12-09 04:29:15,735 - seesaw.warrior - DEBUG - Install project stack-exchange
2023-12-09 04:29:15,738 - seesaw.warrior - DEBUG - git clone
2023-12-09 04:29:19,171 - seesaw.warrior - DEBUG - git operation: Cloning into '/home/warrior/projects/stack-exchange'...
warning: You appear to have cloned an empty repository.

2023-12-09 04:29:19,173 - seesaw.warrior - DEBUG - Install complete Cloning into '/home/warrior/projects/stack-exchange'...
warning: You appear to have cloned an empty repository.

2023-12-09 04:29:19,174 - seesaw.warrior - DEBUG - Result of the install process: True
2023-12-09 04:29:19,176 - seesaw.warrior - DEBUG - Clone project stack-exchange /home/warrior/projects/stack-exchange
2023-12-09 04:29:19,182 - seesaw.warrior - DEBUG - Cloning version 
2023-12-09 04:29:19,197 - seesaw.warrior - DEBUG - Load pipeline /home/warrior/data/projects/stack-exchange-/pipeline.py
2023-12-09 04:29:19,198 - seesaw.warrior - ERROR - Error loading pipeline
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 736, in start_selected_project
    (project, pipeline, config_values) = self.load_pipeline(
  File "/usr/local/lib/python3.9/site-packages/seesaw/warrior.py", line 674, in load_pipeline
    with open(pipeline_path) as f:
FileNotFoundError: [Errno 2] No such file or directory: '/home/warrior/data/projects/stack-exchange-/pipeline.py'
2023-12-09 04:29:19,199 - seesaw.warrior - WARNING - Project stack-exchange did not install correctly and we're ignoring this problem.

@JustAnotherArchivist
Copy link
Contributor

@szymmirr VK and Stack Exchange are marked as 'WIP' (work in progress, i.e. not ready yet), and Periscope is 'paused'. In other words, those three are not currently operational, and errors are to be expected.

@Ramblurr
Copy link

Getting this with the latest image latest@sha256:1df66b037c4a8c915b380bde4ffd59ced214d809779a8c3cac07685a618ab7b5 for project telegram.

@flotwig
Copy link

flotwig commented Apr 6, 2024

This error still occurs with the latest warrior-dockerfile for telegram, imgur, mediafire, pastebin and imgur.

edit: Fixed after switching from the Docker Hub archiveteam/warrior-dockerfile to atdr.meo.ws/archiveteam/warrior-dockerfile.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests