Jobs fail to start with ValueError: ZIP does not support timestamps before 1980

[bpedersen2]

Please confirm the following

• I agree to follow this project's code of conduct.
• I have checked the current issues for duplicates.
• I understand that AWX is open source software provided for free and that I might not receive a timely response.

Summary

On AWX 21 all jobs fail with a fatal error before doing any work:
ZIP does not support timestamps before 1980

AWX version

21.0 installed via awx-operator

Select the relevant components

• UI
• API
• Docs

Installation method

kubernetes

Modifications

no

Ansible version

No response

Operating system

Linux /k3s

Web browser

No response

Steps to reproduce

Run any job that was working with Awx 20 on a awx-operator managed awx instance with AWX-21.

The job immediatly fails ( the worker pod gets spawned, but dies without logs) before performing any tasks.

Expected results

job runs

Actual results

Job fails to start correctly with traceback as below.

Additional information

Traceback (most recent call last):
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/awx/main/tasks/jobs.py", line 540, in run
    res = receptor_job.run()
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/awx/main/tasks/receptor.py", line 271, in run
    res = self._run_internal(receptor_ctl)
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/awx/main/tasks/receptor.py", line 326, in _run_internal
    transmitter_future.result()
  File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result
    raise self._exception
  File "/usr/lib64/python3.9/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/awx/main/utils/common.py", line 1153, in wrapper_cleanup_new_process
    return func(*args, **kwargs)
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/awx/main/tasks/receptor.py", line 398, in transmit
    ansible_runner.interface.run(streamer='transmit', _output=_socket.makefile('wb'), **self.runner_params)
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/ansible_runner/interface.py", line 210, in run
    r.run()
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/ansible_runner/streaming.py", line 54, in run
    stream_dir(self.private_data_dir, self._output)
  File "/var/lib/awx/venv/awx/lib64/python3.9/site-packages/ansible_runner/utils/streaming.py", line 36, in stream_dir
    archive.write(
  File "/usr/lib64/python3.9/zipfile.py", line 1727, in write
    zinfo = ZipInfo.from_file(filename, arcname,
  File "/usr/lib64/python3.9/zipfile.py", line 517, in from_file
    zinfo = cls(arcname, date_time)
  File "/usr/lib64/python3.9/zipfile.py", line 361, in __init__
    raise ValueError('ZIP does not support timestamps before 1980')
ValueError: ZIP does not support timestamps before 1980

[bpedersen2]

I did some more research: It could be linked to the a missing strict_timestamps=False in ansible_runner.

See pypa/pip#9920 where a similar problem.

I'll test and possible supply a patch.

[bpedersen2]

ansible/ansible-runner#1049 fixes it for me

[bpedersen2]

can be closed, as the ansible-runner fix is now included in the release