Boto3 1.35+ throws exception in Ubuntu 20.10 under Python 3.8

[fstab50]

Describe the bug

Entering this bug reports because:

1. No other errors produced in python programs not utilising boto3.
2. This functionality was previously working 1 week prior to this posting and appears correlated to boto3 version update.

Ancillary Information: There was also a minor update to python 3.8 on Ubuntu in the last 10 days; however, I discount this as a root cause because all python3 programs not utilising boto3 are working normally.

--
Traceback (most recent call last):
File "/home/blake/.local/bin/keyup", line 5, in
from keyup.cli import init
File "/home/blake/.local/lib/python3.8/site-packages/keyup/cli.py", line 39, in
import boto3
File "/home/blake/.local/lib/python3.8/site-packages/boto3/init.py", line 17, in
from boto3.session import Session
File "/home/blake/.local/lib/python3.8/site-packages/boto3/session.py", line 17, in
import botocore.session
File "/home/blake/.local/lib/python3.8/site-packages/botocore/session.py", line 26, in
import botocore.client
File "/home/blake/.local/lib/python3.8/site-packages/botocore/client.py", line 15, in
from botocore import waiter, xform_name
File "/home/blake/.local/lib/python3.8/site-packages/botocore/waiter.py", line 20, in
from botocore.docs.docstring import WaiterDocstring
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/init.py", line 15, in
from botocore.docs.service import ServiceDocumenter
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/service.py", line 14, in
from botocore.docs.client import (
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/client.py", line 18, in
from botocore.docs.example import ResponseExampleDocumenter
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/example.py", line 13, in
from botocore.docs.shape import ShapeDocumenter
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/shape.py", line 19, in
from botocore.utils import is_json_value_header
File "/home/blake/.local/lib/python3.8/site-packages/botocore/utils.py", line 39, in
import botocore.httpsession
File "/home/blake/.local/lib/python3.8/site-packages/botocore/httpsession.py", line 45, in
from urllib3.contrib.pyopenssl import (
File "/usr/local/lib/python3.8/dist-packages/urllib3/contrib/pyopenssl.py", line 50, in
import OpenSSL.SSL
File "/usr/lib/python3/dist-packages/OpenSSL/init.py", line 8, in
from OpenSSL import crypto, SSL
File "/usr/lib/python3/dist-packages/OpenSSL/crypto.py", line 1553, in
class X509StoreFlags(object):
File "/usr/lib/python3/dist-packages/OpenSSL/crypto.py", line 1571, in X509StoreFlags
NOTIFY_POLICY = _lib.X509_V_FLAG_NOTIFY_POLICY
AttributeError: module 'lib' has no attribute 'X509_V_FLAG_NOTIFY_POLICY'

Regression Issue

• Select this option if this issue appears to be a regression.

Expected Behavior

No exceptions thrown

Current Behavior

Traceback (most recent call last):
File "/home/blake/.local/bin/keyup", line 5, in
from keyup.cli import init
File "/home/blake/.local/lib/python3.8/site-packages/keyup/cli.py", line 39, in
import boto3
File "/home/blake/.local/lib/python3.8/site-packages/boto3/init.py", line 17, in
from boto3.session import Session
File "/home/blake/.local/lib/python3.8/site-packages/boto3/session.py", line 17, in
import botocore.session
File "/home/blake/.local/lib/python3.8/site-packages/botocore/session.py", line 26, in
import botocore.client
File "/home/blake/.local/lib/python3.8/site-packages/botocore/client.py", line 15, in
from botocore import waiter, xform_name
File "/home/blake/.local/lib/python3.8/site-packages/botocore/waiter.py", line 20, in
from botocore.docs.docstring import WaiterDocstring
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/init.py", line 15, in
from botocore.docs.service import ServiceDocumenter
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/service.py", line 14, in
from botocore.docs.client import (
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/client.py", line 18, in
from botocore.docs.example import ResponseExampleDocumenter
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/example.py", line 13, in
from botocore.docs.shape import ShapeDocumenter
File "/home/blake/.local/lib/python3.8/site-packages/botocore/docs/shape.py", line 19, in
from botocore.utils import is_json_value_header
File "/home/blake/.local/lib/python3.8/site-packages/botocore/utils.py", line 39, in
import botocore.httpsession
File "/home/blake/.local/lib/python3.8/site-packages/botocore/httpsession.py", line 45, in
from urllib3.contrib.pyopenssl import (
File "/usr/local/lib/python3.8/dist-packages/urllib3/contrib/pyopenssl.py", line 50, in
import OpenSSL.SSL
File "/usr/lib/python3/dist-packages/OpenSSL/init.py", line 8, in
from OpenSSL import crypto, SSL
File "/usr/lib/python3/dist-packages/OpenSSL/crypto.py", line 1553, in
class X509StoreFlags(object):
File "/usr/lib/python3/dist-packages/OpenSSL/crypto.py", line 1571, in X509StoreFlags
NOTIFY_POLICY = _lib.X509_V_FLAG_NOTIFY_POLICY
AttributeError: module 'lib' has no attribute 'X509_V_FLAG_NOTIFY_POLICY'

Reproduction Steps

1. Install keyup python3 program
2. Attempt to run any keyup command (keyup --help for example)
3. Exception thrown in crypto.py module

Possible Solution

No response

Additional Information/Context

No response

SDK version used

1.37.23

Environment details (OS name and version, etc.)

Ubuntu 20.10, Python 3.8.10

[adev-code]

Hi @fstab50, thanks for reaching out. From your error, it looks like Boto3 version 1.35+ and the older OpenSSL libraries in Ubuntu 20.10. The specific error (X509_V_FLAG_NOTIFY_POLICY not found) indicates that newer Boto3 versions require OpenSSL features not available in your system's libraries. Since Ubuntu 20.10 reached end-of-life in July 2021 https://wiki.ubuntu.com/Releases, it no longer receives updates for these underlying libraries. I tried by testing on Ubuntu 22.04 LTS (closest I could get), where the same Boto3 version works without issues. As alternative, could you either :

• Downgrade Boto3 to version 1.34 or earlier if staying in Ubuntu 20.10
• Use a Python virtual environment with updated PyOpenSSL packages
• Upgrade to a supported Ubuntu version (example 22.04 LTS)
• Install a newer OpenSSL version on your current system
• Use a containerized environment/virtual environment with updated dependencies for your application

Please let me know if you have any questions. Thanks.

[github-actions]

Greetings! It looks like this issue hasn’t been active in longer than five days. We encourage you to check if this is still an issue in the latest release. In the absence of more information, we will be closing this issue soon. If you find that this is still a problem, please feel free to provide a comment or upvote with a reaction on the initial post to prevent automatic closure. If the issue is already closed, please feel free to open a new one.

[fstab50]

A huge thank you @adev-code. I will see if I can update (openSSL) and attempt again.

Very much appreciate your help.
fstab50

[github-actions]

This issue is now closed. Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.