AWS Key rotation is not detected by helm-s3

[sheikhness]

Hi,

I have rotated my AWS access key as per security requirements.
I have verified S3 access with a new key to the S3 bucket I have my repo storage setup. It works fine.
However, when trying to do helm s3 push --force <package_name> <repo_name> it fails with:

check if chart already exists in the repository: head s3 object: Forbidden: Forbidden
        status code: 403, request id: 3FD3FD<redacted>, host id: R2CAM<redacted>

versions:
helm: 2.14.3, s3 plugin: 0.9.2
aws-cli 1.16.169
macOS Catalina

P.S after re-activating pre-rotation AWS keys the same action works which leads me to believe that the plugin caches the keys somewhere?

Thanks!