auth-utils: add support in the native image #19619

ilappe · 2023-08-30T11:03:43Z

Related Issues

Related: https://jira-hq.paloaltonetworks.local/browse/CIAC-861

Related PRs

Related: #19547

Description

after the new image auth-utils will be merged in this PR
this PR will update the native image to support the new auth-utils image

…IAC-861/update_native_image_with_auth_utils

JudahSchwartz

@samuelFain @GuyAfik looks like a hard lock. We good with this?
Otherwise looks good to me

JudahSchwartz · 2023-09-05T11:59:48Z

docker/py3-native/pyproject.toml

@@ -69,6 +69,9 @@ python-whois = "*"
 ipwhois = "*"
 edgegrid-python = "*"
 tldextract = "*"
+pydantic = "*"


would lock to > version 2. Better to make sure in case something else gets added that it wont suddenly get switched

JudahSchwartz · 2023-09-05T12:00:19Z

please also add to changelog

GuyAfik

@ilappe great work!

You can add the validations in the verify.py for the auth-utils in the verify.py of auth-utils image and then just add a symlink to it.
can we avoid locking the entire py3-native? it contains tons of packages which are getting updated, is it possible to update the dependancies only required for the new packages?
as @JudahSchwartz mentioned, please add it to the changelog

docker/py3-native/Dockerfile

docker/py3-native/verify.py

xsoar-bot · 2023-09-06T10:52:50Z

Docker Image Ready - Dev

Docker automatic build at CircleCI has deployed your docker image: devdemisto/py3-native:8.3.0.73082
It is available now on docker hub at: https://hub.docker.com/r/devdemisto/py3-native/tags
Get started by pulling the image:

docker pull devdemisto/py3-native:8.3.0.73082

Docker Metadata

Image Size: 1187.31 MB
Image ID: sha256:3f791ba040017a3ac1562dc93bebc87b8a2bb71cfafbb6a2dd1116c39f42adca
Created: 2023-09-06T10:48:43.917564403Z
Arch: linux/amd64
Command: ["python3"]
Environment:
- PATH=/usr/local/bin:/home/python/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
- container=oci
- PYTHON_VERSION=3.10.8
- LANG=C.UTF-8
- DOCKER_IMAGE=devdemisto/py3-native:8.3.0.73082
- NLTK_DATA=/ml/nltk_data
Labels:
- architecture:x86_64
- build-date:2023-08-23T05:46:27
- com.redhat.component:ubi9-container
- com.redhat.license_terms:https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI
- description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- distribution-scope:public
- io.buildah.version:1.29.0
- io.k8s.description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- io.k8s.display-name:Red Hat Universal Base Image 9
- io.openshift.expose-services:
- io.openshift.tags:base rhel9
- maintainer:Red Hat, Inc.
- name:ubi9
- org.opencontainers.image.authors:Demisto <containers@demisto.com>
- org.opencontainers.image.revision:407dd7ff124d57d4f3cf9e21140665270648f511
- org.opencontainers.image.version:8.3.0.73082
- release:722.1692769367
- summary:Provides the latest release of Red Hat Universal Base Image 9.
- url:https://access.redhat.com/containers/#/registry.access.redhat.com/ubi9/images/9.2-722.1692769367
- vcs-ref:6b5892a11894993e819f9a93ee1d7aaa80dc3a17
- vcs-type:git
- vendor:Red Hat, Inc.
- version:9.2

xsoar-bot · 2023-09-06T13:58:08Z

Docker Image Ready - Dev

Docker automatic build at CircleCI has deployed your docker image: devdemisto/py3-native:8.3.0.73085
It is available now on docker hub at: https://hub.docker.com/r/devdemisto/py3-native/tags
Get started by pulling the image:

docker pull devdemisto/py3-native:8.3.0.73085

Docker Metadata

Image Size: 1189.59 MB
Image ID: sha256:378470b0b20c913c8e004e6927d4a80714045e81f9e69b9c808d524f9e3c0d46
Created: 2023-09-06T13:54:26.83859327Z
Arch: linux/amd64
Command: ["python3"]
Environment:
- PATH=/usr/local/bin:/home/python/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
- container=oci
- PYTHON_VERSION=3.10.8
- LANG=C.UTF-8
- DOCKER_IMAGE=devdemisto/py3-native:8.3.0.73085
- NLTK_DATA=/ml/nltk_data
Labels:
- architecture:x86_64
- build-date:2023-08-23T05:46:27
- com.redhat.component:ubi9-container
- com.redhat.license_terms:https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI
- description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- distribution-scope:public
- io.buildah.version:1.29.0
- io.k8s.description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- io.k8s.display-name:Red Hat Universal Base Image 9
- io.openshift.expose-services:
- io.openshift.tags:base rhel9
- maintainer:Red Hat, Inc.
- name:ubi9
- org.opencontainers.image.authors:Demisto <containers@demisto.com>
- org.opencontainers.image.revision:8c508467806beb1b29c8ecadb06428811b1f8358
- org.opencontainers.image.version:8.3.0.73085
- release:722.1692769367
- summary:Provides the latest release of Red Hat Universal Base Image 9.
- url:https://access.redhat.com/containers/#/registry.access.redhat.com/ubi9/images/9.2-722.1692769367
- vcs-ref:6b5892a11894993e819f9a93ee1d7aaa80dc3a17
- vcs-type:git
- vendor:Red Hat, Inc.
- version:9.2

xsoar-bot · 2023-09-19T14:24:38Z

Docker Image Ready - Dev

Docker automatic build at CircleCI has deployed your docker image: devdemisto/py3-native:8.4.0.74549
It is available now on docker hub at: https://hub.docker.com/r/devdemisto/py3-native/tags
Get started by pulling the image:

docker pull devdemisto/py3-native:8.4.0.74549

Docker Metadata

Image Size: 1209.37 MB
Image ID: sha256:2c4339e6e1cd89cd280562d9317f9f3cbc81e3878511a7e071d403a646f7a769
Created: 2023-09-19T14:20:52.219921311Z
Arch: linux/amd64
Command: ["python3"]
Environment:
- PATH=/usr/local/bin:/home/python/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
- container=oci
- PYTHON_VERSION=3.10.8
- LANG=C.UTF-8
- DOCKER_IMAGE=devdemisto/py3-native:8.4.0.74549
- NLTK_DATA=/ml/nltk_data
Labels:
- architecture:x86_64
- build-date:2023-08-23T05:46:27
- com.redhat.component:ubi9-container
- com.redhat.license_terms:https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI
- description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- distribution-scope:public
- io.buildah.version:1.29.0
- io.k8s.description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- io.k8s.display-name:Red Hat Universal Base Image 9
- io.openshift.expose-services:
- io.openshift.tags:base rhel9
- maintainer:Red Hat, Inc.
- name:ubi9
- org.opencontainers.image.authors:Demisto <containers@demisto.com>
- org.opencontainers.image.revision:84b28a8ecba1a1e90de5b3a41b307fac82b9b7af
- org.opencontainers.image.version:8.4.0.74549
- release:722.1692769367
- summary:Provides the latest release of Red Hat Universal Base Image 9.
- url:https://access.redhat.com/containers/#/registry.access.redhat.com/ubi9/images/9.2-722.1692769367
- vcs-ref:6b5892a11894993e819f9a93ee1d7aaa80dc3a17
- vcs-type:git
- vendor:Red Hat, Inc.
- version:9.2

GuyAfik

looks good to me, please wait for @JudahSchwartz 's approval

JudahSchwartz · 2023-09-20T06:36:16Z

just left is my comment regarding pydantic, otherwise lgtm

…IAC-861/update_native_image_with_auth_utils

xsoar-bot · 2023-09-20T07:42:13Z

Docker Image Ready - Dev

Docker automatic build at CircleCI has deployed your docker image: devdemisto/py3-native:8.4.0.74724
It is available now on docker hub at: https://hub.docker.com/r/devdemisto/py3-native/tags
Get started by pulling the image:

docker pull devdemisto/py3-native:8.4.0.74724

Docker Metadata

Image Size: 1209.67 MB
Image ID: sha256:3dbab5bf0e5faed9948a2bb85bdf999a5f7b494f09862cb575fa4638339f602b
Created: 2023-09-20T07:38:37.922113253Z
Arch: linux/amd64
Command: ["python3"]
Environment:
- PATH=/usr/local/bin:/home/python/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
- container=oci
- PYTHON_VERSION=3.10.8
- LANG=C.UTF-8
- DOCKER_IMAGE=devdemisto/py3-native:8.4.0.74724
- NLTK_DATA=/ml/nltk_data
Labels:
- architecture:x86_64
- build-date:2023-08-23T05:46:27
- com.redhat.component:ubi9-container
- com.redhat.license_terms:https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI
- description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- distribution-scope:public
- io.buildah.version:1.29.0
- io.k8s.description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- io.k8s.display-name:Red Hat Universal Base Image 9
- io.openshift.expose-services:
- io.openshift.tags:base rhel9
- maintainer:Red Hat, Inc.
- name:ubi9
- org.opencontainers.image.authors:Demisto <containers@demisto.com>
- org.opencontainers.image.revision:be7c59171bc0209b2397e4a3dff6855ed9f32da8
- org.opencontainers.image.version:8.4.0.74724
- release:722.1692769367
- summary:Provides the latest release of Red Hat Universal Base Image 9.
- url:https://access.redhat.com/containers/#/registry.access.redhat.com/ubi9/images/9.2-722.1692769367
- vcs-ref:6b5892a11894993e819f9a93ee1d7aaa80dc3a17
- vcs-type:git
- vendor:Red Hat, Inc.
- version:9.2

xsoar-bot · 2023-09-20T09:43:31Z

Docker Image Ready - Production

Docker automatic build at CircleCI has deployed your docker image: demisto/py3-native:8.4.0.74970
It is available now on docker hub at: https://hub.docker.com/r/demisto/py3-native/tags
Get started by pulling the image:

docker pull demisto/py3-native:8.4.0.74970

Docker Metadata

Image Size: 1209.85 MB
Image ID: sha256:570b147e001c2bc966b76b8b3ba4abfbce53e9e586fd36fbef347c20207e4a73
Created: 2023-09-20T09:39:56.285188478Z
Arch: linux/amd64
Command: ["python3"]
Environment:
- PATH=/usr/local/bin:/home/python/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
- container=oci
- PYTHON_VERSION=3.10.8
- LANG=C.UTF-8
- DOCKER_IMAGE=demisto/py3-native:8.4.0.74970
- NLTK_DATA=/ml/nltk_data
Labels:
- architecture:x86_64
- build-date:2023-08-23T05:46:27
- com.redhat.component:ubi9-container
- com.redhat.license_terms:https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI
- description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- distribution-scope:public
- io.buildah.version:1.29.0
- io.k8s.description:The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.
- io.k8s.display-name:Red Hat Universal Base Image 9
- io.openshift.expose-services:
- io.openshift.tags:base rhel9
- maintainer:Red Hat, Inc.
- name:ubi9
- org.opencontainers.image.authors:Demisto <containers@demisto.com>
- org.opencontainers.image.revision:8b8e8f1de91fccf14ffeeba105af486b5176ae63
- org.opencontainers.image.version:8.4.0.74970
- release:722.1692769367
- summary:Provides the latest release of Red Hat Universal Base Image 9.
- url:https://access.redhat.com/containers/#/registry.access.redhat.com/ubi9/images/9.2-722.1692769367
- vcs-ref:6b5892a11894993e819f9a93ee1d7aaa80dc3a17
- vcs-type:git
- vendor:Red Hat, Inc.
- version:9.2

add suppor for the auth utils image in native

8f6d133

ilappe self-assigned this Aug 30, 2023

ilappe requested review from GuyAfik and JudahSchwartz as code owners August 30, 2023 11:03

ilappe added 2 commits August 30, 2023 14:18

update verify file

c7b3a40

fix os pck issue

a70d424

ilappe requested a review from samuelFain as a code owner September 3, 2023 20:19

ilappe added 4 commits September 5, 2023 11:44

test winrm without kerberos

ed746af

remove winrm from py3-native

68dcf92

Merge branch 'master' of github.com:demisto/dockerfiles into ilappe/C…

078ddc2

…IAC-861/update_native_image_with_auth_utils

empty

69f404f

JudahSchwartz reviewed Sep 5, 2023

View reviewed changes

GuyAfik reviewed Sep 5, 2023

View reviewed changes

docker/py3-native/Dockerfile Show resolved Hide resolved

docker/py3-native/verify.py Outdated Show resolved Hide resolved

ilappe added 4 commits September 6, 2023 11:17

CR changes

f550097

merge master

56a62f5

lock after merge master

b4d5806

poetry lock without update

407dd7f

check support of winrm

8c50846

ilappe added 2 commits September 19, 2023 16:58

merge master

fab1fc4

CR changes

84b28a8

ilappe requested review from GuyAfik and JudahSchwartz September 19, 2023 14:25

GuyAfik approved these changes Sep 20, 2023

View reviewed changes

lock pydantic > 2.0

f6fd98a

Merge branch 'master' of github.com:demisto/dockerfiles into ilappe/C…

be7c591

…IAC-861/update_native_image_with_auth_utils

ilappe merged commit 8b8e8f1 into master Sep 20, 2023
6 of 7 checks passed

ilappe deleted the ilappe/CIAC-861/update_native_image_with_auth_utils branch September 20, 2023 09:23

samuelFain mentioned this pull request Sep 20, 2023

[Native Image] Updated native:8.4 image demisto/content#29792

Merged

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

auth-utils: add support in the native image #19619

auth-utils: add support in the native image #19619

ilappe commented Aug 30, 2023

JudahSchwartz left a comment

JudahSchwartz Sep 5, 2023

JudahSchwartz commented Sep 5, 2023

GuyAfik left a comment •

edited

xsoar-bot commented Sep 6, 2023

xsoar-bot commented Sep 6, 2023

xsoar-bot commented Sep 19, 2023

GuyAfik left a comment

JudahSchwartz commented Sep 20, 2023

xsoar-bot commented Sep 20, 2023

xsoar-bot commented Sep 20, 2023

auth-utils: add support in the native image #19619

auth-utils: add support in the native image #19619

Conversation

ilappe commented Aug 30, 2023

Related Content Pull Request

Related Issues

Related PRs

Description

JudahSchwartz left a comment

Choose a reason for hiding this comment

JudahSchwartz Sep 5, 2023

Choose a reason for hiding this comment

JudahSchwartz commented Sep 5, 2023

GuyAfik left a comment • edited

Choose a reason for hiding this comment

xsoar-bot commented Sep 6, 2023

Docker Image Ready - Dev

Docker Metadata

xsoar-bot commented Sep 6, 2023

Docker Image Ready - Dev

Docker Metadata

xsoar-bot commented Sep 19, 2023

Docker Image Ready - Dev

Docker Metadata

GuyAfik left a comment

Choose a reason for hiding this comment

JudahSchwartz commented Sep 20, 2023

xsoar-bot commented Sep 20, 2023

Docker Image Ready - Dev

Docker Metadata

xsoar-bot commented Sep 20, 2023

Docker Image Ready - Production

Docker Metadata

GuyAfik left a comment •

edited