New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Investigate using pushmi_pullyu with OLRC #349
Comments
Here are the major differences I've experienced when converting the CWRC perseveration tooling to use OLRC Swift as a drop-in replacement for UAL Swift. The main difference, OLRC requires an additional property, a domain as part of the authentication. As of 2023-08-15, I'm testing to see if further changes are required: https://github.com/ualbertalib/cwrc_preservation/tree/jefferya/olrc_compatibility
The ruby-openstack connection is defined here: https://github.com/ruby-openstack/ruby-openstack/blob/master/lib/openstack/connection.rb
The aforementioned OpenStack RC file can be downloaded from the Horizon UI via the upper right-hand corner user account menu. If you want to test the Swift authentication, one can use the OpenStack Swift command-line tool. The following is a command-line OpenStack Swift example that can be used to test (replace values with items from the OpenStack RC file) the individual parameters. swift --os-auth-url 'a' \
--os-username 'b' \
--os-user-domain-name 'c' \
--os-password 'd' \
--os-project-name 'e' \
--os-project-domain-id 'f' \
--auth-version 3 \
stat Note: running The install process for the Swift client is: pip3 install python-swiftclient --user One might also need |
Thanks to @jefferya work the process of redirecting PMPY to OLRC has been straightforward. The following shell command works for me to test authentication: swift --os-auth-url 'AUTH_URL' \
--os-username 'USER_NAME' \
--os-user-domain-name 'USER_DOMAIN_NAME' \
--os-password 'PASSWORD' \
--os-project-name 'PROJECT_NAME' \
--os-project-domain-name 'PROJECT_DOMAIN_NAME' \
--auth-version 3 \
stat The changes in the codebase to redirect pushing the items to OLRC Swift have been mirroring the configuration changes used to authenticate. I've successfully pushed synthetic data to a new container in OLRC. My next steps include:
|
Investigate using pushmi_pullyu with OLRC
I think we will likely need to re-configure PMPY to point to OLRC this fall. With that we might take several approaches - simple configuration of existing PMPY against a new swift container using the current API approach, or a more complex project of integrating Duracloud into our PMPY pipeline. - Kenton
First steps
Maybe the first step is seeing if our development environment will write to OLRC.
The text was updated successfully, but these errors were encountered: