Older Java versions now yield a "404 Not found"

[kuoirad]

Greetings,

I'm attempting to use this module to handle installation of JDK 7 onto some machines (ETA: Ubuntu 14.04). Last time I set up a machine and needed to do an install with this module, it worked. When I attempted to bring a new machine up today, I got the following error:

Error: Execution of '/usr/bin/curl http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz -o /tmp/jdk-7u80-linux-x64.tar.gz_20170607-29275-c28sca -fsSL --max-redirs 5 --cookie oraclelicense=accept-securebackup-cookie' returned 22: curl: (22) The requested URL returned error: 404 Not Found

I was able to install the JDK for Java 8 without any problem, and also to manually download the 7u80 JDK. I also get a 404 when trying to do a manual download using wget after a few redirects.

[antoineco]

Hmm, looks like the Java archive portal is now redirecting to a "Sign in" page:
http://www.oracle.com/technetwork/java/javase/downloads/java-archive-downloads-javase7-521261.html

Downloading these releases requires an oracle.com account. If you don't have an oracle.com account you can use the links on the top of this page to learn more about it and register for one for free.

That would be very very unfortunate.

[kuoirad]

Yeah, I noticed that for my manual download.

Question to get me moving for now while you figure out if it's fixable - if I untar the tar.gz I downloaded manually into the place I specified, will the module take care of the setting alternatives and all that other stuff?

[antoineco]

If Oracle decided to give access to logged-in customers only this sounds like a problem I can't fix unfortunately :(
Oracle, come on!

If you extract your archive to /usr/java/jdk1.7.0_80 the module will do the rest yes.

[kuoirad]

Ok, thanks. Let me know if I can help with any testing or information.

(Stupid Oracle...and stupid other software vendor for not working with OpenJDK...)

[mtron]

Is it worth it adding user and pass params to auth against oracle's sso?

A proof of concept (taken from typekpb/oradown ) to login and dl 7u80 using curl & xmllint. (Set ORACLEUSER and ORACLEPASS).

OAM_REQ=$(curl -s -L -c /tmp/cookies http://download.oracle.com/otn/java/jdk/7u80-b15/jdk-7u80-linux-x64.rpm \
        -H "User-Agent: Mozilla/5.0 (Windows NT 6.2) AppleWebKit/537.13 (KHTML, like Gecko) Chrome/24.0.1290.1 Safari/537.13" | \
        xmllint --html --xpath "string(//form/input[@name='OAM_REQ']/@value)" -)

curl -o /tmp/jdk-7u80-linux-x64.rpm -L -b /tmp/cookies 'https://login.oracle.com/oam/server/sso/auth_cred_submit' \
        -H "Cookie: s_cc=true; oraclelicense=accept-securebackup-cookie" \
        -H "User-Agent: Mozilla/5.0 (Windows NT 6.2) AppleWebKit/537.13 (KHTML, like Gecko) Chrome/24.0.1290.1 Safari/537.13" \
        --data-urlencode "ssousername=${ORACLEUSER}" --data-urlencode "password=${ORACLEPASS}" \
        -d "OAM_REQ=${OAM_REQ}" --compressed

Although i doubt that the archive class would swallow crazy stuff like this :)

[antoineco]

The user and password is a simple addition, but getting the value of OAM_REQ would require some custom function. It's a good suggestion though.

[antoineco]

@mtron I'm giving a try at a Ruby implementation of the solution you suggested.

[antoineco]

@mtron @kuoirad I have a working concept in the referenced branch. Some demo cases:

1. Unauthenticated user / public file

root@b2704976f31d:/# puppet apply -te "class {'oracle_java': version => '8u144'}"
Info: Loading facts
Info: Loading facts
Info: Scope(Class[Oracle_java::Download]): Authentication not required for http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jre-8u144-linux-x64.tar.gz
Notice: Compiled catalog for b2704976f31d in environment production in 1.02 seconds

2. Unauthenticated user / private file

root@b2704976f31d:/# puppet apply -te "class {'oracle_java': version => '8u121'}"
Info: Loading facts
Info: Loading facts
Info: Scope(Class[Oracle_java::Download]): File not found at http://download.oracle.com/otn-pub/java/jdk/8u121-b13/e9e7ea248e2c4826b92b3f075a80e441/jre-8u121-linux-x64.tar.gz
Info: Scope(Class[Oracle_java::Download]): Trying authenticated download...
Info: Scope(Class[Oracle_java::Download]): Retrieving Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Found OAM_REQ parameter from Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Submitting Oracle.com SSO form.
Error: Evaluation Error: Error while evaluating a Function Call, Sign-on failed. Check your Oracle.com credentials. at /etc/puppet/code/modules/oracle_java/manifests/download.pp:33:17 on node b2704976f31d

3. Authenticated user / private file

root@b2704976f31d:/# puppet apply -te "class {'oracle_java': version => '8u121', ssousername => '[redacted]', ssopassword => '[redacted]'}"
Info: Loading facts
Info: Loading facts
Info: Scope(Class[Oracle_java::Download]): File not found at http://download.oracle.com/otn-pub/java/jdk/8u121-b13/e9e7ea248e2c4826b92b3f075a80e441/jre-8u121-linux-x64.tar.gz
Info: Scope(Class[Oracle_java::Download]): Trying authenticated download...
Info: Scope(Class[Oracle_java::Download]): Retrieving Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Found OAM_REQ parameter from Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Submitting Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Sign-on success.
Notice: Compiled catalog for b2704976f31d in environment production in 4.14 seconds

Would you mind testing for yourself and confirming this works as expected for you?

[kuoirad]

Looks like it worked for me:

[root@svrhpc2 jvm]# puppet apply -te "class {'oracle_java': version => '7', ssousername => '[redacted]', ssopassword => '[redacted]', install_path => '/usr/lib/jvm', type => 'jdk', add_alternative => true}"
Info: Loading facts
Info: Loading facts
Info: Loading facts
Warning: /etc/puppetlabs/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5
(in /etc/puppetlabs/puppet/hiera.yaml)
Info: Scope(Class[Oracle_java::Download]): File not found at http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz
Info: Scope(Class[Oracle_java::Download]): Trying authenticated download...
Info: Scope(Class[Oracle_java::Download]): Retrieving Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Found OAM_REQ parameter from Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Submitting Oracle.com SSO form.
Info: Scope(Class[Oracle_java::Download]): Sign-on success.
Notice: Compiled catalog for svrhpc2.asuragen.us in environment production in 2.52 seconds
Info: Applying configuration version '1506550087'
Notice: /Stage[main]/Oracle_java::Download/Archive[/usr/lib/jvm/jdk-7u80-linux-x64.tar.gz]/ensure: download archive from http://download.oracle.com/otn/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1506550209_bd3d4ccbd260cba6107f3415e8d9e64a to /usr/lib/jvm/jdk-7u80-linux-x64.tar.gz and extracted in /usr/lib/jvm with cleanup
Info: Class[Oracle_java::Download]: Scheduling refresh of Class[Oracle_java::Install]
Info: Class[Oracle_java::Install]: Scheduling refresh of Class[Oracle_java::Install::Targz]
Notice: /Stage[main]/Oracle_java::Install::Targz/File[/usr/lib/jvm/default]/ensure: created
Notice: /Stage[main]/Oracle_java::Alternative::Deb/Exec[add java alternative 7u80]/returns: executed successfully
Notice: Applied catalog in 44.42 seconds<

[antoineco]

Thanks for the feedback, much appreciated :)

I'll make these debug messages less verbose and draft a new version then.

[kuoirad]

Your timing was actually pretty excellent, I was re-imaging some machines today that needed a Java 7 JDK installed. I'm still doing it semi-manually locally, but it's working nicely.