New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more container-based 3rd party application tests #172

Open
smlambert opened this Issue Nov 15, 2017 · 4 comments

Comments

4 participants
@smlambert
Contributor

smlambert commented Nov 15, 2017

As an example of this type of testing, we have added scala tests: https://github.com/AdoptOpenJDK/openjdk-tests/tree/master/thirdparty_containers/scala

We have derby and solr_lucene tests running in the same "dockerized" way, so we should also add those test sub-folders.

Once we have those 3 examples of 3rd party application tests added, we should consider the list of other applications we would like to add and prioritize them (eclipse, cassandra, etc). It will also be good to engage with these communities so that they are aware that we will be running their community test suites against the different flavours of JVM at AdoptOpenJDK (openjdk8, openjdk9, openjdk+openj9...).

Here is a list of potential ones to add, not in any priority order:

Also, this Testing Java link and this Quality Outreach link relates to this effort (engaging with Java projects, unblocking them if they have issues)...

@suman-mitra

This comment has been minimized.

Contributor

suman-mitra commented Mar 28, 2018

Add Elasticsearch under thirdparty container tests
#360

@tellison

This comment has been minimized.

Member

tellison commented Apr 30, 2018

In additional to a broad set of application tests to prove the quality of the binaries, it would be useful to have a suite of MicroProfile tests to demonstrate that our binaries are a good foundation for MicroProfile.

Microprofile doesn't have a reference implementation, rather there are a number of popular implementations that cover different proportions of the specification.

The following projects will provide a good test environment for our binaries:

The tests would be taken from the MicroProfile TCKs, e.g. fault tolerance APIs, metrics APIs, etc. Note that not all the implementations implement every part of the MicroProfile spec, so we'd need to define the appropriate set of TCKs to run against each implementation.

As the MicroProfile projects are open communities, I expect we can get help in putting together the tests and running them on our test farm.

@kwsutter

This comment has been minimized.

kwsutter commented May 2, 2018

This is a little bit longer term, but you should also consider the use of the Jakarta EE test suite (CTS) when that becomes available under Eclipse licensing. I know from personal experience that running the CTS can be complicated and time-consuming. So, maybe we can work with the various vendors and developers that have or will be running the Jakarta EE CTS to also run with AdoptOpenJDK binaries. Not as a requirement, but as a "friend of open source". We're still a few months away before these test suites will be available and usable, but something to keep in your back pocket for future testing efforts.

@smlambert

This comment has been minimized.

Contributor

smlambert commented May 2, 2018

Thanks @tellison and @kwsutter - we are in process of updating our test doc to state our goals around running these external tests and engaging with the open-source communities (Summarized mission: us running their tests, them using adopt SDKs, attempting to make both aspects of testing drop-dead easy).

Both your suggestions fit in with the overall mission. 👍 Link to updated mission statement to come shortly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment