From 2b46ff2d78b36fa718552de293e194191d486ec9 Mon Sep 17 00:00:00 2001 From: Michael Larabel Date: Wed, 3 Jun 2020 18:40:26 -0500 Subject: [PATCH] Prep for 9.8 M1 --- ChangeLog | 3 +- README.md | 2 +- documentation/man-pages/phoronix-test-suite.1 | 5 +- documentation/phoronix-test-suite.html | 491 ++++++------------ documentation/phoronix-test-suite.md | 491 ++++++------------ documentation/stubs/00_user_options.html | 3 + documentation/stubs/55_virtual_suites.html | 488 +++++------------ pts-core/pts-core.php | 8 +- 8 files changed, 446 insertions(+), 1045 deletions(-) diff --git a/ChangeLog b/ChangeLog index dc0dc5838a..fe8bc24074 100644 --- a/ChangeLog +++ b/ChangeLog @@ -1,6 +1,7 @@ PHORONIX TEST SUITE CHANGE-LOG -Phoronix Test Suite (Git) +Phoronix Test Suite 9.8.0 Milestone 1 +3 June 2020 pts-core: When an install fails, try a newer minor version update to that test profile if available (fixes broken download mirrors, etc) pts-core: When a newer minor version of a test profile is installed and a requested (older) one is not, use the newer compatible version diff --git a/README.md b/README.md index 955f50b99d..7bfe706d49 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# Phoronix Test Suite 9.6.1 +# Phoronix Test Suite 9.8.0m1 https://www.phoronix-test-suite.com/ The **Phoronix Test Suite** is the most comprehensive testing and benchmarking diff --git a/documentation/man-pages/phoronix-test-suite.1 b/documentation/man-pages/phoronix-test-suite.1 index 47033ec7c7..9d312f6012 100644 --- a/documentation/man-pages/phoronix-test-suite.1 +++ b/documentation/man-pages/phoronix-test-suite.1 @@ -1,4 +1,4 @@ -.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "9.6.1" +.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "9.8.0m1" .SH NAME phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation. .SH SYNOPSIS @@ -192,6 +192,9 @@ This option will list all available test profiles that are available from the en .B search This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query.. .TP +.B test-to-suite-map +This option will list all test profiles and any test suites each test belongs to. +.TP .SH ASSET CREATION .B build-suite This option will guide the user through the process of generating their own test suite, which they can then run. Optionally, passed as arguments can be the test(s) or suite(s) to add to the suite to be created, instead of being prompted through the process. diff --git a/documentation/phoronix-test-suite.html b/documentation/phoronix-test-suite.html index 47cd884747..ec772ae192 100644 --- a/documentation/phoronix-test-suite.html +++ b/documentation/phoronix-test-suite.html @@ -406,6 +406,9 @@

list-unsupported-tests

search

This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..

+

test-to-suite-map +

+

This option will list all test profiles and any test suites each test belongs to.

Asset Creation

build-suite

@@ -934,459 +937,255 @@

Module Writing


Virtual Test Suites

Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed.

Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites.


-

All PTS Tests pts/all -

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests pts/application +

All Tests in pts pts/all

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests pts/benchmark +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

benchmark Tests pts/benchmark

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library pts/blas +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.

+

BLAS (Basic Linear Algebra Sub-Routine) Library Tests pts/blas

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries pts/boost +

Boost Development Libraries Tests pts/boost

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests pts/bsd +

bsd Operating System Tests pts/bsd

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Every PTS Test pts/everything +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

disk Subsystem Tests pts/disk

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran pts/fortran +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.

+

Everything in pts pts/everything +

+

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

Fortran Tests pts/fortran

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests pts/game +

game Tests pts/game

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language pts/golang +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.

+

Go Language Tests pts/golang

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests pts/graphics -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests pts/hurd +

graphics Subsystem Tests pts/graphics

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.

Installed Tests pts/installed

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

LAPACK (Linear Algebra Pack) pts/lapack +

java Tests pts/java +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing java.

+

LAPACK (Linear Algebra Pack) Tests pts/lapack

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests pts/linux +

linux Operating System Tests pts/linux +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests pts/macosx +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

memory Subsystem Tests pts/memory

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests pts/macosx +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system.

+

network Subsystem Tests pts/network

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Node.js + NPM pts/node-npm +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.

+

Node.js + NPM Tests pts/node-npm

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV pts/opencv +

OpenCV Tests pts/opencv

This is a collection of test profiles having an external dependency on OpenCV

-

Openmpi Tests pts/openmpi +

openmpi Tests pts/openmpi

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.

-

Other Subsystem Tests pts/other +

processor Subsystem Tests pts/processor

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests pts/processor +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

python Tests pts/python

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Ruby pts/ruby +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

+

Ruby Tests pts/ruby

This is a collection of test profiles having an external dependency on Ruby

-

Rust pts/rust +

Rust Tests pts/rust

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests pts/scientific +

scientific Tests pts/scientific

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests pts/simulator +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.

+

simulator Tests pts/simulator

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests pts/solaris +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test.

+

solaris Operating System Tests pts/solaris

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam pts/steam +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.

+

system Subsystem Tests pts/system

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests pts/system +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.

+

utility Tests pts/utility

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests pts/utility +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

windows Operating System Tests pts/windows

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests pts/windows -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine pts/wine -

-

This is a collection of test profiles having an external dependency on Wine

-

Smp Tests pts/smp +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.

+

smp Tests pts/smp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

-

Cuda Tests pts/cuda +

opencl Tests pts/opencl +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.

+

cuda Tests pts/cuda

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.

-

Openmp Tests pts/openmp +

mpi Tests pts/mpi +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

+

openmp Tests pts/openmp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

-

Cloud Tests pts/cloud +

cloud Tests pts/cloud

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.

-

Docker Tests pts/docker +

docker Tests pts/docker

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.

-

Go Tests pts/go +

go Tests pts/go

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.

-

Vdpau Tests pts/vdpau +

vdpau Tests pts/vdpau

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

-

Video Tests pts/video +

video Tests pts/video

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.

-

Responsiveness Tests pts/responsiveness +

responsiveness Tests pts/responsiveness

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.

-

All SYSTEM Tests system/all -

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests system/application +

All Tests in system system/all

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests system/benchmark +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

benchmark Tests system/benchmark

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library system/blas +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.

+

BLAS (Basic Linear Algebra Sub-Routine) Library Tests system/blas

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries system/boost +

Boost Development Libraries Tests system/boost

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests system/bsd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Disk Subsystem Tests system/disk +

bsd Operating System Tests system/bsd

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system.

-

Every SYSTEM Test system/everything +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

disk Subsystem Tests system/disk

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran system/fortran +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.

+

Everything in system system/everything

-

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests system/game -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language system/golang -

-

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests system/graphics +

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

game Tests system/game

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests system/hurd +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.

+

graphics Subsystem Tests system/graphics

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.

Installed Tests system/installed

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

Java system/java -

-

This is a collection of test profiles having an external dependency on Java

-

LAPACK (Linear Algebra Pack) system/lapack -

-

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests system/linux +

linux Operating System Tests system/linux

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests system/macosx -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Memory Subsystem Tests system/memory -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system.

-

Network Subsystem Tests system/network -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system.

-

Node.js + NPM system/node-npm -

-

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV system/opencv -

-

This is a collection of test profiles having an external dependency on OpenCV

-

OpenMPI system/openmpi +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests system/macosx

-

This is a collection of test profiles having an external dependency on OpenMPI

-

Other Subsystem Tests system/other +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

network Subsystem Tests system/network

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests system/processor +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.

+

processor Subsystem Tests system/processor

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Python system/python +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

Python Tests system/python

This is a collection of test profiles having an external dependency on Python

-

Ruby system/ruby +

solaris Operating System Tests system/solaris

-

This is a collection of test profiles having an external dependency on Ruby

-

Rust system/rust -

-

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests system/scientific -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests system/simulator -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests system/solaris -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam system/steam -

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests system/system +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.

+

system Subsystem Tests system/system

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests system/utility +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.

+

utility Tests system/utility

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests system/windows +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

windows Operating System Tests system/windows

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine system/wine -

-

This is a collection of test profiles having an external dependency on Wine

-

Opencl Tests system/opencl +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.

+

opencl Tests system/opencl

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.

-

Cuda Tests system/cuda +

cuda Tests system/cuda

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.

-

All GIT Tests git/all -

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests git/application -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests git/benchmark -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library git/blas -

-

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries git/boost -

-

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests git/bsd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Disk Subsystem Tests git/disk -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system.

-

Every GIT Test git/everything -

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran git/fortran -

-

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests git/game -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language git/golang -

-

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests git/graphics -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests git/hurd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

-

Installed Tests git/installed -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

Java git/java +

All Tests in git git/all

-

This is a collection of test profiles having an external dependency on Java

-

LAPACK (Linear Algebra Pack) git/lapack +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

bsd Operating System Tests git/bsd

-

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests git/linux -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests git/macosx -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Memory Subsystem Tests git/memory -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system.

-

Network Subsystem Tests git/network -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system.

-

Node.js + NPM git/node-npm -

-

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV git/opencv +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

Everything in git git/everything

-

This is a collection of test profiles having an external dependency on OpenCV

-

OpenMPI git/openmpi -

-

This is a collection of test profiles having an external dependency on OpenMPI

-

Other Subsystem Tests git/other +

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

linux Operating System Tests git/linux

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests git/processor +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests git/macosx

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Python git/python +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

processor Subsystem Tests git/processor

-

This is a collection of test profiles having an external dependency on Python

-

Ruby git/ruby -

-

This is a collection of test profiles having an external dependency on Ruby

-

Rust git/rust +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

Rust Tests git/rust

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests git/scientific -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests git/simulator -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests git/solaris +

utility Tests git/utility

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam git/steam -

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests git/system -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests git/utility -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests git/windows -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine git/wine -

-

This is a collection of test profiles having an external dependency on Wine

-

Smp Tests git/smp +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

smp Tests git/smp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

-

All WINDOWS Tests windows/all -

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests windows/application -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests windows/benchmark +

All Tests in windows windows/all

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library windows/blas +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

benchmark Tests windows/benchmark

-

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries windows/boost -

-

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests windows/bsd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Disk Subsystem Tests windows/disk +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.

+

bsd Operating System Tests windows/bsd

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system.

-

Every WINDOWS Test windows/everything -

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran windows/fortran -

-

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests windows/game -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language windows/golang -

-

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests windows/graphics -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests windows/hurd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

-

Installed Tests windows/installed -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

Java windows/java -

-

This is a collection of test profiles having an external dependency on Java

-

LAPACK (Linear Algebra Pack) windows/lapack -

-

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests windows/linux -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests windows/macosx -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Memory Subsystem Tests windows/memory -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system.

-

Network Subsystem Tests windows/network -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system.

-

Node.js + NPM windows/node-npm -

-

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV windows/opencv -

-

This is a collection of test profiles having an external dependency on OpenCV

-

OpenMPI windows/openmpi -

-

This is a collection of test profiles having an external dependency on OpenMPI

-

Other Subsystem Tests windows/other -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests windows/processor -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Python windows/python -

-

This is a collection of test profiles having an external dependency on Python

-

Ruby windows/ruby -

-

This is a collection of test profiles having an external dependency on Ruby

-

Rust windows/rust -

-

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests windows/scientific +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

Everything in windows windows/everything

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests windows/simulator +

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

linux Operating System Tests windows/linux

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests windows/solaris +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests windows/macosx

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam windows/steam +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

processor Subsystem Tests windows/processor

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests windows/system +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

solaris Operating System Tests windows/solaris

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests windows/utility +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.

+

system Subsystem Tests windows/system

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests windows/windows +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.

+

utility Tests windows/utility

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine windows/wine +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

windows Operating System Tests windows/windows

-

This is a collection of test profiles having an external dependency on Wine

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.


Component Testing

Compiler Testing & Masking

A majority of the test profiles provided by OpenBenchmarking.org to the Phoronix Test Suite are source-based tests. Relying upon the upstream source-code for each program under test allows for the tests to be easily brought to new platforms and architectures, avoids any out-of-tree / non-default packaging differences by different distributions and operating systems, and to allow the Phoronix Test Suite user to easily test new compilers and/or compiler options. For the source-based tests, the Phoronix Test Suite relies upon a compiler (e.g. GCC, LLVM/Clang, Sun Studio, Open64, et al) being present on the system under test. The Phoronix Test Suite does respect CC/CXX environment variables and test profiles are expected to honor CFLAGS/CXXFLAGS and other compiler settings.

diff --git a/documentation/phoronix-test-suite.md b/documentation/phoronix-test-suite.md index 40c8624d22..93f3e06a58 100644 --- a/documentation/phoronix-test-suite.md +++ b/documentation/phoronix-test-suite.md @@ -217,6 +217,9 @@ This option will list all available test profiles that are available from the en #### search This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query.. +#### test-to-suite-map +This option will list all test profiles and any test suites each test belongs to. + ## Asset Creation #### build-suite @@ -1016,458 +1019,254 @@ Virtual test suites can be installed and run just like a normal XML test suite a --- -#### All PTS Tests pts/all -This is a collection of all test profiles found within the specified OpenBenchmarking.org repository. - -#### Application Tests pts/application -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test. +#### All Tests in pts pts/all +This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. -#### Benchmark Tests pts/benchmark -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test. +#### benchmark Tests pts/benchmark +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test. -#### BLAS (Basic Linear Algebra Sub-Routine) Library pts/blas +#### BLAS (Basic Linear Algebra Sub-Routine) Library Tests pts/blas This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library -#### Boost Development Libraries pts/boost +#### Boost Development Libraries Tests pts/boost This is a collection of test profiles having an external dependency on Boost Development Libraries -#### BSD Operating System Tests pts/bsd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System. +#### bsd Operating System Tests pts/bsd +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. -#### Every PTS Test pts/everything -This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests. +#### disk Subsystem Tests pts/disk +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system. -#### Fortran pts/fortran +#### Everything in pts pts/everything +This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc. + +#### Fortran Tests pts/fortran This is a collection of test profiles having an external dependency on Fortran -#### Game Tests pts/game -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test. +#### game Tests pts/game +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test. -#### Go Language pts/golang +#### Go Language Tests pts/golang This is a collection of test profiles having an external dependency on Go Language -#### Graphics Subsystem Tests pts/graphics -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system. - -#### Hurd Operating System Tests pts/hurd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System. +#### graphics Subsystem Tests pts/graphics +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system. #### Installed Tests pts/installed This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test. -#### LAPACK (Linear Algebra Pack) pts/lapack +#### java Tests pts/java +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing java. + +#### LAPACK (Linear Algebra Pack) Tests pts/lapack This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack) -#### Linux Operating System Tests pts/linux -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System. +#### linux Operating System Tests pts/linux +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System. + +#### macosx Operating System Tests pts/macosx +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System. + +#### memory Subsystem Tests pts/memory +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system. -#### MacOSX Operating System Tests pts/macosx -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System. +#### network Subsystem Tests pts/network +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system. -#### Node.js + NPM pts/node-npm +#### Node.js + NPM Tests pts/node-npm This is a collection of test profiles having an external dependency on Node.js + NPM -#### OpenCV pts/opencv +#### OpenCV Tests pts/opencv This is a collection of test profiles having an external dependency on OpenCV -#### Openmpi Tests pts/openmpi +#### openmpi Tests pts/openmpi This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi. -#### Other Subsystem Tests pts/other -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system. +#### processor Subsystem Tests pts/processor +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system. -#### Processor Subsystem Tests pts/processor -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system. +#### python Tests pts/python +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python. -#### Ruby pts/ruby +#### Ruby Tests pts/ruby This is a collection of test profiles having an external dependency on Ruby -#### Rust pts/rust +#### Rust Tests pts/rust This is a collection of test profiles having an external dependency on Rust -#### Scientific Tests pts/scientific -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test. +#### scientific Tests pts/scientific +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test. -#### Simulator Tests pts/simulator -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test. +#### simulator Tests pts/simulator +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test. -#### Solaris Operating System Tests pts/solaris -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System. +#### solaris Operating System Tests pts/solaris +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System. -#### Steam pts/steam -This is a collection of test profiles having an external dependency on Steam +#### system Subsystem Tests pts/system +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system. -#### System Subsystem Tests pts/system -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system. +#### utility Tests pts/utility +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test. -#### Utility Tests pts/utility -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test. +#### windows Operating System Tests pts/windows +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System. -#### Windows Operating System Tests pts/windows -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System. - -#### Wine pts/wine -This is a collection of test profiles having an external dependency on Wine - -#### Smp Tests pts/smp +#### smp Tests pts/smp This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp. -#### Cuda Tests pts/cuda +#### opencl Tests pts/opencl +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl. + +#### cuda Tests pts/cuda This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda. -#### Openmp Tests pts/openmp +#### mpi Tests pts/mpi +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi. + +#### openmp Tests pts/openmp This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp. -#### Cloud Tests pts/cloud +#### cloud Tests pts/cloud This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud. -#### Docker Tests pts/docker +#### docker Tests pts/docker This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker. -#### Go Tests pts/go +#### go Tests pts/go This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go. -#### Vdpau Tests pts/vdpau +#### vdpau Tests pts/vdpau This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau. -#### Video Tests pts/video +#### video Tests pts/video This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video. -#### Responsiveness Tests pts/responsiveness +#### responsiveness Tests pts/responsiveness This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness. -#### All SYSTEM Tests system/all -This is a collection of all test profiles found within the specified OpenBenchmarking.org repository. - -#### Application Tests system/application -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test. +#### All Tests in system system/all +This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. -#### Benchmark Tests system/benchmark -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test. +#### benchmark Tests system/benchmark +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test. -#### BLAS (Basic Linear Algebra Sub-Routine) Library system/blas +#### BLAS (Basic Linear Algebra Sub-Routine) Library Tests system/blas This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library -#### Boost Development Libraries system/boost +#### Boost Development Libraries Tests system/boost This is a collection of test profiles having an external dependency on Boost Development Libraries -#### BSD Operating System Tests system/bsd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System. - -#### Disk Subsystem Tests system/disk -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system. +#### bsd Operating System Tests system/bsd +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. -#### Every SYSTEM Test system/everything -This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests. +#### disk Subsystem Tests system/disk +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system. -#### Fortran system/fortran -This is a collection of test profiles having an external dependency on Fortran - -#### Game Tests system/game -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test. - -#### Go Language system/golang -This is a collection of test profiles having an external dependency on Go Language +#### Everything in system system/everything +This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc. -#### Graphics Subsystem Tests system/graphics -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system. +#### game Tests system/game +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test. -#### Hurd Operating System Tests system/hurd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System. +#### graphics Subsystem Tests system/graphics +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system. #### Installed Tests system/installed This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test. -#### Java system/java -This is a collection of test profiles having an external dependency on Java - -#### LAPACK (Linear Algebra Pack) system/lapack -This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack) - -#### Linux Operating System Tests system/linux -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System. - -#### MacOSX Operating System Tests system/macosx -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System. - -#### Memory Subsystem Tests system/memory -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system. - -#### Network Subsystem Tests system/network -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system. - -#### Node.js + NPM system/node-npm -This is a collection of test profiles having an external dependency on Node.js + NPM - -#### OpenCV system/opencv -This is a collection of test profiles having an external dependency on OpenCV +#### linux Operating System Tests system/linux +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System. -#### OpenMPI system/openmpi -This is a collection of test profiles having an external dependency on OpenMPI +#### macosx Operating System Tests system/macosx +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System. -#### Other Subsystem Tests system/other -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system. +#### network Subsystem Tests system/network +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system. -#### Processor Subsystem Tests system/processor -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system. +#### processor Subsystem Tests system/processor +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system. -#### Python system/python +#### Python Tests system/python This is a collection of test profiles having an external dependency on Python -#### Ruby system/ruby -This is a collection of test profiles having an external dependency on Ruby - -#### Rust system/rust -This is a collection of test profiles having an external dependency on Rust - -#### Scientific Tests system/scientific -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test. - -#### Simulator Tests system/simulator -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test. - -#### Solaris Operating System Tests system/solaris -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System. - -#### Steam system/steam -This is a collection of test profiles having an external dependency on Steam +#### solaris Operating System Tests system/solaris +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System. -#### System Subsystem Tests system/system -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system. +#### system Subsystem Tests system/system +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system. -#### Utility Tests system/utility -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test. +#### utility Tests system/utility +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test. -#### Windows Operating System Tests system/windows -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System. +#### windows Operating System Tests system/windows +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System. -#### Wine system/wine -This is a collection of test profiles having an external dependency on Wine - -#### Opencl Tests system/opencl +#### opencl Tests system/opencl This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl. -#### Cuda Tests system/cuda +#### cuda Tests system/cuda This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda. -#### All GIT Tests git/all -This is a collection of all test profiles found within the specified OpenBenchmarking.org repository. - -#### Application Tests git/application -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test. - -#### Benchmark Tests git/benchmark -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test. - -#### BLAS (Basic Linear Algebra Sub-Routine) Library git/blas -This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library - -#### Boost Development Libraries git/boost -This is a collection of test profiles having an external dependency on Boost Development Libraries - -#### BSD Operating System Tests git/bsd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System. - -#### Disk Subsystem Tests git/disk -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system. - -#### Every GIT Test git/everything -This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests. - -#### Fortran git/fortran -This is a collection of test profiles having an external dependency on Fortran - -#### Game Tests git/game -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test. - -#### Go Language git/golang -This is a collection of test profiles having an external dependency on Go Language - -#### Graphics Subsystem Tests git/graphics -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system. - -#### Hurd Operating System Tests git/hurd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System. - -#### Installed Tests git/installed -This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test. - -#### Java git/java -This is a collection of test profiles having an external dependency on Java +#### All Tests in git git/all +This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. -#### LAPACK (Linear Algebra Pack) git/lapack -This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack) - -#### Linux Operating System Tests git/linux -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System. - -#### MacOSX Operating System Tests git/macosx -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System. - -#### Memory Subsystem Tests git/memory -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system. - -#### Network Subsystem Tests git/network -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system. - -#### Node.js + NPM git/node-npm -This is a collection of test profiles having an external dependency on Node.js + NPM +#### bsd Operating System Tests git/bsd +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. -#### OpenCV git/opencv -This is a collection of test profiles having an external dependency on OpenCV - -#### OpenMPI git/openmpi -This is a collection of test profiles having an external dependency on OpenMPI +#### Everything in git git/everything +This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc. -#### Other Subsystem Tests git/other -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system. +#### linux Operating System Tests git/linux +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System. -#### Processor Subsystem Tests git/processor -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system. +#### macosx Operating System Tests git/macosx +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System. -#### Python git/python -This is a collection of test profiles having an external dependency on Python +#### processor Subsystem Tests git/processor +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system. -#### Ruby git/ruby -This is a collection of test profiles having an external dependency on Ruby - -#### Rust git/rust +#### Rust Tests git/rust This is a collection of test profiles having an external dependency on Rust -#### Scientific Tests git/scientific -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test. - -#### Simulator Tests git/simulator -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test. - -#### Solaris Operating System Tests git/solaris -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System. +#### utility Tests git/utility +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test. -#### Steam git/steam -This is a collection of test profiles having an external dependency on Steam - -#### System Subsystem Tests git/system -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system. - -#### Utility Tests git/utility -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test. - -#### Windows Operating System Tests git/windows -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System. - -#### Wine git/wine -This is a collection of test profiles having an external dependency on Wine - -#### Smp Tests git/smp +#### smp Tests git/smp This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp. -#### All WINDOWS Tests windows/all -This is a collection of all test profiles found within the specified OpenBenchmarking.org repository. - -#### Application Tests windows/application -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test. - -#### Benchmark Tests windows/benchmark -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test. +#### All Tests in windows windows/all +This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. -#### BLAS (Basic Linear Algebra Sub-Routine) Library windows/blas -This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library - -#### Boost Development Libraries windows/boost -This is a collection of test profiles having an external dependency on Boost Development Libraries - -#### BSD Operating System Tests windows/bsd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System. +#### benchmark Tests windows/benchmark +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test. -#### Disk Subsystem Tests windows/disk -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system. - -#### Every WINDOWS Test windows/everything -This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests. - -#### Fortran windows/fortran -This is a collection of test profiles having an external dependency on Fortran - -#### Game Tests windows/game -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test. - -#### Go Language windows/golang -This is a collection of test profiles having an external dependency on Go Language - -#### Graphics Subsystem Tests windows/graphics -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system. - -#### Hurd Operating System Tests windows/hurd -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System. - -#### Installed Tests windows/installed -This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test. - -#### Java windows/java -This is a collection of test profiles having an external dependency on Java - -#### LAPACK (Linear Algebra Pack) windows/lapack -This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack) - -#### Linux Operating System Tests windows/linux -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System. - -#### MacOSX Operating System Tests windows/macosx -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System. - -#### Memory Subsystem Tests windows/memory -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system. - -#### Network Subsystem Tests windows/network -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system. - -#### Node.js + NPM windows/node-npm -This is a collection of test profiles having an external dependency on Node.js + NPM - -#### OpenCV windows/opencv -This is a collection of test profiles having an external dependency on OpenCV - -#### OpenMPI windows/openmpi -This is a collection of test profiles having an external dependency on OpenMPI - -#### Other Subsystem Tests windows/other -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system. - -#### Processor Subsystem Tests windows/processor -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system. - -#### Python windows/python -This is a collection of test profiles having an external dependency on Python - -#### Ruby windows/ruby -This is a collection of test profiles having an external dependency on Ruby - -#### Rust windows/rust -This is a collection of test profiles having an external dependency on Rust +#### bsd Operating System Tests windows/bsd +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. -#### Scientific Tests windows/scientific -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test. +#### Everything in windows windows/everything +This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc. -#### Simulator Tests windows/simulator -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test. +#### linux Operating System Tests windows/linux +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System. -#### Solaris Operating System Tests windows/solaris -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System. +#### macosx Operating System Tests windows/macosx +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System. -#### Steam windows/steam -This is a collection of test profiles having an external dependency on Steam +#### processor Subsystem Tests windows/processor +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system. -#### System Subsystem Tests windows/system -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system. +#### solaris Operating System Tests windows/solaris +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System. -#### Utility Tests windows/utility -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test. +#### system Subsystem Tests windows/system +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system. -#### Windows Operating System Tests windows/windows -This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System. +#### utility Tests windows/utility +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test. -#### Wine windows/wine -This is a collection of test profiles having an external dependency on Wine +#### windows Operating System Tests windows/windows +This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System. # Component Testing diff --git a/documentation/stubs/00_user_options.html b/documentation/stubs/00_user_options.html index eef2075ea9..800a881683 100644 --- a/documentation/stubs/00_user_options.html +++ b/documentation/stubs/00_user_options.html @@ -188,6 +188,9 @@

list-unsupported-tests

search

This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..

+

test-to-suite-map +

+

This option will list all test profiles and any test suites each test belongs to.

Asset Creation

build-suite

diff --git a/documentation/stubs/55_virtual_suites.html b/documentation/stubs/55_virtual_suites.html index 4f1ee8f02d..36c31fc6d4 100644 --- a/documentation/stubs/55_virtual_suites.html +++ b/documentation/stubs/55_virtual_suites.html @@ -6,458 +6,254 @@

Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed.

Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running phoronix-test-suite list-available-virtual-suites.


-

All PTS Tests pts/all +

All Tests in pts pts/all

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests pts/application +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

benchmark Tests pts/benchmark

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests pts/benchmark -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library pts/blas +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.

+

BLAS (Basic Linear Algebra Sub-Routine) Library Tests pts/blas

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries pts/boost +

Boost Development Libraries Tests pts/boost

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests pts/bsd +

bsd Operating System Tests pts/bsd +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

disk Subsystem Tests pts/disk

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Every PTS Test pts/everything +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.

+

Everything in pts pts/everything

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran pts/fortran +

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

Fortran Tests pts/fortran

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests pts/game +

game Tests pts/game

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language pts/golang +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.

+

Go Language Tests pts/golang

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests pts/graphics +

graphics Subsystem Tests pts/graphics

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests pts/hurd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.

Installed Tests pts/installed

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

LAPACK (Linear Algebra Pack) pts/lapack +

java Tests pts/java +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing java.

+

LAPACK (Linear Algebra Pack) Tests pts/lapack

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests pts/linux +

linux Operating System Tests pts/linux

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests pts/macosx +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests pts/macosx

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Node.js + NPM pts/node-npm +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

memory Subsystem Tests pts/memory +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system.

+

network Subsystem Tests pts/network +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.

+

Node.js + NPM Tests pts/node-npm

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV pts/opencv +

OpenCV Tests pts/opencv

This is a collection of test profiles having an external dependency on OpenCV

-

Openmpi Tests pts/openmpi +

openmpi Tests pts/openmpi

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.

-

Other Subsystem Tests pts/other +

processor Subsystem Tests pts/processor

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests pts/processor +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

python Tests pts/python

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Ruby pts/ruby +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.

+

Ruby Tests pts/ruby

This is a collection of test profiles having an external dependency on Ruby

-

Rust pts/rust +

Rust Tests pts/rust

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests pts/scientific -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests pts/simulator +

scientific Tests pts/scientific

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests pts/solaris +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.

+

simulator Tests pts/simulator

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam pts/steam +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test.

+

solaris Operating System Tests pts/solaris

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests pts/system +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.

+

system Subsystem Tests pts/system

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests pts/utility +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.

+

utility Tests pts/utility

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests pts/windows +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

windows Operating System Tests pts/windows

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine pts/wine -

-

This is a collection of test profiles having an external dependency on Wine

-

Smp Tests pts/smp +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.

+

smp Tests pts/smp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

-

Cuda Tests pts/cuda +

opencl Tests pts/opencl +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.

+

cuda Tests pts/cuda

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.

-

Openmp Tests pts/openmp +

mpi Tests pts/mpi +

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.

+

openmp Tests pts/openmp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.

-

Cloud Tests pts/cloud +

cloud Tests pts/cloud

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.

-

Docker Tests pts/docker +

docker Tests pts/docker

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.

-

Go Tests pts/go +

go Tests pts/go

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.

-

Vdpau Tests pts/vdpau +

vdpau Tests pts/vdpau

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.

-

Video Tests pts/video +

video Tests pts/video

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.

-

Responsiveness Tests pts/responsiveness +

responsiveness Tests pts/responsiveness

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.

-

All SYSTEM Tests system/all +

All Tests in system system/all

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests system/application +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

benchmark Tests system/benchmark

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests system/benchmark -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library system/blas +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.

+

BLAS (Basic Linear Algebra Sub-Routine) Library Tests system/blas

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries system/boost +

Boost Development Libraries Tests system/boost

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests system/bsd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Disk Subsystem Tests system/disk -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system.

-

Every SYSTEM Test system/everything +

bsd Operating System Tests system/bsd

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran system/fortran +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

disk Subsystem Tests system/disk

-

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests system/game -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language system/golang +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.

+

Everything in system system/everything

-

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests system/graphics +

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

game Tests system/game

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests system/hurd +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.

+

graphics Subsystem Tests system/graphics

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.

Installed Tests system/installed

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

Java system/java -

-

This is a collection of test profiles having an external dependency on Java

-

LAPACK (Linear Algebra Pack) system/lapack -

-

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests system/linux -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests system/macosx +

linux Operating System Tests system/linux

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Memory Subsystem Tests system/memory +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests system/macosx

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system.

-

Network Subsystem Tests system/network +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

network Subsystem Tests system/network

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system.

-

Node.js + NPM system/node-npm +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.

+

processor Subsystem Tests system/processor

-

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV system/opencv -

-

This is a collection of test profiles having an external dependency on OpenCV

-

OpenMPI system/openmpi -

-

This is a collection of test profiles having an external dependency on OpenMPI

-

Other Subsystem Tests system/other -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests system/processor -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Python system/python +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

Python Tests system/python

This is a collection of test profiles having an external dependency on Python

-

Ruby system/ruby +

solaris Operating System Tests system/solaris

-

This is a collection of test profiles having an external dependency on Ruby

-

Rust system/rust +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.

+

system Subsystem Tests system/system

-

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests system/scientific -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests system/simulator -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests system/solaris -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam system/steam -

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests system/system -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests system/utility -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests system/windows +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.

+

utility Tests system/utility

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine system/wine +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

windows Operating System Tests system/windows

-

This is a collection of test profiles having an external dependency on Wine

-

Opencl Tests system/opencl +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.

+

opencl Tests system/opencl

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.

-

Cuda Tests system/cuda +

cuda Tests system/cuda

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.

-

All GIT Tests git/all -

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests git/application -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests git/benchmark -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library git/blas -

-

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries git/boost -

-

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests git/bsd +

All Tests in git git/all

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Disk Subsystem Tests git/disk +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

bsd Operating System Tests git/bsd

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system.

-

Every GIT Test git/everything -

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran git/fortran -

-

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests git/game -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language git/golang -

-

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests git/graphics -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests git/hurd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

-

Installed Tests git/installed -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

Java git/java -

-

This is a collection of test profiles having an external dependency on Java

-

LAPACK (Linear Algebra Pack) git/lapack -

-

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests git/linux +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

Everything in git git/everything

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests git/macosx +

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

linux Operating System Tests git/linux

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Memory Subsystem Tests git/memory +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests git/macosx

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system.

-

Network Subsystem Tests git/network +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

processor Subsystem Tests git/processor

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system.

-

Node.js + NPM git/node-npm -

-

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV git/opencv -

-

This is a collection of test profiles having an external dependency on OpenCV

-

OpenMPI git/openmpi -

-

This is a collection of test profiles having an external dependency on OpenMPI

-

Other Subsystem Tests git/other -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests git/processor -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Python git/python -

-

This is a collection of test profiles having an external dependency on Python

-

Ruby git/ruby -

-

This is a collection of test profiles having an external dependency on Ruby

-

Rust git/rust +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

Rust Tests git/rust

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests git/scientific -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests git/simulator -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests git/solaris -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam git/steam +

utility Tests git/utility

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests git/system -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests git/utility -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests git/windows -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine git/wine -

-

This is a collection of test profiles having an external dependency on Wine

-

Smp Tests git/smp +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

smp Tests git/smp

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.

-

All WINDOWS Tests windows/all -

-

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.

-

Application Tests windows/application -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.

-

Benchmark Tests windows/benchmark -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.

-

BLAS (Basic Linear Algebra Sub-Routine) Library windows/blas -

-

This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library

-

Boost Development Libraries windows/boost -

-

This is a collection of test profiles having an external dependency on Boost Development Libraries

-

BSD Operating System Tests windows/bsd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.

-

Disk Subsystem Tests windows/disk -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Disk sub-system.

-

Every WINDOWS Test windows/everything +

All Tests in windows windows/all

-

This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.

-

Fortran windows/fortran +

This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.

+

benchmark Tests windows/benchmark

-

This is a collection of test profiles having an external dependency on Fortran

-

Game Tests windows/game -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.

-

Go Language windows/golang -

-

This is a collection of test profiles having an external dependency on Go Language

-

Graphics Subsystem Tests windows/graphics -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.

-

Hurd Operating System Tests windows/hurd -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.

-

Installed Tests windows/installed -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.

-

Java windows/java -

-

This is a collection of test profiles having an external dependency on Java

-

LAPACK (Linear Algebra Pack) windows/lapack -

-

This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)

-

Linux Operating System Tests windows/linux -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.

-

MacOSX Operating System Tests windows/macosx -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.

-

Memory Subsystem Tests windows/memory -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Memory sub-system.

-

Network Subsystem Tests windows/network +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.

+

bsd Operating System Tests windows/bsd

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Network sub-system.

-

Node.js + NPM windows/node-npm -

-

This is a collection of test profiles having an external dependency on Node.js + NPM

-

OpenCV windows/opencv -

-

This is a collection of test profiles having an external dependency on OpenCV

-

OpenMPI windows/openmpi -

-

This is a collection of test profiles having an external dependency on OpenMPI

-

Other Subsystem Tests windows/other -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.

-

Processor Subsystem Tests windows/processor -

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.

-

Python windows/python -

-

This is a collection of test profiles having an external dependency on Python

-

Ruby windows/ruby -

-

This is a collection of test profiles having an external dependency on Ruby

-

Rust windows/rust -

-

This is a collection of test profiles having an external dependency on Rust

-

Scientific Tests windows/scientific +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.

+

Everything in windows windows/everything

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.

-

Simulator Tests windows/simulator +

This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.

+

linux Operating System Tests windows/linux

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.

-

Solaris Operating System Tests windows/solaris +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.

+

macosx Operating System Tests windows/macosx

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.

-

Steam windows/steam +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.

+

processor Subsystem Tests windows/processor

-

This is a collection of test profiles having an external dependency on Steam

-

System Subsystem Tests windows/system +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.

+

solaris Operating System Tests windows/solaris

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.

-

Utility Tests windows/utility +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.

+

system Subsystem Tests windows/system

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.

-

Windows Operating System Tests windows/windows +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.

+

utility Tests windows/utility

-

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.

-

Wine windows/wine +

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

+

windows Operating System Tests windows/windows

-

This is a collection of test profiles having an external dependency on Wine

+

This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.

diff --git a/pts-core/pts-core.php b/pts-core/pts-core.php index 1d1928cc8b..07d83ba925 100644 --- a/pts-core/pts-core.php +++ b/pts-core/pts-core.php @@ -294,10 +294,10 @@ function pts_version_codenames() ); } -pts_define('PTS_VERSION', '9.6.1'); -pts_define('PTS_CORE_VERSION', 9610); -pts_define('PTS_RELEASE_DATE', '20200525'); -pts_define('PTS_CODENAME', 'Nittedal'); +pts_define('PTS_VERSION', '9.8.0m1'); +pts_define('PTS_CORE_VERSION', 9710); +pts_define('PTS_RELEASE_DATE', '20200603'); +pts_define('PTS_CODENAME', 'Nesodden'); pts_define('PTS_IS_CLIENT', (defined('PTS_MODE') && strstr(PTS_MODE, 'CLIENT') !== false)); pts_define('PTS_IS_WEB_CLIENT', (defined('PTS_MODE') && PTS_MODE == 'WEB_CLIENT'));