Test Results for pstore Unit and System Tests

Test the llvm-prepo toolchain using the pstore unit and system tests. The work invokes:

1. Build llvm-repo/clang-repo toolchain with Debug configuration.
   1. llvm-prepo(commit: 547050a5f2a54469de5bbddcc8215001c17d0ca0)
   2. pstore (commit: 606058c761646b8c38388a8fa6bb7503198300e7)
2. For each pstore unit test target except pstore-broker-unit-tests:
   1. Compile the pstore unit tests targeting the program repository using the above compiler.
   2. Convert the Repo ticket files to ELF object files using repo2obj.
   3. Link the ELF object files to generate an executable ELF file.
   4. Run the executable file and check the unit tests pass.
   5. Repeat for the remaining unit test targets.
3. clean the build by deleting all ticket files (retain the clang.db database).
4. Repeat step 2 to produce the result for the second time build (note: all fragments are in the database.)

The pstore unit tests

The pstore unit tests have been built and run twice with debug and release configuration.

Debug build

Compiler switches: -O0 -fno-exceptions -fno-rtti.

Unit Tests	prepo 1st build	prepo 1st run	prepo 2nd build	prepo 2nd run
pstore-support-unit-tests	✔	✔	✔	✔
pstore-core-unit-tests	✔	✔	✔	✔
pstore-cmd-util-unit-tests	✔	✔	✔	✔
pstore-diff-unit-tests	✔	✔	✔	✔
pstore-dump-unit-tests	✔	✔	✔	✔
pstore-json-unit-tests	✔	✔	✔	✔
pstore-mcrepo-unit-tests	✔	✔	✔	✔
pstore-serialize-unit-tests	✔	✔	✔	✔

Release build

Compiler switches: -O3 -fno-exceptions -fno-rtti.

Unit Tests	prepo 1st build	prepo 1st run	prepo 2nd build	prepo 2nd run
pstore-support-unit-tests	✔	✔	✔	✔
pstore-core-unit-tests	✔	✔	✔	✔
pstore-cmd-util-unit-tests	✔	✔	✔	✔
pstore-diff-unit-tests	✔	✔	✔	✔
pstore-dump-unit-tests	✔	✔	✔	✔
pstore-json-unit-tests	✔	✔	✔	✔
pstore-mcrepo-unit-tests	✔	✔	✔	✔
pstore-serialize-unit-tests	✔	✔	✔	✔

The pstore system tests (enabled pstore examples)

The pstore system tests have been built and run twice with debug and release configuration.

1. Unsupported Tests: broker/broker1.test and broker/broker_kill.test.
2. Expected Failures: bad/empty.test, index/dump_missing_file.test and index/read_missing_file.test.
3. Other tests are expected to pass.

Debug build

Compiler switches: -O0 -fno-exceptions -fno-rtti

System Tests	prepo 1st build	prepo 1st run	prepo 2nd build	prepo 2nd run
bad/empty.test	✔	✔	✔	✔
fuzzing/dump_indices.test	✔	✔	✔	✔
fuzzing/dump_log.test	✔	✔	✔	✔
fuzzing/dump_header.test	✔	✔	✔	✔
fuzzing/dump_contents.test	✔	✔	✔	✔
fuzzing/dump_shared_memory.test	✔	✔	✔	✔
fuzzing/write.test	✔	✔	✔	✔
fuzzing/vacuumd.test	✔	✔	✔	✔
index/name.test	✔	✔	✔	✔
index/name_and_write.test	✔	✔	✔	✔
index/put1.test	✔	✔	✔	✔
index/put2.test	✔	✔	✔	✔
index/put3.test	✔	✔	✔	✔
index/write.test	✔	✔	✔	✔
serialize/ex1.t	✔	✔	✔	✔
serialize/ex2.t	✔	✔	✔	✔
serialize/istream_reader.t	✔	✔	✔	✔
serialize/nonpod1.t	✔	✔	✔	✔
serialize/nonpod2.t	✔	✔	✔	✔
serialize/ostream_writer.t	✔	✔	✔	✔
index/large1.test	✔	✔	✔	✔
index/large2.test	✔	✔	✔	✔
index/hamt_test.test	✔	✔	✔	✔
bad/empty.test	✔	✔	✔	✔
index/dump_missing_file.test	✔	✔	✔	✔
index/read_missing_file.test	✔	✔	✔	✔

Release build

Compiler switches: -O3 -fno-exceptions -fno-rtti.

Unit Tests	prepo 1st build	prepo 1st run	prepo 2nd build	prepo 2nd run
bad/empty.test	✔	✔	✔	✔
fuzzing/dump_indices.test	✔	✔	✔	✔
fuzzing/dump_log.test	✔	✔	✔	✔
fuzzing/dump_header.test	✔	✔	✔	✔
fuzzing/dump_contents.test	✔	✔	✔	✔
fuzzing/dump_shared_memory.test	✔	✔	✔	✔
fuzzing/write.test	✔	✔	✔	✔
fuzzing/vacuumd.test	✔	✔	✔	✔
index/name.test	✔	✔	✔	✔
index/name_and_write.test	✔	✔	✔	✔
index/put1.test	✔	✔	✔	✔
index/put2.test	✔	✔	✔	✔
index/put3.test	✔	✔	✔	✔
index/write.test	✔	✔	✔	✔
serialize/ex1.t	✔	✔	✔	✔
serialize/ex2.t	✔	✔	✔	✔
serialize/istream_reader.t	✔	✔	✔	✔
serialize/nonpod1.t	✔	✔	✔	✔
serialize/nonpod2.t	✔	✔	✔	✔
serialize/ostream_writer.t	✔	✔	✔	✔
index/large1.test	✔	✔	✔	✔
index/large2.test	✔	✔	✔	✔
index/hamt_test.test	✔	✔	✔	✔
bad/empty.test	✔	✔	✔	✔
index/dump_missing_file.test	✔	✔	✔	✔
index/read_missing_file.test	✔	✔	✔	✔