Skip to content

Commit

Permalink
preparing to use repo for new results
Browse files Browse the repository at this point in the history
Signed-off-by: vsoch <vsoch@users.noreply.github.com>
  • Loading branch information
vsoch committed Jul 28, 2022
1 parent 88b2e7d commit 95d7ef7
Show file tree
Hide file tree
Showing 762 changed files with 6 additions and 3,315,770 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/artifacts.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ jobs:
- name: Get Artifacts
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
INPUT_REPOSITORY: "buildsi/build-abi-containers"
INPUT_REPOSITORY: "buildsi/splice-experiment-runs"

# Check for the last 2 days
INPUT_DAYS: 2
Expand Down
26 changes: 5 additions & 21 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,30 +1,14 @@
# Build ABI Containers Results
# Spliced Experiment Artifacts

![https://avatars.githubusercontent.com/u/85255731?s=200&v=4](https://avatars.githubusercontent.com/u/85255731?s=200&v=4)

This repository does an automated retrieval of results from [build-abi-containers](https://github.com/buildsi/build-abi-containers).
This works via the [GitHub workflow](.github/workflows/artifacts.yml) that runs
the script [get_artifacts.py](get_artifacts.py) nightly to do the following:
This repository does an automated retrieval of results from [splice-experiment-runs](https://github.com/buildsi/splice-experiment-runs). It used to derive from [build-abi-containers](https://github.com/builsi/build-abi-containers), a (previously written) GitHub pipeline that I wrote, but we didn't use.
Now I'm back to GitHub because HPC never seems to work :) The process of retrieving artifacts works via the [GitHub workflow](.github/workflows/artifacts.yml) that runs the script [get_artifacts.py](get_artifacts.py) nightly to do the following:

1. Get a listing of artifacts from [build-abi-containers](https://github.com/builsi/build-abi-containers), which saves test results for containers (a tester base like libabigail combined with multiple versions of a particular spack package) as artifacts.
1. Get a listing of artifacts from the repository that saves test results for spliced as artifacts.
2. For artifacts that are not expired (they expire typically in 90 days) and that are within 2 days of today (we don't need to parse artifacts more than once) do the following:
- If the filename does not exist under [artifacts](artifacts), which is organized by `<tester>/<tester-version>/<package>/<package-version>/<result-type>`, copy it there. It's a new result.
- If the filename already exists, compare the hashes of the two. If the hashes are different, only copy the artifact file if it's newer (it's a new version of a result).

This creates a nice structured tree of results, where the namespace is nicely organized
by tester, tester version, package version, and result types within the tester. For example, for libabigail
we likely want to run `abidw` on some set of libraries and this is saved under `lib`. For
`abidiff` we save results under a `diff` folder. Given that the library can compile an example
and run `abicompat`, that gets saved under `compat`. If you want to edit the specific versions
that are tested, and the libraries that data is extracted for, you should edit the files
in the [tests](https://github.com/buildsi/build-abi-containers/tree/main/tests) folder of the
main repository. Updating any of those files will automatically deploy a new container and generate
a new artifact that will be discovered here. If you want to update a tester base, the files
are also located in that repository.

Once we have more than one tester, we probably want to think about how to compare results between them.
But likely first we need to finish our tool [Smeagle](https://github.com/buildsi/Smeagle) to be able
to run tests here, and also to figure out what "experiments" we want to run. Likely we want
to extend the test capability beyond comparing multiple versions of the same package within
a container, so that is something to talk about too. Please [open an issue](https://github.com/buildsi/build-abi-containers-results/issues)
if you have a question or point of discussion.
by tester, tester version, package version, and result types within the tester.
Empty file added artifacts/.gitkeep
Empty file.
30 changes: 0 additions & 30 deletions artifacts/libabigail/1.8.2/ben/1.0.0/lib/librttiexcep.so.xml

This file was deleted.

This file was deleted.

20 changes: 0 additions & 20 deletions artifacts/libabigail/1.8.2/ben/1.0.0/lib/libunderlink.so.xml

This file was deleted.

This file was deleted.

31 changes: 0 additions & 31 deletions artifacts/libabigail/1.8.2/ben/2.0.0/lib/librttiexcep.so.xml

This file was deleted.

This file was deleted.

21 changes: 0 additions & 21 deletions artifacts/libabigail/1.8.2/ben/2.0.0/lib/libunderlink.so.xml

This file was deleted.

This file was deleted.

0 comments on commit 95d7ef7

Please sign in to comment.