Refactor Zenodo upload

[tovrstra]

The dataset on Zenodo can be improved in a few ways:

• Splitting up the dataset into one ZIP per kernel would allow for downloading a subset. This can be useful if someone only needs a part and wants to avoid downloading the full 43 GB.
• The file acid-dataset.pdf can be renamed to overview.pdf (idem for typ file).
• The zenodo.md should reference the new location of the validation results, which was previously included
• Metadata in zenodo.yaml should refer to the validation data.

[tovrstra]

My initial suggestion of nested ZIP files has some problems:

• It requires additional local storage to make these new files prior to uploading them to Zenodo (as Robbe pointed out).
• When using the data, contained ZIP files need to be unpacked if one wants to use only a part of it, which is rather inefficient. (There may be ways to avoid this, but it is certainly not a common practice to work around this limitation.)
• Nested ZIP files are more complicated to document and explain in a paper. (Minor, but can be significant in terms of getting a paper accepted.)

We could also flatten the nested ZIP files by modifying the data generation to create one large ZIP per kernel, with an internal directory layout to group data into test cases, e.g. using a tree structure along the following lines:

List of files within e.g. exp1p.zip

meta.json
nstep01024/times.npy
nstep01024/acf.npy
nstep01024/freqs.npy
nstep01024/psd.npy
nstep01024/nseq0001/sequences_01.npy
...
nstep01024/nseq0001/sequences_63.npy
nstep01024/nseq0004/sequences_01.npy
...
nstep01024/nseq0004/sequences_63.npy
...
nstep01024/nseq0256/sequences_01.npy
...
nstep01024/nseq0256/sequences_63.npy
...
nstep65536/times.npy
nstep65536/acf.npy
nstep65536/freqs.npy
nstep65536/psd.npy
...
nstep65536/nseq0256/sequences_01.npy
...
nstep01024/nseq0256/sequences_63.npy

The meta.json file is the same for all test cases if we leave out two fields (nstep and nseq, which follow from the directory names) and only keep the following:

• kernel
• nseed
• var
• acint
• corrtime_int
• corrtime_exp
• typst
• latex