Test Case 1: Bundle that references non-accumulating collections by LIDVID #32

jordanpadams · 2020-04-14T00:46:23Z

Test data:

https://pdssbn.astro.umd.edu/holdings/pds4-compil-comet-v1.0/
https://pdssbn.astro.umd.edu/holdings/pds4-epoxi_mri-v1.0/
https://pdssbn.astro.umd.edu/holdings/pds4-soho-v1.0/

Downloaded and ran from pds-gamma:

https://pds-gamma.jpl.nasa.gov/data/pds4/test-bundles/pds4-compil-comet-v1.0/
https://pds-gamma.jpl.nasa.gov/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/
https://pds-gamma.jpl.nasa.gov/data/pds4/test-bundles/pds4-soho-v1.0/

These test cases reference by LID, but the LIDVID case would be handled by one of #35

jordanpadams · 2020-06-05T00:27:06Z

Executed successfully:

(base) [jpadams@pds-gamma ~]$ pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 👟 PDS Deep Archive, version 0.1.0
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 🎉  Success! AIP done, files generated:
INFO • Checksum manifest: compil-comet_v4.0_checksum_manifest_v4.0.tab
INFO • Transfer manifest: compil-comet_v4.0_transfer_manifest_v4.0.tab
INFO • XML label for them both: compil-comet_v4.0_aip_v4.0.xml
WARNING 🤚 Notice! --include-all-collections isn't yet supported; will assume it's enabled for now
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml, generated these output files:
INFO • SIP Manifest: compil-comet_v4.0_sip_v1.0.tab
INFO • XML label for the SIP: compil-comet_v4.0_sip_v1.0.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
(base) [jpadams@pds-gamma ~]$ pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/
data_calibrated/                pds4-soho-v1.0/                 uvs_data_calibrated.tar.gz
pds4-compil-comet-v1.0/         pdssbn.astro.umd.edu/
pds4-epoxi_mri-v1.0/            urn-nasa-pds-insight_documents/
(base) [jpadams@pds-gamma ~]$ pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 👟 PDS Deep Archive, version 0.1.0
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 🎉  Success! AIP done, files generated:
INFO • Checksum manifest: epoxi_mri_v1.0_checksum_manifest_v1.0.tab
INFO • Transfer manifest: epoxi_mri_v1.0_transfer_manifest_v1.0.tab
INFO • XML label for them both: epoxi_mri_v1.0_aip_v1.0.xml
WARNING 🤚 Notice! --include-all-collections isn't yet supported; will assume it's enabled for now
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml, generated these output files:
INFO • SIP Manifest: epoxi_mri_v1.0_sip_v1.0.tab
INFO • XML label for the SIP: epoxi_mri_v1.0_sip_v1.0.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
(base) [jpadams@pds-gamma ~]$ pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 👟 PDS Deep Archive, version 0.1.0
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 🎉  Success! AIP done, files generated:
INFO • Checksum manifest: soho_v1.0_checksum_manifest_v1.0.tab
INFO • Transfer manifest: soho_v1.0_transfer_manifest_v1.0.tab
INFO • XML label for them both: soho_v1.0_aip_v1.0.xml
WARNING 🤚 Notice! --include-all-collections isn't yet supported; will assume it's enabled for now
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml, generated these output files:
INFO • SIP Manifest: soho_v1.0_sip_v1.0.tab
INFO • XML label for the SIP: soho_v1.0_sip_v1.0.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!

jordanpadams · 2020-06-05T00:30:01Z

Validated successfully:

(base) [jpadams@pds-gamma ~]$ validate-1.23.1/bin/validate -t pds-deep-archive-testing/*.xml

PDS Validate Tool Report

Configuration:
   Version                       1.23.1
   Date                          2020-06-05T00:29:15Z

Parameters:
   Targets                       [file:/home/jpadams/pds-deep-archive-testing/compil-comet_v4.0_aip_v4.0.xml, file:/home/jpadams/pds-deep-archive-testing/compil-comet_v4.0_sip_v1.0.xml, file:/home/jpadams/pds-deep-archive-testing/epoxi_mri_v1.0_aip_v1.0.xml, file:/home/jpadams/pds-deep-archive-testing/epoxi_mri_v1.0_sip_v1.0.xml, file:/home/jpadams/pds-deep-archive-testing/insight.spice_v1.0_aip_v1.0.xml, file:/home/jpadams/pds-deep-archive-testing/insight.spice_v1.0_sip_v1.0.xml, file:/home/jpadams/pds-deep-archive-testing/soho_v1.0_aip_v1.0.xml, file:/home/jpadams/pds-deep-archive-testing/soho_v1.0_sip_v1.0.xml]
   Severity Level                WARNING
   Recurse Directories           true
   File Filters Used             [*.xml, *.XML]
   Data Content Validation       on
   Product Level Validation      on
   Max Errors                    100000
   Registered Contexts File      /home/jpadams/validate-1.23.1/resources/registered_context_products.json



Product Level Validation Results

  PASS: file:/home/jpadams/pds-deep-archive-testing/compil-comet_v4.0_aip_v4.0.xml
        1 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/compil-comet_v4.0_sip_v1.0.xml
        2 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/epoxi_mri_v1.0_aip_v1.0.xml
        3 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/epoxi_mri_v1.0_sip_v1.0.xml
        4 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/insight.spice_v1.0_aip_v1.0.xml
        5 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/insight.spice_v1.0_sip_v1.0.xml
        6 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/soho_v1.0_aip_v1.0.xml
        7 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/soho_v1.0_sip_v1.0.xml
        8 product validation(s) completed

Summary:

  0 error(s)
  0 warning(s)

  Product Validation Summary:
    8          product(s) passed
    0          product(s) failed
    0          product(s) skipped

  Referential Integrity Check Summary:
    0          check(s) passed
    0          check(s) failed
    0          check(s) skipped


End of Report
Completed execution in 8222 ms

jordanpadams · 2020-06-18T20:58:43Z

executed with latest version of pds-deep-archive successfully:

(base) [jpadams@pds-gamma 20200618]$ pds-deep-archive --version
pds-deep-archive 0.1.1

$ ~/validate-1.23.1/bin/validate -t *.xml

PDS Validate Tool Report

Configuration:
   Version                       1.23.1
   Date                          2020-06-18T20:57:40Z

Parameters:
   Targets                       [file:/home/jpadams/pds-deep-archive-testing/20200618/compil-comet_v4.0_aip_v4.0_20200618.xml, file:/home/jpadams/pds-deep-archive-testing/20200618/compil-comet_v4.0_sip_v1.0_20200618.xml, file:/home/jpadams/pds-deep-archive-testing/20200618/epoxi_mri_v1.0_aip_v1.0_20200618.xml, file:/home/jpadams/pds-deep-archive-testing/20200618/epoxi_mri_v1.0_sip_v1.0_20200618.xml, file:/home/jpadams/pds-deep-archive-testing/20200618/soho_v1.0_aip_v1.0_20200618.xml, file:/home/jpadams/pds-deep-archive-testing/20200618/soho_v1.0_sip_v1.0_20200618.xml]
   Severity Level                WARNING
   Recurse Directories           true
   File Filters Used             [*.xml, *.XML]
   Data Content Validation       on
   Product Level Validation      on
   Max Errors                    100000
   Registered Contexts File      /home/jpadams/validate-1.23.1/resources/registered_context_products.json



Product Level Validation Results

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200618/compil-comet_v4.0_aip_v4.0_20200618.xml
        1 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200618/compil-comet_v4.0_sip_v1.0_20200618.xml
        2 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200618/epoxi_mri_v1.0_aip_v1.0_20200618.xml
        3 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200618/epoxi_mri_v1.0_sip_v1.0_20200618.xml
        4 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200618/soho_v1.0_aip_v1.0_20200618.xml
        5 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200618/soho_v1.0_sip_v1.0_20200618.xml
        6 product validation(s) completed

Summary:

  0 error(s)
  0 warning(s)

  Product Validation Summary:
    6          product(s) passed
    0          product(s) failed
    0          product(s) skipped

  Referential Integrity Check Summary:
    0          check(s) passed
    0          check(s) failed
    0          check(s) skipped


End of Report
Completed execution in 9042 ms

Submitting to NSSDCA for integration testing.

jordanpadams · 2020-07-01T02:33:14Z

Re-running test:

$ pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 👟 PDS Deep Archive, version 0.1.2
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: compil-comet_v4.0_checksum_manifest_v4.0_20200701.tab
INFO 📄 Transfer manifest: compil-comet_v4.0_transfer_manifest_v4.0_20200701.tab
INFO 📄 XML label for them both: compil-comet_v4.0_aip_v4.0_20200701.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml, generated these output files:
INFO 📄 SIP Manifest: compil-comet_v4.0_sip_v1.0_20200701.tab
INFO 📄 XML label for the SIP: compil-comet_v4.0_sip_v1.0_20200701.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
(base) [jpadams@pds-gamma 20200630]$ pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 👟 PDS Deep Archive, version 0.1.2
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: epoxi_mri_v1.0_checksum_manifest_v1.0_20200701.tab
INFO 📄 Transfer manifest: epoxi_mri_v1.0_transfer_manifest_v1.0_20200701.tab
INFO 📄 XML label for them both: epoxi_mri_v1.0_aip_v1.0_20200701.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml, generated these output files:
INFO 📄 SIP Manifest: epoxi_mri_v1.0_sip_v1.0_20200701.tab
INFO 📄 XML label for the SIP: epoxi_mri_v1.0_sip_v1.0_20200701.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
(base) [jpadams@pds-gamma 20200630]$ pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 👟 PDS Deep Archive, version 0.1.2
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: soho_v1.0_checksum_manifest_v1.0_20200701.tab
INFO 📄 Transfer manifest: soho_v1.0_transfer_manifest_v1.0_20200701.tab
INFO 📄 XML label for them both: soho_v1.0_aip_v1.0_20200701.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml, generated these output files:
INFO 📄 SIP Manifest: soho_v1.0_sip_v1.0_20200701.tab
INFO 📄 XML label for the SIP: soho_v1.0_sip_v1.0_20200701.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!

jordanpadams · 2020-07-02T04:03:18Z

$ date
Wed Jul  1 20:55:12 PDT 2020

$ pds-deep-archive -s PDS_SBN -b https://pds.nasa.gov/data/pds4/test-bundles/ /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0-secondary-collection-test/bundle.xml; pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml; pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml; pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml; pds-deep-archive -s PDS_GEO -b  https://pds.nasa.gov/data/pds4/test-bundles/ /data/local/starbase/data/pds4/test-bundles/urn-nasa-pds-insight_documents/bundle_insight_documents.xml
INFO 👟 PDS Deep Archive, version 0.1.4
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0-secondary-collection-test/bundle.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: epoxi_mri_test_v1.0_checksum_manifest_v1.0_20200702.tab
INFO 📄 Transfer manifest: epoxi_mri_test_v1.0_transfer_manifest_v1.0_20200702.tab
INFO 📄 XML label for them both: epoxi_mri_test_v1.0_aip_v1.0_20200702.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0-secondary-collection-test/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0-secondary-collection-test/bundle.xml, generated these output files:
INFO 📄 SIP Manifest: epoxi_mri_test_v1.0_sip_v1.0_20200702.tab
INFO 📄 XML label for the SIP: epoxi_mri_test_v1.0_sip_v1.0_20200702.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
INFO 👟 PDS Deep Archive, version 0.1.4
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: compil-comet_v4.0_checksum_manifest_v1.0_20200702.tab
INFO 📄 Transfer manifest: compil-comet_v4.0_transfer_manifest_v1.0_20200702.tab
INFO 📄 XML label for them both: compil-comet_v4.0_aip_v1.0_20200702.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-compil-comet-v1.0/bundle.xml, generated these output files:
INFO 📄 SIP Manifest: compil-comet_v4.0_sip_v1.0_20200702.tab
INFO 📄 XML label for the SIP: compil-comet_v4.0_sip_v1.0_20200702.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
INFO 👟 PDS Deep Archive, version 0.1.4
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: epoxi_mri_v1.0_checksum_manifest_v1.0_20200702.tab
INFO 📄 Transfer manifest: epoxi_mri_v1.0_transfer_manifest_v1.0_20200702.tab
INFO 📄 XML label for them both: epoxi_mri_v1.0_aip_v1.0_20200702.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0/bundle.xml, generated these output files:
INFO 📄 SIP Manifest: epoxi_mri_v1.0_sip_v1.0_20200702.tab
INFO 📄 XML label for the SIP: epoxi_mri_v1.0_sip_v1.0_20200702.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
INFO 👟 PDS Deep Archive, version 0.1.4
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: soho_v1.0_checksum_manifest_v1.0_20200702.tab
INFO 📄 Transfer manifest: soho_v1.0_transfer_manifest_v1.0_20200702.tab
INFO 📄 XML label for them both: soho_v1.0_aip_v1.0_20200702.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/pds4-soho-v1.0/bundle.xml, generated these output files:
INFO 📄 SIP Manifest: soho_v1.0_sip_v1.0_20200702.tab
INFO 📄 XML label for the SIP: soho_v1.0_sip_v1.0_20200702.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!
INFO 👟 PDS Deep Archive, version 0.1.4
INFO 🏃‍♀️ Starting AIP generation for /data/local/starbase/data/pds4/test-bundles/urn-nasa-pds-insight_documents/bundle_insight_documents.xml
INFO 🎉 Success! AIP done, files generated:
INFO 📄 Checksum manifest: insight_documents_v2.0_checksum_manifest_v1.0_20200702.tab
INFO 📄 Transfer manifest: insight_documents_v2.0_transfer_manifest_v1.0_20200702.tab
INFO 📄 XML label for them both: insight_documents_v2.0_aip_v1.0_20200702.xml
INFO 🏃‍♀️ Starting SIP generation for /data/local/starbase/data/pds4/test-bundles/urn-nasa-pds-insight_documents/bundle_insight_documents.xml
INFO 🎉 Success! From /data/local/starbase/data/pds4/test-bundles/urn-nasa-pds-insight_documents/bundle_insight_documents.xml, generated these output files:
INFO 📄 SIP Manifest: insight_documents_v2.0_sip_v1.0_20200702.tab
INFO 📄 XML label for the SIP: insight_documents_v2.0_sip_v1.0_20200702.xml
INFO 👋 That's it! Thanks for making an AIP and SIP with us today. Bye!

$ ls
total 476
drwxrwxr-x 2 jpadams pds  4096 Jul  1 20:54 ./
drwxrwxr-x 5 jpadams pds  4096 Jul  1 20:23 ../
-rw-rw-r-- 1 jpadams pds  4190 Jul  1 20:55 compil-comet_v4.0_aip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds  9872 Jul  1 20:55 compil-comet_v4.0_checksum_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds 27532 Jul  1 20:55 compil-comet_v4.0_sip_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4625 Jul  1 20:55 compil-comet_v4.0_sip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds 74240 Jul  1 20:55 compil-comet_v4.0_transfer_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4198 Jul  1 20:55 epoxi_mri_test_v1.0_aip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds  1358 Jul  1 20:55 epoxi_mri_test_v1.0_checksum_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4301 Jul  1 20:55 epoxi_mri_test_v1.0_sip_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4597 Jul  1 20:55 epoxi_mri_test_v1.0_sip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds  9728 Jul  1 20:55 epoxi_mri_test_v1.0_transfer_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4168 Jul  1 20:55 epoxi_mri_v1.0_aip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds  1358 Jul  1 20:55 epoxi_mri_v1.0_checksum_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  3598 Jul  1 20:55 epoxi_mri_v1.0_sip_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4572 Jul  1 20:55 epoxi_mri_v1.0_sip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds  9728 Jul  1 20:55 epoxi_mri_v1.0_transfer_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4217 Jul  1 20:55 insight_documents_v2.0_aip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds  5874 Jul  1 20:55 insight_documents_v2.0_checksum_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds 16609 Jul  1 20:55 insight_documents_v2.0_sip_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4628 Jul  1 20:55 insight_documents_v2.0_sip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds 38400 Jul  1 20:55 insight_documents_v2.0_transfer_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4144 Jul  1 20:55 soho_v1.0_aip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds 14123 Jul  1 20:55 soho_v1.0_checksum_manifest_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds 35221 Jul  1 20:55 soho_v1.0_sip_v1.0_20200702.tab
-rw-rw-r-- 1 jpadams pds  4615 Jul  1 20:55 soho_v1.0_sip_v1.0_20200702.xml
-rw-rw-r-- 1 jpadams pds 88576 Jul  1 20:55 soho_v1.0_transfer_manifest_v1.0_20200702.tab

# Validation was successful
$ ~/validate-1.23.1/bin/validate -t *.xml

PDS Validate Tool Report

Configuration:
   Version                       1.23.1
   Date                          2020-07-02T03:56:23Z

Parameters:
   Targets                       [file:/home/jpadams/pds-deep-archive-testing/20200701/compil-comet_v4.0_aip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/compil-comet_v4.0_sip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_test_v1.0_aip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_test_v1.0_sip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_v1.0_aip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_v1.0_sip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/insight_documents_v2.0_aip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/insight_documents_v2.0_sip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/soho_v1.0_aip_v1.0_20200702.xml, file:/home/jpadams/pds-deep-archive-testing/20200701/soho_v1.0_sip_v1.0_20200702.xml]
   Severity Level                WARNING
   Recurse Directories           true
   File Filters Used             [*.xml, *.XML]
   Data Content Validation       on
   Product Level Validation      on
   Max Errors                    100000
   Registered Contexts File      /home/jpadams/validate-1.23.1/resources/registered_context_products.json



Product Level Validation Results

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/compil-comet_v4.0_aip_v1.0_20200702.xml
        1 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/compil-comet_v4.0_sip_v1.0_20200702.xml
        2 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_test_v1.0_aip_v1.0_20200702.xml
        3 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_test_v1.0_sip_v1.0_20200702.xml
        4 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_v1.0_aip_v1.0_20200702.xml
        5 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/epoxi_mri_v1.0_sip_v1.0_20200702.xml
        6 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/insight_documents_v2.0_aip_v1.0_20200702.xml
        7 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/insight_documents_v2.0_sip_v1.0_20200702.xml
        8 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/soho_v1.0_aip_v1.0_20200702.xml
        9 product validation(s) completed

  PASS: file:/home/jpadams/pds-deep-archive-testing/20200701/soho_v1.0_sip_v1.0_20200702.xml
        10 product validation(s) completed

Summary:

  0 error(s)
  0 warning(s)

  Product Validation Summary:
    10         product(s) passed
    0          product(s) failed
    0          product(s) skipped

  Referential Integrity Check Summary:
    0          check(s) passed
    0          check(s) failed
    0          check(s) skipped


End of Report
Completed execution in 6934 ms

# All .TAB files match as expected
$ wc -l *.tab
   145 compil-comet_v4.0_checksum_manifest_v1.0_20200702.tab
   145 compil-comet_v4.0_sip_v1.0_20200702.tab
   145 compil-comet_v4.0_transfer_manifest_v1.0_20200702.tab
    19 epoxi_mri_test_v1.0_checksum_manifest_v1.0_20200702.tab
    19 epoxi_mri_test_v1.0_sip_v1.0_20200702.tab
    19 epoxi_mri_test_v1.0_transfer_manifest_v1.0_20200702.tab
    19 epoxi_mri_v1.0_checksum_manifest_v1.0_20200702.tab
    19 epoxi_mri_v1.0_sip_v1.0_20200702.tab
    19 epoxi_mri_v1.0_transfer_manifest_v1.0_20200702.tab
    75 insight_documents_v2.0_checksum_manifest_v1.0_20200702.tab
    75 insight_documents_v2.0_sip_v1.0_20200702.tab
    75 insight_documents_v2.0_transfer_manifest_v1.0_20200702.tab
   173 soho_v1.0_checksum_manifest_v1.0_20200702.tab
   173 soho_v1.0_sip_v1.0_20200702.tab
   173 soho_v1.0_transfer_manifest_v1.0_20200702.tab

# All SIP checkout
(base) [jpadams@pds-gamma 20200701]$ diff ../20200630/compil-comet_v4.0_sip_v1.0_20200701.tab compil-comet_v4.0_sip_v1.0_20200702.tab
(base) [jpadams@pds-gamma 20200701]$ diff ../20200630/epoxi_mri_test_v1.0_sip_v1.0_20200701.tab epoxi_mri_test_v1.0_sip_v1.0_20200702.tab
(base) [jpadams@pds-gamma 20200701]$ diff ../20200630/epoxi_mri_v1.0_sip_v1.0_20200701.tab epoxi_mri_v1.0_sip_v1.0_20200702.tab
(base) [jpadams@pds-gamma 20200701]$ diff ../20200630/soho_v1.0_sip_v1.0_20200701.tab soho_v1.0_sip_v1.0_20200702.tab
(base) [jpadams@pds-gamma 20200701]$ diff ../20200630/insight_documents_v2.0_sip_v1.0_20200701.tab insight_documents_v2.0_sip_v1.0_20200702.tab

I can't find any more bugs. This is as good as it's going to get.

jordanpadams · 2020-07-02T04:04:28Z

@nutjob4life ⬆️ 🎉 awesome stuff!

nutjob4life · 2020-07-02T13:34:48Z

🥂🍾🎊

jordanpadams self-assigned this Apr 14, 2020

jordanpadams added the test label Apr 14, 2020

jordanpadams added this to the PDS.15 (ends 2020-04-22) milestone Apr 14, 2020

jordanpadams modified the milestones: PDS.15 (ends 2020-04-22), PDS.16 (ends 2020-05-06) Apr 25, 2020

jordanpadams modified the milestones: PDS.16 (ends 2020-05-06), PDS.17 (ends 2020-05-20) May 7, 2020

jordanpadams modified the milestones: PDS.17 (ends 2020-05-20), PDS.18 (ends 2020-06-03) May 21, 2020

This was referenced Jun 5, 2020

Test Case 2: Bundle that references non-accumulating secondary collection by LID or LIDVID #33

Closed

Test Case 3: Bundle that references non-accumulating collections by LID #34

Closed

jordanpadams modified the milestones: PDS.18 (ends 2020-06-03), PDS.19 (ends 2020-06-17) Jun 5, 2020

jordanpadams mentioned this issue Jun 19, 2020

Software appears to be excluding all the products associated with the collections #69

Closed

jordanpadams closed this as completed Jul 2, 2020

jordanpadams mentioned this issue Jul 2, 2020

Test Case 5: Bundle that references accumulating collections by LID #36

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Test Case 1: Bundle that references non-accumulating collections by LIDVID #32

Test Case 1: Bundle that references non-accumulating collections by LIDVID #32

jordanpadams commented Apr 14, 2020 •

edited

Loading

jordanpadams commented Jun 5, 2020

jordanpadams commented Jun 5, 2020

jordanpadams commented Jun 18, 2020

jordanpadams commented Jul 1, 2020

jordanpadams commented Jul 2, 2020

jordanpadams commented Jul 2, 2020

nutjob4life commented Jul 2, 2020

Test Case 1: Bundle that references non-accumulating collections by LIDVID #32

Test Case 1: Bundle that references non-accumulating collections by LIDVID #32

Comments

jordanpadams commented Apr 14, 2020 • edited Loading

jordanpadams commented Jun 5, 2020

jordanpadams commented Jun 5, 2020

jordanpadams commented Jun 18, 2020

jordanpadams commented Jul 1, 2020

jordanpadams commented Jul 2, 2020

jordanpadams commented Jul 2, 2020

nutjob4life commented Jul 2, 2020

jordanpadams commented Apr 14, 2020 •

edited

Loading