Move notebooks around and fix imports.

crocs-muni · Sep 19, 2022 · 7cb93cd · 7cb93cd
1 parent b1b0c25
commit 7cb93cd
Show file tree

Hide file tree

Showing 6 changed files with 152 additions and 205 deletions.
diff --git a/data/cert_id_eval/missing_ids.csv b/data/cert_id_eval/missing_ids.csv
@@ -42,7 +42,7 @@ ace7ea6d7f58dbb1,DE,,404 for report PDF
 8ed77a6223a94fb5,US,,maybe "09-1832-R-0027 V1.0" the ETR id
 422dc5758723c7d1,TR,21.0.03/TSE-CCCS-68,report not a PDF (docx)
 02482228eb547c15,US,,404 for report PDF
-4de4a9f436958574,CA,55 LSS 2020,report not a PDF (docx)
+4de4a9f436958574,CA,525 LSS 2020,report not a PDF (docx)
 c312bbf9e303b844,SE,CSEC2019012,space in cert_id
 fb6d7faf0ed2dca5,CA,,cert_id missing
 b3ae94eeccc566ba,CA,383-4-17-CR,regex missing

diff --git a/data/readme.md b/data/readme.md
@@ -1,5 +1,14 @@
 # Data
 
+## Certificate ID evaluation
+
+The directory `./cert_id_eval` contains data on a manual evaluation of certificate ID assignment.
+`missing_ids.csv` contains an evaluation of certificates to which the sec-certs tool was not able to
+find a certificate ID (to analyze why that happened and whether we could fix that).
+`duplicate_ids.csv` contains an evaluation of certificates to which the sec-certs tool assigned a duplicate
+ID (to analyze why that happened and whether we could fix that). These files are used by the `cert_id_eval.ipynb`
+Jupyter notebook which evaluates a dataset with respect to the manually labeled ground truth in them.
+
 ## CPE Matching
 
 To evaluate quality of our automatic matching of CPE names to certificates (which in turn allows us to assign CVEs to certificates), we manually evaluated candidate CPE records for all of the certificates both in FIPS and CC framework. 

diff --git a/notebooks/cc/references.ipynb b/notebooks/cc/references.ipynb
@@ -191,9 +191,9 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.10.4"
+   "version": "3.10.7"
   }
  },
  "nbformat": 4,
  "nbformat_minor": 1
-}
+}