Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Packages updated #484

Merged
merged 6 commits into from
Jan 4, 2024
Merged

Packages updated #484

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
04cdc8c
softreset
babenek Jan 4, 2024
eb00d1d
BM scores fix
babenek Jan 4, 2024
6302c20
Update cicd/benchmark.txt
babenek Jan 4, 2024
9b33baf
BM scores fix
babenek Jan 4, 2024
7bce0bf
[no ci] Update .github/workflows/benchmark.yml
babenek Jan 4, 2024
d5fcd80
Update .github/workflows/benchmark.yml
babenek Jan 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions .github/workflows/benchmark.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,8 @@ jobs:
- name: Checkout CredData
uses: actions/checkout@v3
with:
repository: Samsung/CredData
ref: rndlineseed
repository: babenek/CredData
babenek marked this conversation as resolved.
Show resolved Hide resolved

- name: Cache data
id: cache-data
Expand Down Expand Up @@ -62,7 +63,8 @@ jobs:
- name: Checkout CredData
uses: actions/checkout@v3
with:
repository: Samsung/CredData
ref: rndlineseed
repository: babenek/CredData
babenek marked this conversation as resolved.
Show resolved Hide resolved

- name: Cache data
id: cache-data
Expand Down
41 changes: 20 additions & 21 deletions cicd/benchmark.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,24 @@
DATA: 19379397 valid lines. MARKUP: 74004 items
DATA: 19379397 valid lines. MARKUP: 74003 items
Category Positives Negatives Template
-------------------------- ----------- ----------- ----------
Authentication Key & Token 77 1 31
Generic Secret 1056 15 203
Generic Token 333 45 558
Other 842 63097 631
Password 1399 110 4143
Predefined Pattern 330 2 40
Private Key 1009 2 32
Seed, Salt, Nonce 40 4 4
TOTAL: 5086 63276 5642
Detected Credentials: 5919
credsweeper result_cnt : 5157, lost_cnt : 0, true_cnt : 4263, false_cnt : 894
Authentication Key & Token 84 1 31
Generic Secret 1055 17 203
Generic Token 339 45 560
Other 905 62995 631
Password 1402 110 4143
Predefined Pattern 347 2 39
Private Key 1009 2 31
Seed, Salt, Nonce 44 4 4
TOTAL: 5185 63176 5642
credsweeper result_cnt : 5145, lost_cnt : 0, true_cnt : 4355, false_cnt : 790
Category TP FP TN FN FPR FNR ACC PRC RCL F1
babenek marked this conversation as resolved.
Show resolved Hide resolved
-------------------------- ---- ---- -------- ---- --------- --------- -------- -------- -------- --------
Authentication Key & Token 60 4 28 17 0.125 0.220779 0.807339 0.9375 0.779221 0.851064
Generic Secret 973 3 215 83 0.0137615 0.0785985 0.932496 0.996926 0.921402 0.957677
Generic Token 289 7 596 44 0.0116086 0.132132 0.945513 0.976351 0.867868 0.918919
Other 586 746 62982 256 0.011706 0.304038 0.984482 0.43994 0.695962 0.539098
Password 998 126 4127 401 0.0296262 0.286633 0.906759 0.8879 0.713367 0.791122
Predefined Pattern 312 2 40 18 0.0476191 0.0545455 0.946237 0.993631 0.945455 0.968944
Private Key 1009 4 30 0 0.117647 0.996165 0.996051 1 0.998022
Seed, Salt, Nonce 36 2 6 4 0.25 0.1 0.875 0.947368 0.9 0.923077
4263 894 19373417 823 4.614e-05 0.161817 0.999911 0.826643 0.838183 0.832373
Authentication Key & Token 65 4 28 19 0.125 0.22619 0.801724 0.942029 0.77381 0.849673
Generic Secret 971 3 217 84 0.0136364 0.0796209 0.931765 0.99692 0.920379 0.957122
Generic Token 291 9 596 48 0.014876 0.141593 0.939619 0.97 0.858407 0.910798
Other 655 643 62983 250 0.0101059 0.276243 0.986162 0.504622 0.723757 0.594644
Password 989 126 4127 413 0.0296262 0.294579 0.904686 0.886996 0.705421 0.785856
Predefined Pattern 334 1 40 13 0.0243902 0.037464 0.963918 0.997015 0.962536 0.979472
Private Key 1009 2 31 0 0.0606061 0.998081 0.998022 1 0.99901
Seed, Salt, Nonce 41 2 6 3 0.25 0.0681818 0.903846 0.953488 0.931818 0.942529
4355 790 19373422 830 4.078e-05 0.160077 0.999916 0.846453 0.839923 0.843175
1 change: 0 additions & 1 deletion credsweeper/filters/value_jfrog_token_check.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,6 @@ class ValueJfrogTokenCheck(Filter):
def __init__(self, config: Config = None) -> None:
# reftkn:01:0123456789:abcdefGhijklmnoPqrstuVwxyz0
self._pattern = re.compile(r"reftkn:\d+:\d+:[\w_/+-]+")
pass

def run(self, line_data: LineData, target: AnalysisTarget) -> bool:
"""Run filter checks on received token which might be structured.
Expand Down
6 changes: 3 additions & 3 deletions requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ cryptography==41.0.7
GitPython==3.1.40
google-auth-oauthlib==1.2.0
humanfriendly==10.0
lxml==4.9.3
lxml==5.0.0
oauthlib==3.2.2
openpyxl==3.1.2
pandas==2.0.3
Expand All @@ -15,7 +15,7 @@ requests==2.31.0
schwifty==2023.11.2
typing_extensions==4.9.0
whatthepatch==1.0.5
pdfminer.six==20221105
pdfminer.six==20231228
password-strength==0.0.3.post2
python-dateutil==2.8.2
pyjks==20.0.0
Expand All @@ -32,7 +32,7 @@ scipy==1.10.1
onnxruntime==1.16.3

# setup.py requirement
setuptools==69.0.2
setuptools==69.0.3

# Auxiliary
# Tests and maintenance packages
Expand Down
Loading