Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve sequential string detection #207

Merged
merged 1 commit into from
Jul 9, 2019

Conversation

OiCMudkips
Copy link
Contributor

  • Ensure that we catch all base64 strings correctly
  • Add an explicit check for alphanumeric sequences
  • Add some more tests for sequential string detection

Fixes #200

@OiCMudkips OiCMudkips self-assigned this Jul 8, 2019
Copy link
Collaborator

@KevinHock KevinHock left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm 🚢 🐑


# Number sequences
'0123456789',
'1234567890',

# alphanumeric sequences
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super nit lol: Most comments start capitalized, e.g. Number sequences above

* Ensure that we catch all base64 strings correctly
* Add an explicit check for alphanumeric sequences
* Add some more tests for sequential string detection
@OiCMudkips OiCMudkips force-pushed the better_sequential_filtering branch from 4310fa9 to a183582 Compare July 8, 2019 23:12
@OiCMudkips
Copy link
Contributor Author

Right, just for posterity, I tested this manually with a YAML file with the config config: ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/ and the resulting baseline had no secrets, which is expected with this change.

@OiCMudkips OiCMudkips merged commit d0bea23 into Yelp:master Jul 9, 2019
@OiCMudkips OiCMudkips deleted the better_sequential_filtering branch July 9, 2019 22:52
killuazhu pushed a commit to killuazhu/detect-secrets that referenced this pull request Oct 30, 2019
* clarify var names in test

* help text

* correcting account / pw test verification path

* correcting validation error response

* change detector vars & add cases

* detection tests clean pending verification tests

* all tests clean

* added more key assignment tests

* PR simplifications

* fix capture group

* fix capture group 2
killuazhu pushed a commit to IBM/detect-secrets that referenced this pull request May 28, 2020
* clarify var names in test

* help text

* correcting account / pw test verification path

* correcting validation error response

* change detector vars & add cases

* detection tests clean pending verification tests

* all tests clean

* added more key assignment tests

* PR simplifications

* fix capture group

* fix capture group 2
killuazhu pushed a commit to IBM/detect-secrets that referenced this pull request Jul 9, 2020
* clarify var names in test

* help text

* correcting account / pw test verification path

* correcting validation error response

* change detector vars & add cases

* detection tests clean pending verification tests

* all tests clean

* added more key assignment tests

* PR simplifications

* fix capture group

* fix capture group 2
killuazhu pushed a commit to IBM/detect-secrets that referenced this pull request Sep 17, 2020
adding cloudant to base plugins (Yelp#220)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add base 64 charset to filters.py
2 participants