Skip to content

Adding support for filtering secrets using deep learning models #873

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 13 commits into
base: master
Choose a base branch
from
Open

Adding support for filtering secrets using deep learning models #873

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
936d7c0
Adding support for filtering secrets using deep learning models from …
millianlmx Aug 6, 2024
b27bbc9
Adapting for every kind of model.
millianlmx Aug 7, 2024
4e290ec
Making transformers integration cleaner and compliant with actual cod…
millianlmx Aug 7, 2024
77fd2b4
Fixing the feature ready checking.
millianlmx Aug 7, 2024
fe0b28d
Test changes.
millianlmx Aug 27, 2024
e9ab318
Test changes.
millianlmx Aug 27, 2024
867aa1a
New fixes.
millianlmx Aug 27, 2024
dd6e04c
Fixes.
millianlmx Aug 27, 2024
e5732ee
Type fixes.
millianlmx Aug 27, 2024
687a965
Fixing CI/C checks.
millianlmx Aug 27, 2024
a40db54
Fixing test.
millianlmx Aug 27, 2024
b30e36f
Fixing CI/CD tests.
millianlmx Aug 27, 2024
74c7aa5
Correcting feature_ready test for usage of huggingface models.
millianlmx Aug 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fixing CI/CD tests.
  • Loading branch information
@millianlmx
millianlmx committed Aug 27, 2024
commit b30e36fa33445b3618fc0829e43291d79b3edf52
2 changes: 1 addition & 1 deletion detect_secrets/filters/classifier.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,7 @@ def should_exclude_secret(secret: str, plugin: Optional[Plugin] = None) -> bool:
raise AssertionError('Attempting to use uninitialized HuggingFace model.')

pipeline = get_model(model_name, token)
result:Dict[str, Union[str, float]] = pipeline(secret)[0]
result: Dict[str, Union[str, float]] = pipeline(secret)[0]

return result['label'] == 'LABEL_1' and result['score'] >= threshold

Expand Down