You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As a user, it would be useful if data that I mark as pii in the metadata gets anonymized.
The new DataProcessor class should utilize the AnonymizedFaker class to handle anonymization.
Expected behavior
When configuring which transformers should be used on each field and the sdtype is not one of the basic sdtypes with a predefined transformer, then we should do the following:
If the field is marked as pii, we should configure a AnonymizedFaker class based on the details in the Additional Context section.
Otherwise we should use the default categorical transformer.
Additional context
The transformer we select if the field is marked as pii depends on the sdtype. We should follow the rules below
If another sdtype is provided, then we should attempt to search through the Faker function names for one that matches the sdtype and use that if possible. If we cannot do a search, then we will require users to provide the sdtype in the following format: provider_name.function_name
The text was updated successfully, but these errors were encountered:
Problem Description
As a user, it would be useful if data that I mark as
pii
in the metadata gets anonymized.The new
DataProcessor
class should utilize theAnonymizedFaker
class to handle anonymization.Expected behavior
sdtype
is not one of the basicsdtypes
with a predefined transformer, then we should do the following:pii
, we should configure aAnonymizedFaker
class based on the details in the Additional Context section.Additional context
The transformer we select if the field is marked as
pii
depends on thesdtype
. We should follow the rules belowIf another
sdtype
is provided, then we should attempt to search through the Faker function names for one that matches the sdtype and use that if possible. If we cannot do a search, then we will require users to provide the sdtype in the following format:provider_name.function_name
The text was updated successfully, but these errors were encountered: