Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Incorporate name detection into SmartTextVectorizer #456

Closed
wants to merge 142 commits into from
Closed

Incorporate name detection into SmartTextVectorizer #456

wants to merge 142 commits into from

Commits on Dec 5, 2019

  1. Re-added unary estimator code and started porting logic to Algebird m… 

    …onoids instead of custom accumulators
    @MWYang
    MWYang committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    2acf3fc View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2019

  1. Re-added JRC name dictionary and cleaned up names of methods

    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    b55c31e View commit details
    Browse the repository at this point in the history

  2. Fixed bug with AveragedValue computation; Trying to debug current Alg… 

    …ebird problem
    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    f443952 View commit details
    Browse the repository at this point in the history

  3. Fixed wrong inequality direction in guard checks

    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    557ef39 View commit details
    Browse the repository at this point in the history

  4. Added HLL back to monoid accumulator and code now compiles correctly;… 

    … Still need to fix HLL serialization in Spark issue
    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    b6728ec View commit details
    Browse the repository at this point in the history

  5. Fixed HLL in NameDetectStats not serializing correctly; Now need to f… 

    …ix printing bug for NameDetectStats
    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    ff1b2ef View commit details
    Browse the repository at this point in the history

  6. Fixed NameDetectStats printing

    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    33b77c9 View commit details
    Browse the repository at this point in the history

  7. Fixed guard stat calculation computing moments of number of tokens in… 

    …stead of moments of text length; Still need to fix no moments higher than the 1st being calculated
    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    4caec75 View commit details
    Browse the repository at this point in the history

  8. Fixed moments calculation and fixed divide by zero error when list of… 

    … tokens is empty
    @MWYang
    MWYang committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    b60dc4a View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2019

  1. Added gender identification code transforming; All previous tests now… 

    … pass
    @MWYang
    MWYang committed Dec 7, 2019
    Configuration menu
    Copy the full SHA
    469111b View commit details
    Browse the repository at this point in the history

  2. Undid SparkUtils changes, which are no longer necessary

    @MWYang
    MWYang committed Dec 7, 2019
    Configuration menu
    Copy the full SHA
    e5f169e View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2019

  1. Renamed class names to be more consistent + small fixes

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    b701612 View commit details
    Browse the repository at this point in the history

  2. Added honorific detection

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    8342dae View commit details
    Browse the repository at this point in the history

  3. Implemented RegEx checking for gender

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    2e0e85a View commit details
    Browse the repository at this point in the history

  4. Implemented mixed gender identification strategies

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    b079a27 View commit details
    Browse the repository at this point in the history

  5. Removed TODOs and extraneous functions in preparation for PR

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    a1197a7 View commit details
    Browse the repository at this point in the history

  6. Updated documentation

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    19bad0b View commit details
    Browse the repository at this point in the history

  7. Ignore null values in detecting names

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    3172bde View commit details
    Browse the repository at this point in the history

  8. Added flag for ignoring nulls

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    0d82eef View commit details
    Browse the repository at this point in the history

  9. Added sir/madam to list of honorifics

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    7812d12 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'master' into my/unary-detect-names

    @MWYang
    MWYang committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    345508f View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2019

  1. Fixed typo when adding sir/madam to list of honorifics that caused fa… 

    …iling test
    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    a80e382 View commit details
    Browse the repository at this point in the history

  2. Fixed failing test due to divide by zero NA on some inputs

    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    f7817d9 View commit details
    Browse the repository at this point in the history

  3. Cleaned up redundant import in tests

    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    cf3eff0 View commit details
    Browse the repository at this point in the history

  4. Added failing tests for STV

    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    eaaa23a View commit details
    Browse the repository at this point in the history

  5. Made small changes based on PR comments (updated inline comment and i… 

    …mport statement)
    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    b928a49 View commit details
    Browse the repository at this point in the history

  6. Created metadata case class per PR review; Added tests for metadata; … 

    …Cleaned up test code
    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    048c084 View commit details
    Browse the repository at this point in the history

  7. Added test for name threshold

    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    5d30e79 View commit details
    Browse the repository at this point in the history

  8. Updated comment about NameDetectStats.toJson

    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    78c321c View commit details
    Browse the repository at this point in the history

  9. Added tests for new NameStats feature type

    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    a597d21 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 10, 2019
    Configuration menu
    Copy the full SHA
    12b3eae View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2019

  1. Started porting over name detection code before wanting to try and si… 

    …mplify the shared code even further
    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    e299677 View commit details
    Browse the repository at this point in the history

  2. Added private declaration to methods in NameDetectFun trait

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    997a132 View commit details
    Browse the repository at this point in the history

  3. Abstracted out even more name detection logic into NameDetectUtils

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    6b8a039 View commit details
    Browse the repository at this point in the history

  4. Added default dictionaries to NameDetectUtils object (for lazy and pe… 

    …rsistent loading)
    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    1250559 View commit details
    Browse the repository at this point in the history

  5. Fixed tests sometimes failing because they were not using the same na… 

    …me dictionary as NameDetectUtils; Removed now unncessary change to RandomText test helper
    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    2d804ee View commit details
    Browse the repository at this point in the history

  6. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    f4ecea1 View commit details
    Browse the repository at this point in the history

  7. Using new util abstractions for name detection and fixed encoder issue

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    6c34935 View commit details
    Browse the repository at this point in the history

  8. Refactored STV changes to be cleaner

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    9427cd3 View commit details
    Browse the repository at this point in the history

  9. Figured out Algebird-fu so that we can perform both reduce operations… 

    … in one pass
    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    11f5bf3 View commit details
    Browse the repository at this point in the history

  10. Using Algebird shortcuts again to reduce verbosity

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    38bff0b View commit details
    Browse the repository at this point in the history

  11. Added custom enum for how to handle each column in SmartTextVectorizer

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    e823ecb View commit details
    Browse the repository at this point in the history

  12. Updated NameDetectStats.toJson to be less verbose and use custom seri… 

    …alizers
    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    5f4f592 View commit details
    Browse the repository at this point in the history

  13. Updated NameDetectStats.toJson to be less verbose and use custom seri… 

    …alizers
    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    5336e71 View commit details
    Browse the repository at this point in the history

  14. Updated STV.partition name to be more meaningful

    @MWYang
    MWYang committed Dec 11, 2019
    Configuration menu
    Copy the full SHA
    9e9c149 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2019

  1. Added back SensitiveFeatureInformation metadata files/changes

    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    141f1af View commit details
    Browse the repository at this point in the history

  2. Delete accidentally committed temporary test file

    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    33f6809 View commit details
    Browse the repository at this point in the history

  3. Added shortcut for unary name detector

    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    464fe52 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    6cc90de View commit details
    Browse the repository at this point in the history

  5. Started to make Changes to SmartTextMapVectorizer but ran into proble… 

    …m with utils and types
    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    87c568d View commit details
    Browse the repository at this point in the history

  6. Delete accidentally committed temporary test file

    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    bff4d1b View commit details
    Browse the repository at this point in the history

  7. Removed type parameter from NameDetectFun because of later conflict w… 

    …ith SmartTextMapVectorizer
    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    639af3d View commit details
    Browse the repository at this point in the history

  8. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    a8b4423 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2019

  1. Added first failing test for SmartTextMapVectorizer

    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    e7795dc View commit details
    Browse the repository at this point in the history

  2. Removed Pythonic i.e. not Scala-ic index thing and added separate cas… 

    …e for checkign the last token instead, per PR comment
    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    440068c View commit details
    Browse the repository at this point in the history

  3. Removed extraneous case classes for dictionaries, per PR comment

    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    e6136f9 View commit details
    Browse the repository at this point in the history

  4. Small fixes (updated comments, re-ordered things) per PR comments

    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    283d76e View commit details
    Browse the repository at this point in the history

  5. Removed usage of broadcast variables in transformer b/c it does not s… 

    …erialize correctly
    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    80d81ed View commit details
    Browse the repository at this point in the history

  6. Fixed serialization of GenderDetectStrategy, per PR recommendation to… 

    … test with local workflow
    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    e003eb2 View commit details
    Browse the repository at this point in the history

  7. Started merging my/unary-detect-names into my/stv-detect-names

    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    ee6c24b View commit details
    Browse the repository at this point in the history

  8. Restored GenderDetectStrategy after merge

    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    2fc0c3d View commit details
    Browse the repository at this point in the history

  9. Fixed missing plus sign in OpPipelineStageReaderWriter causing double… 

    … serialization test to fail
    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    b51e14b View commit details
    Browse the repository at this point in the history

  10. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    634b664 View commit details
    Browse the repository at this point in the history

  11. Cleaned up utils file by moving all implicit definitions to NameDetec… 

    …tStats object and started integrating name detection in SmartTextMapVectorizer
    @MWYang
    MWYang committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    03431e9 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2019

  1. Passed first test for SmartTextMapVectorizer

    @MWYang
    MWYang committed Dec 14, 2019
    Configuration menu
    Copy the full SHA
    cde7551 View commit details
    Browse the repository at this point in the history

  2. Synced changes from upstream feature branch for STV changes

    @MWYang
    MWYang committed Dec 14, 2019
    Configuration menu
    Copy the full SHA
    393275c View commit details
    Browse the repository at this point in the history

  3. Tidied up monoid definition for NameDetectStats after figuring out ho… 

    …w to use Algebird
    @MWYang
    MWYang committed Dec 14, 2019
    Configuration menu
    Copy the full SHA
    ad9574c View commit details
    Browse the repository at this point in the history

  4. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 14, 2019
    Configuration menu
    Copy the full SHA
    72a1d48 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2019

  1. Added more passing tests for SmartTextMapVectorizer

    @MWYang
    MWYang committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    a8d91de View commit details
    Browse the repository at this point in the history

  2. Started to add next test for excluding names from vector output

    @MWYang
    MWYang committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    0639af5 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2019

  1. Updated tests based on my new correct understanding that Text.empty =… 

    …> null, not empty string
    @MWYang
    MWYang committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    4f316e5 View commit details
    Browse the repository at this point in the history

  2. Fixed failing test due to constructing to-be-compared estimators diff… 

    …erently
    @MWYang
    MWYang committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    714dcdc View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2019

  1. Added first failing metadata test

    @MWYang
    MWYang committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    27a6ce6 View commit details
    Browse the repository at this point in the history

  2. Changed SensitiveFeatureInformation.Name to log gender detection stra… 

    …tegies and started on passing first sensitive feature test
    @MWYang
    MWYang committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    9e7bfd2 View commit details
    Browse the repository at this point in the history

  3. Abstracted out ordering of gender detection strategies into utils file

    @MWYang
    MWYang committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    5d7716b View commit details
    Browse the repository at this point in the history

  4. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    bc9bc63 View commit details
    Browse the repository at this point in the history

  5. Added warning logging into SmartTextVectorizer

    @MWYang
    MWYang committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    7c218e9 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2019

  1. Passed first metadata test for SmartTextVectorizer; Started to re-wor… 

    …k SensitiveFeatureInformation for map feature types
    @MWYang
    MWYang committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    500d16e View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2019

  1. Added first passing metadata test for STMapV

    @MWYang
    MWYang committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    08af16b View commit details
    Browse the repository at this point in the history

  2. Fixed OPVectorMetadataTest

    @MWYang
    MWYang committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    573820c View commit details
    Browse the repository at this point in the history

  3. Small fixes to tests

    @MWYang
    MWYang committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    eb5ff9b View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into my/unary-detect-names

    @MWYang
    MWYang committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    eaad6f8 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'my/unary-detect-names' of https://github.com/MWYang/Tra… 

    …nsmogrifAI into my/unary-detect-names
    @MWYang
    MWYang committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    2bea311 View commit details
    Browse the repository at this point in the history

  6. Small fixes (better Scala code, more safe, better patterns) from Matt… 

    …hew's PR comments
    @MWYang
    MWYang committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    77f91a2 View commit details
    Browse the repository at this point in the history

  7. Improved gender detection strategy tests to check that the correct st… 

    …rategy was used
    @MWYang
    MWYang committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    b6b385a View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2019

  1. Broke out guard check numbers into their own params

    @MWYang
    MWYang committed Dec 21, 2019
    Configuration menu
    Copy the full SHA
    8ed02bd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Dec 21, 2019
    Configuration menu
    Copy the full SHA
    e92101a View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2020

  1. Added operationName as an argument to HumanNameDetectorModel for easi… 

    …er debugging
    @MWYang
    MWYang committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    799eb58 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into my/unary-detect-names

    @MWYang
    MWYang committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    ca69ed8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'my/unary-detect-names' of https://github.com/MWYang/Tra… 

    …nsmogrifAI into my/unary-detect-names
    @MWYang
    MWYang committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    b82440a View commit details
    Browse the repository at this point in the history

  4. Revert to using container Text class for NameDetectUtils per PR comments

    @MWYang
    MWYang committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    d747c92 View commit details
    Browse the repository at this point in the history

  5. Added NameStats to FeatureBuilder

    @MWYang
    MWYang committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    7d01d70 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2020

  1. Added NameStats to a few more places

    @MWYang
    MWYang committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    b4209c6 View commit details
    Browse the repository at this point in the history

  2. Added NameStats to TestFeatureBuilder and RandomMap

    @MWYang
    MWYang committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    23d7a57 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    d86f2d6 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2020

  1. Reordered tests to avoid flooding output with test logs

    @MWYang
    MWYang committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    eea3a3c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into my/unary-detect-names

    @tovbinm
    tovbinm committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    b9522de View commit details
    Browse the repository at this point in the history

  3. Incorporated PR comments (using enumeratum for NameStats map keys/val… 

    …ues and proper camel casing for guard check params)
    @MWYang
    MWYang committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    e4e3ddd View commit details
    Browse the repository at this point in the history

  4. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    f551543 View commit details
    Browse the repository at this point in the history

  5. Passed most SmartTextVectorizer tests after merging changes

    @MWYang
    MWYang committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    a9d95a1 View commit details
    Browse the repository at this point in the history

  6. Made all tests pass - Debuging wasn't being enabled due to non-intuit… 

    …ve execution order for ScalaTest
    @MWYang
    MWYang committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    30476c8 View commit details
    Browse the repository at this point in the history

  7. Fixed test to show that the output for SmartTextVectorizer is the sam… 

    …e with or without name entries
    @MWYang
    MWYang committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    aa680b8 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2020

  1. Added all other metadata tests for SmartTextVectorizer

    @MWYang
    MWYang committed Jan 9, 2020
    Configuration menu
    Copy the full SHA
    a57aa29 View commit details
    Browse the repository at this point in the history

  2. Removed some print statements

    @MWYang
    MWYang committed Jan 9, 2020
    Configuration menu
    Copy the full SHA
    b9120a5 View commit details
    Browse the repository at this point in the history

  3. Updated documentation

    @MWYang
    MWYang committed Jan 9, 2020
    Configuration menu
    Copy the full SHA
    be2047d View commit details
    Browse the repository at this point in the history

  4. Incorporated PR comments (renamed GenderStrings to GenderValues and r… 

    …emoved BooleanStrings enum
    @MWYang
    MWYang committed Jan 9, 2020
    Configuration menu
    Copy the full SHA
    8b02dff View commit details
    Browse the repository at this point in the history

  5. Removed plural names from NameStats enums and factored out method in … 

    …identifyGender to hopefully reduce complexity
    @MWYang
    MWYang committed Jan 9, 2020
    Configuration menu
    Copy the full SHA
    8844ef5 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2020

  1. More small fixes from PR comments

    @MWYang
    MWYang committed Jan 10, 2020
    Configuration menu
    Copy the full SHA
    0cc10e0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 10, 2020
    Configuration menu
    Copy the full SHA
    a0d97c7 View commit details
    Browse the repository at this point in the history

  3. Got previous tests working

    @Jauntbox
    Jauntbox committed Jan 10, 2020
    Configuration menu
    Copy the full SHA
    3ad8ce1 View commit details
    Browse the repository at this point in the history

  4. New test also working

    @Jauntbox
    Jauntbox committed Jan 10, 2020
    Configuration menu
    Copy the full SHA
    b00775b View commit details
    Browse the repository at this point in the history

  5. Remove debug output

    @Jauntbox
    Jauntbox committed Jan 10, 2020
    Configuration menu
    Copy the full SHA
    03ae4d0 View commit details
    Browse the repository at this point in the history

  6. Added test for TextList monoid

    @Jauntbox
    Jauntbox committed Jan 10, 2020
    Configuration menu
    Copy the full SHA
    9759747 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2020

  1. Added all tests for SmartTextMapVectorizer

    @MWYang
    MWYang committed Jan 13, 2020
    Configuration menu
    Copy the full SHA
    63ad17a View commit details
    Browse the repository at this point in the history

  2. Removed print statements

    @MWYang
    MWYang committed Jan 13, 2020
    Configuration menu
    Copy the full SHA
    89fa865 View commit details
    Browse the repository at this point in the history

  3. Added another test and fixed sneaky metadata issue

    @Jauntbox
    Jauntbox committed Jan 13, 2020
    Configuration menu
    Copy the full SHA
    10644d8 View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2020

  1. Removed emptiness check

    @MWYang
    MWYang committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    4fea007 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'my/unary-detect-names' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    8f7b125 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of github.com:salesforce/TransmogrifAI into km/… 

    …token-lens-map
    @Jauntbox
    Jauntbox committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    9317250 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    6424463 View commit details
    Browse the repository at this point in the history

  5. Pulled out SensitiveFeatureInformation metadata changes into its own … 

    …branch
    @MWYang
    MWYang committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    a107db1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'my/sensitive-metadata' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    32f29ce View commit details
    Browse the repository at this point in the history

  7. Fixed SensitiveFeatureInformation tests failing due to not changing t… 

    …he to/fromMetadata tests
    @MWYang
    MWYang committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    acb873e View commit details
    Browse the repository at this point in the history

  8. Merge branch 'my/sensitive-metadata' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    973aabb View commit details
    Browse the repository at this point in the history

  9. Addressing comments

    @Jauntbox
    Jauntbox committed Jan 14, 2020
    1 Configuration menu
    Copy the full SHA
    3ae735c View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2020

  1. Spelling

    @Jauntbox
    Jauntbox committed Jan 15, 2020
    Configuration menu
    Copy the full SHA
    bef2b22 View commit details
    Browse the repository at this point in the history

  2. Fixed failing test by making default behavior of SmartTextVectorizer … 

    …and SmartTextMapVectorizer the same as previous behavior - don't ignore any features
    @Jauntbox
    Jauntbox committed Jan 15, 2020
    Configuration menu
    Copy the full SHA
    069031c View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2020

  1. Merge branch 'km/token-lens-map' into my/sensitive-metadata

    @MWYang
    MWYang committed Jan 21, 2020
    Configuration menu
    Copy the full SHA
    d8f7f21 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'my/sensitive-metadata' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 21, 2020
    Configuration menu
    Copy the full SHA
    e13c4d1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'km/token-lens-map' into my/sensitive-metadata

    @MWYang
    MWYang committed Jan 21, 2020
    Configuration menu
    Copy the full SHA
    fe57c89 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'my/sensitive-metadata' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 21, 2020
    Configuration menu
    Copy the full SHA
    458af4a View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2020

  1. Made all tests pass after merge (Ignore in STMapV didn't handle empty… 

    … hashFeatures case)
    @MWYang
    MWYang committed Jan 22, 2020
    Configuration menu
    Copy the full SHA
    40cb64b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into my/sensitive-metadata

    @MWYang
    MWYang committed Jan 22, 2020
    Configuration menu
    Copy the full SHA
    fde5c8d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'my/sensitive-metadata' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 22, 2020
    Configuration menu
    Copy the full SHA
    2572332 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2020

  1. Removed enum from SensitiveFeatureInformation per PR comments

    @MWYang
    MWYang committed Jan 24, 2020
    Configuration menu
    Copy the full SHA
    a8504da View commit details
    Browse the repository at this point in the history

  2. Using case class for GenderDetectionStrategy information

    @MWYang
    MWYang committed Jan 24, 2020
    Configuration menu
    Copy the full SHA
    eac0e05 View commit details
    Browse the repository at this point in the history

  3. Cleaning up tests per PR comments

    @MWYang
    MWYang committed Jan 24, 2020
    Configuration menu
    Copy the full SHA
    26f30fb View commit details
    Browse the repository at this point in the history

  4. Merge branch 'my/sensitive-metadata' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 24, 2020
    Configuration menu
    Copy the full SHA
    f66d896 View commit details
    Browse the repository at this point in the history

  5. Made fixes for metadata changes

    @MWYang
    MWYang committed Jan 24, 2020
    Configuration menu
    Copy the full SHA
    9a3f5af View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into my/sensitive-metadata

    @MWYang
    MWYang committed Jan 24, 2020
    Configuration menu
    Copy the full SHA
    bd7b90d View commit details
    Browse the repository at this point in the history

  7. Merge branch 'my/sensitive-metadata' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 24, 2020
    Configuration menu
    Copy the full SHA
    5c37c26 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2020

  1. Merge branch 'master' into my/stv-detect-names

    @MWYang
    MWYang committed Jan 29, 2020
    Configuration menu
    Copy the full SHA
    9344e5f View commit details
    Browse the repository at this point in the history