Skip to content
This repository has been archived by the owner on Apr 27, 2021. It is now read-only.

De-duplication flow #101

Merged
merged 4 commits into from
Nov 7, 2017
Merged

De-duplication flow #101

merged 4 commits into from
Nov 7, 2017

Commits on Nov 1, 2017

  1. Add deduplicator class. 

    Create a non-scheduled deduplication task: it will need to be modified manually in Azkaban to take a file.
    Olessia Karpova committed Nov 1, 2017
    Configuration menu
    Copy the full SHA
    79db28d View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2017

  1. Refactor and test; update the run config.

    Olessia Karpova committed Nov 6, 2017
    Configuration menu
    Copy the full SHA
    4cb5193 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2017

  1. Address review comments.

    Olessia Karpova committed Nov 7, 2017
    Configuration menu
    Copy the full SHA
    bde5e60 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'staging' into dup_cleanup

    Olessia Karpova committed Nov 7, 2017
    Configuration menu
    Copy the full SHA
    118898a View commit details
    Browse the repository at this point in the history