Dedupe.io

All

32 repositories

dedupe
Public
🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
python dedupe datamade clustering record-linkage python-library entity-resolution dedupe-library de-duplicating
Python
•
MIT License
•549•4.1k•68•6•Updated Nov 1, 2024Nov 1, 2024
pylbfgs
Public
🚠 Python/Cython wrapper for liblbfgs
python optimization-algorithms bfgs quasi-newton owlqn
C
•
MIT License
•38•25•1•2•Updated Sep 23, 2024Sep 23, 2024
pyhacrf
Public
📐 Hidden alignment conditional random field for classifying string pairs.
nlp edit-distance string-distance conditional-random-fields python
Python
•
BSD 3-Clause "New" or "Revised" License
•21•25•5•3•Updated Sep 23, 2024Sep 23, 2024
dedupe-variable-embedding
Public
Use embeddings for semantic comparisons
Python
•
MIT License
•0•0•0•0•Updated Sep 18, 2024Sep 18, 2024
dedupe-examples
Public
🆔 Examples for using the dedupe library
entity-resolution python dedupe record-linkage
Python
•
MIT License
•214•406•10•6•Updated Aug 10, 2024Aug 10, 2024
dedupe-variable-datetime
Public
DateTime variable for dedupe
Python
•
MIT License
•3•4•2•0•Updated Jul 10, 2024Jul 10, 2024
dedupe-variable-address
Public
Address Variable Type for dedupe
dedupe-variable dedupe
Python
•3•9•6•0•Updated Jun 27, 2024Jun 27, 2024
parseratorvariable
Public
Base class for dedupe variables for parsed fields
dedupe dedupe-variable
Python
•3•3•2•0•Updated Jun 27, 2024Jun 27, 2024
dedupe-variable-name
Public
name variable type for dedupe
dedupe dedupe-variable
Python
•8•8•1•2•Updated Jun 26, 2024Jun 26, 2024
affinegap
Public
📐 A Cython implementation of the affine gap string distance
levenshtein-distance string-distance python cython
Cython
•
MIT License
•9•58•4•2•Updated Jan 23, 2023Jan 23, 2023
doublemetaphone
Public
🔉 Python wrapper for a C++ Double Metaphone
python string-matching double-metaphone
C++
•
Artistic License 2.0
•7•15•2•2•Updated Jan 23, 2023Jan 23, 2023
Levenshtein_search
Public
Python search module for fast approximate string matching
C
•
MIT License
•19•6•0•0•Updated Jan 17, 2023Jan 17, 2023
dedupe-geocoder
Public
📍 Demonstration of how dedupe might be used as geocoder
Python
•
MIT License
•6•17•2•4•Updated Jun 21, 2022Jun 21, 2022
hcluster
Public archive
Hierarchical Clustering Algorithms
hierarchical-clustering python clustering
Python
•
Other
•20•35•2•2•Updated May 30, 2022May 30, 2022
rlr
Public archive
Regularized Logistic Regression
logistic-regression python l2-regularization
Python
•
Other
•9•11•3•2•Updated Dec 20, 2021Dec 20, 2021
fastcluster
Public
Fast hierarchical clustering routines for R and Python.
C++
•
Other
•35•1•0•0•Updated Aug 22, 2021Aug 22, 2021
dedupe-variable-ilcs
Public
Dedupe variable for Illinois Compiled Statute (ILCS) codes
Python
•
MIT License
•1•2•2•0•Updated Jun 16, 2020Jun 16, 2020
dedupeio-web-api-docs
Public
Dedupe.io web API allows for matching and training against projects using a standard RESTful framework.
Python
•3•6•1•0•Updated May 26, 2020May 26, 2020
dedupe-variable-number
Public
Try to cast strings to numbers, then compare
Python
•1•3•2•0•Updated Mar 31, 2020Mar 31, 2020
highered
Public
CRF Edit Distance
edit-distance string-distance conditional-random-fields python
Python
•4•6•3•0•Updated Mar 31, 2020Mar 31, 2020
simplecosine
Public
📐 simple cosine distance
string-similarity python
Python
•4•3•1•0•Updated Mar 31, 2020Mar 31, 2020
categorical-distance
Public
📐 Compare categorical variables
Python
•4•4•1•0•Updated Mar 31, 2020Mar 31, 2020
datetime-distance
Public
📐 Compare dates and times
Python
•
MIT License
•5•3•1•0•Updated Mar 31, 2020Mar 31, 2020
fuzzycategory
Public
📐 Fuzzy Categorical Distances
Python
•
MIT License
•5•14•0•0•Updated Mar 31, 2020Mar 31, 2020
dedupe-variable-employer
Public
dedupe dedupe-variable
Python
•2•5•1•0•Updated Mar 31, 2020Mar 31, 2020
dedupe-variable-fuzzycategory
Public
Dedupe Variable for Fuzzy Categories
dedupe dedupe-variable
Python
•4•4•1•0•Updated Mar 31, 2020Mar 31, 2020
soft-tfidf
Public
Mispelling tolerant tf-idf similarity metric
MIT License
•3•6•1•0•Updated Mar 31, 2020Mar 31, 2020
learned-string-alignments
Public
Learning String Alignments for Entity Aliases
Python
•
Apache License 2.0
•6•4•0•0•Updated Mar 31, 2020Mar 31, 2020
dedupe-vowpal
Public
Vowpal Wabbit Active Labeler for Dedupe
Python
•
MIT License
•3•4•0•0•Updated Mar 31, 2020Mar 31, 2020
dedupe-variable-person
Public
Dedupe variable for person names. just people. no companies.
Python
•3•9•1•0•Updated Mar 31, 2020Mar 31, 2020