ranieri-unimi / echo Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

LSH from zero 🦾 native Map-Reduce in PySpark 🚀

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 25 Commits
.gitignore		.gitignore
README.md		README.md
echo.ipynb		echo.ipynb
echo.pdf		echo.pdf
requirements.txt		requirements.txt

Repository files navigation

Echo 📣 detection of nearly-identical tweets

In this project, a locality-sensitive hashing over minhash signatures was implemented through a Map Reduce architecture (PySpark).

Get started

Resources

context

https://help.twitter.com/en/rules-and-policies/platform-manipulation

dataset

https://www.kaggle.com/datasets/bwandowando/ukraine-russian-crisis-twitter-dataset-1-2-m-rows