Skip to content

Building Family Tree using Electoral Data (India). Scraped 25k+ data and found relationships spanning more than 3 generations.

Notifications You must be signed in to change notification settings

divinenaman/family-tree-builder

Repository files navigation

Building Family tree using Electoral Data (India)

A very brief overview but hopefully I'll update this soon.

While working on this project (a hiring challenge, cut to the chase was not hired), I was able to scrape 25k+ data from the various sources and successfully built family trees. In my initial testing my approach accurately linked 3+ generations which will eventually produce greater depths given more time. It was fun.

Overview

Tech/Tools At work

  • Computer Visio (OCR, Canny Edges)
  • NLP (Language Transalation (hindi->english, tamli->english))
  • Web Scraping
  • Graphical Analysis
  • Family Relationship Resolver
  • Full Text Search with Text Similarity Score
  • API's
  • Patience: had to build this in 2 days and 2 days for bugs :))
  • Automation
  • CRON jobs

Setup Tesseract (OCR)

https://tesseract-ocr.github.io/tessdoc/Installation.html

sudo apt install tesseract-ocr
sudo apt install libtesseract-dev

search language packs:  apt-cache search tesseract-ocr
lang-packs: https://github.com/tesseract-ocr/tessdata/tree/main/script
lang-location: /usr/share/tesseract-ocr/4.00/tessdata

About

Building Family Tree using Electoral Data (India). Scraped 25k+ data and found relationships spanning more than 3 generations.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages