Functions to get all darwin cut notes based on image dimensions and throw away full-page notes (non cut notes). Works by comparing image dimensions to mean image dimensions within folder. Written in PySpark for efficient parallel processing due to dataset size of ~350GB and ~60k images.
HackTheStacks/darwin-image-preprocessing
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Functions to get all darwin cut notes based on image dimensions - in python and spark for efficient parallel processing
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published