This README covers the notebooks in this repo. There are two distinct workflows:
- Tarazed notebooks — intended for Windows machines with NVIDIA GPUs.
- Video_Processing_Current.ipynb — intended for use on NAIRR Jetstream2 JupyterHub instances.
Platform: Windows with an NVIDIA GPU. Match CUDA/cuDNN to the ML package you install.
- Python: 3.8+ recommended.
- Create and activate a venv (PowerShell):
- python -m venv .venv
- .\.venv\Scripts\Activate.ps1
- Install packages (adjust TensorFlow/PyTorch to match your CUDA):
- pip install jupyterlab jupyter numpy pandas opencv-python pillow tqdm matplotlib
- Install a GPU ML package per official instructions (e.g. tensorflow or torch built for your CUDA version).
- Models & paths:
- Download MegaDetector/model weights and set notebook variables (MEGADETECTOR_PATH, MODEL_FILE, DATA_DIR, OUTPUT_DIR) in the top cells.
- Run:
- jupyter lab
- Open
Notebooks/Tarazed_*.ipynband run top-to-bottom.
Platform: NAIRR Jetstream2 JupyterHub instance (use instance compute/storage).
- Prefer conda if available; venv works too. Example (bash on the instance):
- python3 -m venv .venv
- source .venv/bin/activate
- Install packages:
- pip install jupyterlab jupyter numpy pandas opencv-python pillow tqdm matplotlib
- Data & storage:
- Use $SCRATCH or project persistent storage for large video/frame sets. Update DATA_DIR/OUTPUT_DIR in the notebook accordingly.
- MegaDetector / models:
- Ensure model files and any MegaDetector code are available on the instance and point notebook variables to those paths.
- Run:
- Open the JupyterHub web UI, start
Video_Processing_Current.ipynb, edit the top cells to set paths, then run cells top-to-bottom.
- Open the JupyterHub web UI, start
- If a requirements.txt exists, prefer:
pip install -r requirements.txt - Always edit the top cells in each notebook to set DATA_DIR, OUTPUT_DIR, MEGADETECTOR_PATH, and MODEL_FILE before running.
- For GPU usage, install GPU‑compatible TensorFlow or PyTorch per your CUDA/cuDNN and OS setup.