This repo contains a tools to process articles from incarcernation.com and extract the key details into a structured format for the website database.
git clone https://github.com/tabossert/incarcernation/
If you don't have git you can download the files manually, but git is preferred.
Python version must be 3.10, 3.11, or 3.12.
- Download the 3.12 Python installer for Windows https://www.python.org/ftp/python/3.12.7/python-3.12.7-amd64.exe
- Run the installer
- Check "Add Python to PATH" during installation
- Click "Install Now"
- Download Chrome from https://www.google.com/chrome/
- Open Terminal
- Install Homebrew if not already installed:
/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
- Install Python using Homebrew:
brew install python@3.12
If you prefer you can create a virtual environment to run the program in, but it is not required.
- Navigate to the directory article-processor which contains the requirements.txt file
- Run the following command:
pip install -r requirements.txt
- Navigate to the directory article-processor
- Create a file called .env
- Add the following line in the .env file:
ANTHROPIC_API_KEY=<your-anthropic-api-key>
- Save the file
- Navigate to the directory article-processor
- Run the following command:
python article_processer.py