This repository contains the code for all aspects of Stuyvesant's Spanish Civil War Archives. Included is the code for the original webscraper, the website, the biographies of the volunteers, and the backend interface for seamlessly updating it.
The repository includes the original webscraping code that allowed us to find the New Yorkers who volunteered in the Spanish Civil War. It pulls and compiles the data from http://www.alba-valb.org/
Contained within the folder scraping
:
data.txt
: Contains all the volunteers from NYC and their data.names.txt
: Contains just the names of the volunteers.stuy_volunteers.txt
: Contains the names of volunteers that may have gone to Stuyvesant High School.scraper.py
: A script that pulled the data from http://www.alba-valb.org/ and analyzed it, writing the volunteers from NYC todata.txt
.stuy_finder.py
: Finds the volunteers that may have gone to Stuyvesant High School. Depends on a filestuy_graduates.csv
that I can't release.
Fairly straightforward. Can be visited here: https://scwnyc.stuy.edu/. The archive page contains all the information for the volunteers.
For all intents and purposes a fancy GUI wrapper for git in this very specific case.
Requires: Python2.7 (Will eventually be ported to Python3)
- Clone the repository to your computer.
- Navigate to the directory and execute the command './run.sh'.
- Open http://127.0.0.1:8000 in your web-browser of choice.
- Make any changes you like.
- Click the button marked "Upload Changes".
- Select which changes you would like uploaded in the popup checklist.
- Enter your github username and password and then click "Save Changes".
- Assuming you have access to this repository, your changes will be live in just a few minutes!
Contains all the development history for the website, giving a day by day look into the repo's history. Viewable Here.
Questions or concerns? Problems in the site? Just like what you see? https://theadorabledev.github.io/contact.html.