Update Finance Spreadsheet is a Python-based personal project that automatically scrapes financial account information from various websites and updates the data in Google Sheets and YNAB (You Need a Budget) accounts.
- Scrapes financial account information from multiple websites:
- Hargreaves Lansdown
- Nutmeg
- Shareworks
- StandardLife
- Inserts scraped data into Google Sheets and YNAB accounts
- Automated updates with Python Selenium scrapers
- Utilizes gspread, selenium, and webdriver_manager libraries
- Includes GitHub Actions for Dependabot, MegaLinter, and CodeQL
These instructions will help you set up and run the project on your local machine.
- Python 3.6 or higher
- Pip (Python package installer)
Create a secrets.json file in the root directory of the project with your credentials and settings for the financial websites and Google Sheets. Use the following format, replacing the example values with your actual credentials:
{
"NUTMEG_EMAIL": "example@example.com",
"NUTMEG_PASSWORD": "Password",
"SHAREWORKS_USERNAME": "Username",
"SHAREWORKS_PASSWORD": "Password",
"SHAREWORKS_HOST": "example.com",
"HARGREAVES_USERNAME": "Username",
"HARGREAVES_DOB": "DD/MM/YY",
"HARGREAVES_PASSWORD": "Password",
"HARGREAVES_SECRET_NUMBER": "123456",
"HARGREAVES_ACCOUNTS": ["01", "02"],
"STANDARDLIFE_USERNAME": "Username",
"STANDARDLIFE_PASSWORD": "Password",
"SHEET_ID": "GOOGLE_SHEET_ID"
}Note: Make sure not to commit the secrets.json file to your repository, as it contains sensitive information. Add it to your .gitignore file.
- Clone the repository:
git clone https://github.com/moverperfect/Update-Finance-Spreadsheet.git- Change to the project directory:
cd Update-Finance-Spreadsheet- Install the required packages:
pip install -r requirements.txt-
Update the
secrets.jsonfile as shown above with your credentials and settings for the financial websites, Google Sheets, and YNAB accounts. -
Run the
Main.pyscript to start the scraping process:
python Main.pyThe project is organized into the following folders and files:
Main.py: Entrypoint for the program, initiates the scraping process.scrapers/: Contains Python Selenium scrapers for each supported financial website.utils/: Contains the code to grab the secrets from thesecrets.json.connectors/: Contains the API code to interact with Google Sheets and YNAB.middleware/: Contains the code that translates the scraper information into commands to insert the data into the API code in Google Sheets.requirements.txt: Lists the Python libraries required for the project.
This project is licensed under the GNU General Public License v3.0. See the LICENSE file for details.