Skip to content
View patrickendres's full-sized avatar

Block or report patrickendres

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
patrickendres/README.md
█▀█ ▄▀█ ▀█▀ █▀█ █ █▀▀ █▄▀   █▀▀ █▄ █ █▀▄ █▀█ █▀▀ █▀▀
█▀▀ █▀█  █  █▀▄ █ █▄▄ █ █   ██▄ █ ▀█ █▄▀ █▀▄ ██▄ ▄▄█

data engineer · python · sql · patrickendr.es
$ whoami

Data engineer with a SRE mindset. Running pipelines at JobGet. 

Mostly Python and SQL against Snowflake, sometimes other back end tasks. 
$ stack --sorted

python           ████████████████████░░░░   daily driver · airflow, pandas, pyspark, requests
sql              ███████████████████░░░░░   snowflake, stored procedures, optimization
infrastructure   ███████████████░░░░░░░░░   terraform, ci/cd, data testing
javascript       ██████████░░░░░░░░░░░░░░   enough to be dangerous
$ ls -1 ~/projects
gi_scraper Multi-tenant Shopify catalog scraper. Walks a list of storefronts, normalizes products.json into typed dataclasses (product / variant / image), and lands flat CSVs. Uses curl_cffi to survive TLS fingerprinting. Python
nhl_wiki_agg Aggregates all 32 NHL rosters off Wikipedia into one normalized CSV — or one per team. Generator-based parsing, identifies itself with a real User-Agent, raises on bad status instead of silently writing garbage. Python · BeautifulSoup
boxing_wiki_agg Flattens current boxing rankings — every division, every sanctioning body — into one deduplicated roster per division. Building it surfaced three bugs in the parse: a hardcoded division count silently dropping Strawweight, two fighters glued into a single name, and title annotations breaking dedupe across bodies. Python · BeautifulSoup
$ cat notes/why-scrapers.md

All of my public projects currently are scrapers related to my hobbies: jiu jitsu, hockey, boxing.

Going to aim some more projects in the future.
GitHub stats Top languages
$ cat contact.txt
web      patrickendr.es
mail     patrickjendres92@gmail.com
github   @patrickendres
$ _

Popular repositories Loading

  1. patrickendres patrickendres Public

  2. nhl_wiki_agg nhl_wiki_agg Public

    Scrapes all 32 current NHL rosters from Wikipedia into a normalized CSV

    Python

  3. boxing_wiki_agg boxing_wiki_agg Public

    Flattens current boxing rankings from Wikipedia into a deduplicated roster per division

    Python

  4. gi_scraper gi_scraper Public

    Scrapes product catalogs from Shopify storefronts into normalized, joinable CSVs

    Python