This repository contains my final projects for the Python for Everybody Specialization. These projects focus on Retrieving, Processing, and Visualizing Data using Python and SQLite.
A web crawler that stores webpage data in an SQLite database and ranks pages using PageRank. It allows incremental crawling and visualizes the link structure.
β
Tech Stack: Python, SQLite, JSON, Web Scraping
β
Key Features:
- π‘ Webpage crawling & link mapping
- π’ PageRank algorithm for ranking pages
- π JSON-based visualization of links
β
Run Commands:
python spider.py # Crawl webpages python sprank.py # Compute PageRank python spjson.py # Generate visualization
Uses the Google Places API to geocode university locations, store them in an SQLite database, and visualize them on Google Maps.
β Tech Stack: Python, SQLite, Google API, JavaScript β Key Features:
- π Fetches and caches geolocation data
- ποΈ Stores locations in an SQLite database
- πΊοΈ Interactive Google Maps visualization
β
Run Commands:
python geoload.py # Fetch geolocation data python geodump.py # Export data to JavaScript open where.html # View locations on Google Maps
A database-driven project that processes user-course-role data from JSON and organizes it in an SQLite database. β Tech Stack: Python, SQLite, JSON β Key Features:
- π« Manages user-course-role relationships
- π Prevents duplicate entries using constraints
- π Loads and updates data dynamically
β
Run Commands:
python rosterdb.py
π How to Run
- Ensure Python & SQLite3 are installed
- Clone the repository:
git clone https://github.com/emilhsynv/python-capstone-project.git cd python-capstone-project - Navigate to a project folder and run the script
- Check "rosterdb.sqlite" in DB Browser for SQLite
- Reset database if needed:
rm rosterdb.sqlite # Mac/Linux del rosterdb.sqlite # Windows
- You can inspect and modify the SQLite database using DB Browser for SQLite.
- Make sure to set up your Google API key in geoload.py if using "GeoData" Project.
β Great for learning Python, SQLite, Web Scraping, API integration, and database management! π