Skip to content

emilhsynv/python-capstone-projects

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

10 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Python Capstone Projects

This repository contains my final projects for the Python for Everybody Specialization. These projects focus on Retrieving, Processing, and Visualizing Data using Python and SQLite.

πŸš€ Projects Overview

A web crawler that stores webpage data in an SQLite database and ranks pages using PageRank. It allows incremental crawling and visualizes the link structure.

βœ… Tech Stack: Python, SQLite, JSON, Web Scraping
βœ… Key Features:

  • πŸ“‘ Webpage crawling & link mapping
  • πŸ”’ PageRank algorithm for ranking pages
  • πŸ“Š JSON-based visualization of links

βœ… Run Commands: python spider.py # Crawl webpages python sprank.py # Compute PageRank python spjson.py # Generate visualization

Uses the Google Places API to geocode university locations, store them in an SQLite database, and visualize them on Google Maps.

βœ… Tech Stack: Python, SQLite, Google API, JavaScript βœ… Key Features:

  • πŸ“ Fetches and caches geolocation data
  • πŸ—„οΈ Stores locations in an SQLite database
  • πŸ—ΊοΈ Interactive Google Maps visualization

βœ… Run Commands: python geoload.py # Fetch geolocation data python geodump.py # Export data to JavaScript open where.html # View locations on Google Maps

A database-driven project that processes user-course-role data from JSON and organizes it in an SQLite database. βœ… Tech Stack: Python, SQLite, JSON βœ… Key Features:

  • 🏫 Manages user-course-role relationships
  • πŸ“‚ Prevents duplicate entries using constraints
  • πŸ”„ Loads and updates data dynamically

βœ… Run Commands: python rosterdb.py πŸš€ How to Run

  1. Ensure Python & SQLite3 are installed
  2. Clone the repository:
    git clone https://github.com/emilhsynv/python-capstone-project.git  
    cd python-capstone-project
    
  3. Navigate to a project folder and run the script
  4. Check "rosterdb.sqlite" in DB Browser for SQLite
  5. Reset database if needed:
    rm rosterdb.sqlite  # Mac/Linux
    del rosterdb.sqlite  # Windows
    

πŸ“ Notes

  • You can inspect and modify the SQLite database using DB Browser for SQLite.
  • Make sure to set up your Google API key in geoload.py if using "GeoData" Project.

βœ… Great for learning Python, SQLite, Web Scraping, API integration, and database management! πŸš€

About

Capstone projects for Python for Everybody Specialization

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors