Given your current location, this web app will determine the next UTSG-UTM shuttle bus you can take. The app takes into account your distance from the bus stop and provides you with a time that indicates when you should start walking from your current location to get to the bus (on time!).You can also schedule when you would like to leave.
- Node.js, Express.js
- Node and Express are used to provide the middleware and backend functionality of this project. They are responsible for: endpoint routing, calculating trip time logic, interacting with the database, and using the Google Directions API
- MongoDB and Mongoose
- Mongo is used to store shuttle bus data. The reason why I chose touse a database is to allow for more flexibility for new types of data that can be added in the future. Mongoose provides an abstraction and schema structure over Mongo, and was used to interface with the db.
- Python
- Python is used to webscrape shuttle bus data from a UofT website. I created a script that can be run in the command line, with the user providing arguments that can specify which days they would like to gather/update data for. This data is stored in Mongo. PyMongo was used to interface with the Mongo database
- Pug and Bootstrap
- Pug (front-end templating framework) is used to model the front end, while Bootstrap provides additional CSS styling.
- Python 3.6
pip install bs4- version 0.01
pip install requests- version 2.19.1
- node 10.16.0
- npm 6.10.3
- MongoDB 4.0.10
- You will need an API key from Google Maps Platform (you will need to have a Google Cloud Platform billing account) for the Directions API
- This is "free" (You get $200 in credits for use each month. To exceed this, you would need to make millions of requests with your key)
- https://developers.google.com/maps/gmp-get-started
$ git clone https://github.com/matthuynh/shuttle-time-finder.git
-
$ cd shuttle-time-finder -
$ npm install
-
Start up an instance of Mongo on localhost:27017. Be sure to leave this server up.
-
$ mongod -
Create a shuttle_db db and inside this db, create a shuttle_data collection
$ mongo
<Inside Mongo shell>
$ use shuttle_db
$ db.createCollection("shuttle_data")
$ pwd
/Documents/shuttle-time-finder
$ vi .env
Inside your .env file, be sure to set these variables:
DATABASE=mongodb://localhost:27017/shuttle_db
COLLECTION_PATH=db.shuttle_data
GOOGLE_KEY=<Your_API_Key_Here>
-
You will need to run the Python script found at shuttle-time-finder/webscraper/MongoUpdater.py
-
$ pwdshould output/Documents/shuttle-time-finder/webscraper -
$ python3 MongoUpdater.py 10 17 2019 10This will webscrape shuttle bus data for the days starting from Oct 17, 2019 until Oct 27, 2019. -
To learn more about the script options, do
$ python3 MongoUpdater.py -h -
Note that this script is meant to run periodically as a cron job in order to maintain accurate shuttle data.
$ npm run watch- The project should start on your localhost on port 3000. To view on your browser, navigate to
localhost:3000.
- Webscraping code adapted from: https://github.com/cobalt-uoft/uoft-scrapers/blob/master/uoftscrapers/scrapers/shuttles/__init__.py
- UofT Building Data adapted from: https://github.com/cobalt-uoft/datasets/blob/master/buildings.json
- JEST tests
- Updated frontend using React
- More functionality and customizability for the user (eg. the ability to view various shuttle schedule times, the ability to choose when to arrive)
- Leverage the Directions API to provide more functionality (eg. traffic data, the ability to choose between walking, biking, transit, and driving)
- Improved search functionality and redundancy for UofT buildings
- The ability to get the user's current location (will require React to be implemented first)
- Improved error handling
- https://github.com/timoxley/best-practices
- https://gist.github.com/sidorares/c49750ed8f7750afd5ad