2nd Generation Sports

Release Notes version 1.0

• Web Scraper support
• Added gender to table
• Added ability to delete entries from “All Data” table
• Updated “About” page

Bug Fixes

• Checkboxes being off screen
• Highlighting using same colors for different words
• Cutting off ends of long sentences
• Keywords not being counted near punctuation
• Many false positives
• Highlighter “on/off” toggle gets put to the left of the results table when processing a PDF with a small amount of hits

Known Bugs

• Web scraper does not support the school Brigham Young University (BYU) due to their Angular render HTML
• The word “sea-son” may be acting like a false positive hit on the keyword “son”

Install Guide version 1.0

Pre-requisites:

• Miniconda Python 3.7: https://docs.conda.io/en/latest/miniconda.html or Anaconda Python https://www.anaconda.com/distribution/
• Use all default settings when installing Miniconda
• You must also have JRE 1.8 installed and configured before proceeding. See https://www.java.com/en/download/

Dependencies:

• All dependency downloads are handled in the “Installation” section of the guide below
• For names of specific packages used, read requirements.txt in the repository
• Open an Anaconda or Miniconda Prompt window

Download:

• https://github.com/jchen706/2ndGenSports
• There will be a download button on the right side of the page

Build:

No build necessary for this app.

Installation

• Download the repository to your local machine
• Open an Anaconda or Miniconda Prompt window and navigate to the root directory of the repository. It should be called 2ndGenSports-master If you are unfamiliar with how to navigate a command prompt window, here is a Mac tutorial and a Windows tutorial
• Create and activate the environment by executing the following commands in the Anaconda prompt window:
  • conda create -n myenv python=3.6
  • conda activate myenv
• Install the dependencies from requirements.txt by executing this command: pip install -r requirements.txt
• This could take a while because there are quite a few dependencies.
• Next do the following to install AWSCLI pip install awscli
• You will need an AWS key to use the database. Contact the developers for a key at jchen706@gatech.edu
• To configure AWS do the following to enter your key information
  • aws configure
  • Use “us-east-1” as the Default Region Name
  • Ignore the Default output format, you can type ‘None’
• Open a python shell by typing “python” into the Anaconda Prompt window and pressing Enter
• Execute the following commands:
  • import nltk
  • nltk.download(‘punkt’)
• Exit the python shell by typing “exit()” and pressing Enter

Running Application

• Make sure you have your miniconda environment running
  • conda activate myenv
• Execute the following command in an Anaconda Prompt window to run the Python web application on localhost:5000
  • python 2ndgen.py
• Open a browser and type or paste http://localhost:5000 into the address bar
• Hit enter and you should see the website displayed

Troubleshooting

• Be sure to install all the dependencies on the Miniconda or Anaconda environment you created. You will know that you are in your miniconda environment if you see myenv in the Anaconda or Miniconda Prompt window
• If you are having trouble running the application, make sure you have first activated the miniconda environment using conda activate myenv

Web Scraper Supported Universities Spreadsheet

https://docs.google.com/spreadsheets/d/1JMGE9vjyt_RUCsFW3jGEdUKQa2mGGiYPMml2AXV_L4U/edit?usp=sharing

Using Selenium for scraping delay Javascript Rendered Websites

Language Processing Algorithm

Team & Contact Information

1. Jun Chen jchen706@gatech.edu
2. Phillip Hong phong9@gatech.edu
3. Justin Chiu jchiu33@gatech.edu
4. Eric Vizcaya-Eternod eve6@gatech.edu
5. Jesus Gonzalez jgonzalez314@gatech.edu