code/03-CVec.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# CountVectorizer Model"
   ]
  },
  {
   "source": [
    "### Code Overview\n",
    "For the CountVectorizer Model, we will want to fit transform our job posting column 'text', which is a collection of job description words and job skill words. We will then transform the 'text' column in our user data which is the users titles, skills, summary, education, certifications, and projects columns. We decided to create a function that would import necessary data files and create a dataframe of user information to run in our recommendation system.\n",
    "\n",
    "We then calculate a cosine similiarty score from the user linkedin data and the job posting dataset. The cosine similarity score is a measure of the simlarity between each job title (the 13 we created), and the users linkedin information. The higher the cosine similarity score, the more likely a job title is to be recommended. The output would be a dataframe that would order the similarity scores from highest to lowest next to the job title that was most likely to be recommended."
   ],
   "cell_type": "markdown",
   "metadata": {}
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "import re\n",
    "from sklearn.feature_extraction.text import TfidfVectorizer, CountVectorizer\n",
    "from sklearn.metrics.pairwise import linear_kernel, cosine_similarity\n",
    "from IPython.display import display_html"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Jobs data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "jobs = pd.read_csv('../data/job_postings.csv')\n",
    "jobs = jobs.drop(columns=['date_added', 'organization', 'skills_len', 'job_type'])\n",
    "jobs.fillna('', inplace=True)\n",
    "jobs['text'] = jobs['job_description'] + ' ' + jobs['skills']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## User data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "def gather_profile_data(file_path):\n",
    "    profile_data = pd.read_csv(file_path)\n",
    "    profile_data['text'] = profile_data['Titles'] + ' ' \\\n",
    "                            + profile_data['Skills'] + ' ' \\\n",
    "                            + profile_data['Summary'] + ' ' \\\n",
    "                            + profile_data['Education']\n",
    "    try: profile_data['text'] += ' ' + profile_data['Certifications']\n",
    "    except: pass\n",
    "    \n",
    "    try: profile_data['text'] += ' ' + profile_data['Projects']\n",
    "    except: pass\n",
    "    \n",
    "    return profile_data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Reading in linkedin profile data.\n",
    "profile_data_zach = gather_profile_data('../data/linkedin/test-output/Zach_LinkedInData_12-16-2020.csv')\n",
    "profile_data_nolan = gather_profile_data('../data/linkedin/test-output/Nolan_LinkedInData_12-16-2020.csv')\n",
    "profile_data_albert = gather_profile_data('../data/linkedin/test-output/Albert_LinkedInData.csv')\n",
    "profile_data_ye = gather_profile_data('../data/linkedin/test-output/Ye_LinkedInData.csv')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Make recommendations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "def get_recommendations(vectorizer, user_data):\n",
    "    # Fit transform on text data\n",
    "    cvec_jobtext = vectorizer.fit_transform(jobs['text'])\n",
    "\n",
    "    # Transforming user profile text\n",
    "    user_cvec = vectorizer.transform(user_data['text'])\n",
    "\n",
    "    # Calculating cosine similarity between users profile and job text\n",
    "    cos_similar_user = map(lambda x: cosine_similarity(user_cvec, x), cvec_jobtext)\n",
    "\n",
    "    # Results are a list of our cosine similarity scores\n",
    "    results = list(cos_similar_user)\n",
    "\n",
    "    # Create a dataframe using our results and job_titles\n",
    "    new_df = pd.DataFrame(data = [results, jobs['job_title']]).T\n",
    "    new_df = new_df.rename(columns = {0: \"sim_score\", 1 : \"job_title\"})\n",
    "\n",
    "    # Column sim_score as float so that we can use groupby\n",
    "    new_df['sim_score'] = new_df['sim_score'].astype(float)\n",
    "\n",
    "    # Group by job_title, using count and mean to sort values\n",
    "    new_df = new_df.groupby('job_title').mean().sort_values('sim_score', ascending=False)\n",
    "\n",
    "    return new_df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Instantiating countvectorizer\n",
    "count_vectorizer = CountVectorizer()\n",
    "\n",
    "# Instantiating countvectorizer with stopwords and min_df\n",
    "count_vectorizer_stopwords = CountVectorizer(stop_words = \"english\", min_df = 10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Keep all words\n",
    "zachs_recommendations = get_recommendations(count_vectorizer, profile_data_zach)\n",
    "nolans_recommendations = get_recommendations(count_vectorizer, profile_data_nolan)\n",
    "alberts_recommendations = get_recommendations(count_vectorizer, profile_data_albert)\n",
    "yes_recommendations = get_recommendations(count_vectorizer, profile_data_ye)\n",
    "\n",
    "# Remove stop words and min_df = 10\n",
    "zachs_recommendations_stopwords = get_recommendations(count_vectorizer_stopwords, profile_data_zach)\n",
    "nolans_recommendations_stopwords = get_recommendations(count_vectorizer_stopwords, profile_data_nolan)\n",
    "alberts_recommendations_stopwords = get_recommendations(count_vectorizer_stopwords, profile_data_albert)\n",
    "yes_recommendations_stopwords = get_recommendations(count_vectorizer_stopwords, profile_data_ye)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Zach"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "</style><table id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>All Words</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Data Position</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.351783</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Analyst</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.322048</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Director</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.310410</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Architect</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.309148</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Manager</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.288559</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Engineer</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.287443</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Administrator</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.286771</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Technician</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.284725</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Support</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.277533</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Developer</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.277097</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Programmer</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.275029</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Designer</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.262491</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Consulting</th>\n",
       "                        <td id=\"T_d834c212_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.251921</td>\n",
       "            </tr>\n",
       "    </tbody></table>          <style  type=\"text/css\" >\n",
       "</style><table id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>Stopwords Removed</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Data Position</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.178998</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Architect</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.126449</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Analyst</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.124752</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Developer</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.092764</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Director</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.091080</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Programmer</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.088899</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Engineer</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.076362</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Administrator</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.073022</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Consulting</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.071229</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Manager</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.062797</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Support</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.057537</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Technician</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.047603</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Designer</th>\n",
       "                        <td id=\"T_d83556fa_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.046226</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Credit for notebook styling: https://blog.softhints.com/display-two-pandas-dataframes-side-by-side-jupyter-notebook/\n",
    "df1_styler = zachs_recommendations.style.set_table_attributes(\"style='display:inline'\").set_caption('All Words')\n",
    "df2_styler = zachs_recommendations_stopwords.style.set_table_attributes(\"style='display:inline'\").set_caption('Stopwords Removed')\n",
    "\n",
    "space = \"\\xa0\" * 10\n",
    "display_html(df1_styler._repr_html_() + space + df2_styler._repr_html_(), raw=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Nolan"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "</style><table id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>All Words</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Data Position</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.193067</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Analyst</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.166393</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Architect</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.162124</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Developer</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.150255</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Director</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.146972</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Programmer</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.146852</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Engineer</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.139270</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Administrator</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.137523</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Manager</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.136588</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Consulting</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.129598</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Support</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.123708</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Designer</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.121607</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Technician</th>\n",
       "                        <td id=\"T_d83abffa_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.114109</td>\n",
       "            </tr>\n",
       "    </tbody></table>          <style  type=\"text/css\" >\n",
       "</style><table id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>Stopwords Removed</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Data Position</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.205967</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Analyst</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.156924</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Architect</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.147545</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Director</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.130016</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Developer</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.127768</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Programmer</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.124049</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Administrator</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.112800</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Manager</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.108675</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Engineer</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.107925</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Consulting</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.104279</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Support</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.087496</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Designer</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.078916</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Technician</th>\n",
       "                        <td id=\"T_d83b3854_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.072951</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df1_styler = nolans_recommendations.style.set_table_attributes(\"style='display:inline'\").set_caption('All Words')\n",
    "df2_styler = nolans_recommendations_stopwords.style.set_table_attributes(\"style='display:inline'\").set_caption('Stopwords Removed')\n",
    "\n",
    "space = \"\\xa0\" * 10\n",
    "display_html(df1_styler._repr_html_() + space + df2_styler._repr_html_(), raw=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Albert"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "</style><table id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>All Words</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Director</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.499885</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Data Position</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.493522</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Manager</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.482534</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Analyst</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.479695</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Architect</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.464140</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Engineer</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.464071</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Technician</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.456273</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Support</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.448927</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Designer</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.442908</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Programmer</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.441415</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Developer</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.437457</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Administrator</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.431354</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Consulting</th>\n",
       "                        <td id=\"T_d843e468_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.409961</td>\n",
       "            </tr>\n",
       "    </tbody></table>          <style  type=\"text/css\" >\n",
       "</style><table id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>Stopwords Removed</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Data Position</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.191380</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Analyst</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.161250</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Architect</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.144769</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Director</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.131209</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Manager</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.124166</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Programmer</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.115866</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Developer</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.114011</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Consulting</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.106573</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Engineer</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.105706</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Administrator</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.098912</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Designer</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.089334</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Support</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.086721</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Technician</th>\n",
       "                        <td id=\"T_d845954c_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.075237</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df1_styler = alberts_recommendations.style.set_table_attributes(\"style='display:inline'\").set_caption('All Words')\n",
    "df2_styler = alberts_recommendations_stopwords.style.set_table_attributes(\"style='display:inline'\").set_caption('Stopwords Removed')\n",
    "\n",
    "space = \"\\xa0\" * 10\n",
    "display_html(df1_styler._repr_html_() + space + df2_styler._repr_html_(), raw=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Ye"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "</style><table id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>All Words</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Director</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.227829</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Data Position</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.219652</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Manager</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.219126</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Analyst</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.217274</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Engineer</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.214543</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Technician</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.211993</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Support</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.210440</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Designer</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.206233</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Architect</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.204803</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Administrator</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.204063</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Programmer</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.202984</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Developer</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.197299</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Consulting</th>\n",
       "                        <td id=\"T_d84c91ee_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.186814</td>\n",
       "            </tr>\n",
       "    </tbody></table>          <style  type=\"text/css\" >\n",
       "</style><table id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390a\" style='display:inline'><caption>Stopwords Removed</caption><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >sim_score</th>    </tr>    <tr>        <th class=\"index_name level0\" >job_title</th>        <th class=\"blank\" ></th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row0\" class=\"row_heading level0 row0\" >Director</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow0_col0\" class=\"data row0 col0\" >0.036633</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row1\" class=\"row_heading level0 row1\" >Analyst</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow1_col0\" class=\"data row1 col0\" >0.036214</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row2\" class=\"row_heading level0 row2\" >Data Position</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow2_col0\" class=\"data row2 col0\" >0.033121</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row3\" class=\"row_heading level0 row3\" >Manager</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow3_col0\" class=\"data row3 col0\" >0.030470</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row4\" class=\"row_heading level0 row4\" >Engineer</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow4_col0\" class=\"data row4 col0\" >0.030076</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row5\" class=\"row_heading level0 row5\" >Programmer</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow5_col0\" class=\"data row5 col0\" >0.028149</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row6\" class=\"row_heading level0 row6\" >Administrator</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow6_col0\" class=\"data row6 col0\" >0.028072</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row7\" class=\"row_heading level0 row7\" >Developer</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow7_col0\" class=\"data row7 col0\" >0.026906</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row8\" class=\"row_heading level0 row8\" >Architect</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow8_col0\" class=\"data row8 col0\" >0.026468</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row9\" class=\"row_heading level0 row9\" >Support</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow9_col0\" class=\"data row9 col0\" >0.025880</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row10\" class=\"row_heading level0 row10\" >Consulting</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow10_col0\" class=\"data row10 col0\" >0.025709</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row11\" class=\"row_heading level0 row11\" >Designer</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow11_col0\" class=\"data row11 col0\" >0.024607</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390alevel0_row12\" class=\"row_heading level0 row12\" >Technician</th>\n",
       "                        <td id=\"T_d84ceac2_43e8_11eb_b6a8_a4d18cca390arow12_col0\" class=\"data row12 col0\" >0.021081</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df1_styler = yes_recommendations.style.set_table_attributes(\"style='display:inline'\").set_caption('All Words')\n",
    "df2_styler = yes_recommendations_stopwords.style.set_table_attributes(\"style='display:inline'\").set_caption('Stopwords Removed')\n",
    "\n",
    "space = \"\\xa0\" * 10\n",
    "display_html(df1_styler._repr_html_() + space + df2_styler._repr_html_(), raw=True)"
   ]
  },
  {
   "source": [
    "### CountVectorizer Results\n",
    "Our countvectorizer model recommended similar positions across all of the group members, with Data Position scoring the highest for each of our linkedin profile data. When running our model on a profile that was not in the tech industry, the countvectorizer model was able to analyze the data and give us results that show that their profile was not formatted for a technical position. This means that our model can accurately predict whether or not a users profile information is technical, and/or non-technical.\n",
    "\n",
    "The countvectorizer model performed how our group predicted, and with consistent results across all profiles it was tested on. In conclusion, our countvectorizer model was the most accurate model and had scores that accurately reflected our predictions before modeling even began. With more time and modifications to our jobs dataset, we feel comfortable making the decision to choose the countvectorizer model as the best performing model."
   ],
   "cell_type": "markdown",
   "metadata": {}
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}