Web-Scraping.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Web Scraping data\n",
    "\n",
    "``requests`` module used to fetch the source-code of the required web-site.\n",
    "\n",
    "``BeautifulSoup`` module used to pull data from the HTML page and parse it (using any suitable parser)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Importing necessary libraries"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import requests\n",
    "from bs4 import BeautifulSoup as bs\n",
    "from time import sleep\n",
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Trying out data scraping on my friend's web-site\n",
    "\n",
    "Learning web scraping using BeautifulSoup and requests libraries to get data from web-sites. Starting with scraping my friend's portfolio site."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "# defining link variable to store web-site's URL\n",
    "link = \"http://bhupeshv.me\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<Response [200]> <class 'requests.models.Response'>\n"
     ]
    }
   ],
   "source": [
    "# requesting site, source code is returned\n",
    "req = requests.get (link)\n",
    "\n",
    "# 200 means request went through\n",
    "print (req, type (req))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Parsing the web-site\n",
    "``BeautifulSoup ()`` (``bs`` in the code) used to convert ``requests`` object into ``BeautifulSoup`` object (``soup`` in the code) and parse it using ``lxml`` parser."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<!DOCTYPE HTML>\n",
      "<html>\n",
      " <head>\n",
      "  <title>\n",
      "   Bhupesh Varshney\n",
      "  </title>\n",
      "  <meta charset=\"utf-8\"/>\n",
      "  <meta content=\"Welcome Its Me Bhupesh Varshney\" name=\"description\"/>\n",
      "  <meta content=\"Bhupesh,Varshney,Bhupesh Varshney,bhupesh,bhupeshv,BHUPESH\" name=\"keywords\"/>\n",
      "  <meta content=\"Bhupesh Varshney\" name=\"author\"/>\n",
      "  <meta content=\"width=device-width, initial-scale=1, user-scalable=no\" name=\"viewport\"/>\n",
      "  <link href=\"static/favicon.ico\" rel=\"icon\" type=\"image/x-icon\"/>\n",
      "  <link href=\"static/main.css\" rel=\"stylesheet\"/>\n",
      " </head>\n",
      " <body class=\"is-preload\">\n",
      "  <!-- Wrapper -->\n",
      "  <div id=\"wrapper\">\n",
      "   <!-- Main -->\n",
      "   <section id=\"main\">\n",
      "    <header>\n",
      "     <span class=\"avatar\">\n",
      "      <img height=\"300\" src=\"static/profile.jpg\" width=\"300\"/>\n",
      "     </span>\n",
      "     <h1>\n",
      "      Bhupesh Varshney\n",
      "     </h1>\n",
      "     <p>\n",
      "      Open Source Enthusiast 🤓 &amp; Code Pervert 😜 .\n",
      "     </p>\n",
      "     <a class=\"button\" href=\"blog.html\">\n",
      "      Checkout My Blogs\n",
      "     </a>\n",
      "     <br/>\n",
      "     <br/>\n",
      "     <a class=\"button\" href=\"https://drive.google.com/file/d/1YlOHhvkLCwEhY1iFsHppVOmtMWeKtp4X/view?usp=sharing\" target=\"_blank\">\n",
      "      Resume\n",
      "     </a>\n",
      "    </header>\n",
      "    <hr/>\n",
      "    <h3>\n",
      "     Hi, I am Bhupesh Varshney, 19 year old Student Developer, 2\n",
      "     <sup>\n",
      "      nd\n",
      "     </sup>\n",
      "     year Computer Science student living in New Delhi, India.\n",
      "     <br/>\n",
      "     I code in Python,C++,Golang,C &amp; JavaScript.\n",
      "     <br/>\n",
      "     I use Linux, jupyter, VSCode as my developer environment.\n",
      "    </h3>\n",
      "    <br/>\n",
      "    <hr/>\n",
      "    <h3>\n",
      "     Projects\n",
      "    </h3>\n",
      "    <table align=\"center\">\n",
      "     <tr>\n",
      "      <th>\n",
      "       Name\n",
      "      </th>\n",
      "      <th>\n",
      "       Status\n",
      "      </th>\n",
      "     </tr>\n",
      "     <tr>\n",
      "      <td>\n",
      "       HeckChat\n",
      "      </td>\n",
      "      <td>\n",
      "       <a class=\"button\" href=\"https://github.com/Bhupesh-V/HeckChat\" target=\"_blank\">\n",
      "        Available\n",
      "       </a>\n",
      "      </td>\n",
      "     </tr>\n",
      "     <tr>\n",
      "      <td>\n",
      "       Algorithms\n",
      "      </td>\n",
      "      <td>\n",
      "       <a class=\"button\" href=\"https://github.com/Bhupesh-V/Algorithms\" target=\"_blank\">\n",
      "        Available\n",
      "       </a>\n",
      "      </td>\n",
      "     </tr>\n",
      "     <tr>\n",
      "      <td>\n",
      "       CoderBot\n",
      "      </td>\n",
      "      <td>\n",
      "       <a class=\"button\" href=\"https://github.com/Bhupesh-V/CoderBot\" target=\"_blank\">\n",
      "        On Going\n",
      "       </a>\n",
      "      </td>\n",
      "     </tr>\n",
      "     <tr>\n",
      "      <td>\n",
      "       Learn-Python-Packages\n",
      "      </td>\n",
      "      <td>\n",
      "       <a class=\"button\" href=\"https://github.com/Bhupesh-V/Learn-Python-Packages\" target=\"_blank\">\n",
      "        Available\n",
      "       </a>\n",
      "      </td>\n",
      "     </tr>\n",
      "     <tr>\n",
      "      <td>\n",
      "       30-Seconds-Of-STL\n",
      "      </td>\n",
      "      <td>\n",
      "       <a class=\"button\" href=\"https://github.com/Bhupesh-V/30-Seconds-Of-STL\" target=\"_blank\">\n",
      "        Available\n",
      "       </a>\n",
      "      </td>\n",
      "     </tr>\n",
      "     <tr>\n",
      "      <td>\n",
      "       EmployeeAPI\n",
      "      </td>\n",
      "      <td>\n",
      "       <a class=\"button\" href=\"https://github.com/Bhupesh-V/EmployeeAPI\" target=\"_blank\">\n",
      "        Available\n",
      "       </a>\n",
      "      </td>\n",
      "     </tr>\n",
      "    </table>\n",
      "    <hr/>\n",
      "    <h3>\n",
      "     Frameworks &amp; Technologies\n",
      "    </h3>\n",
      "    <p>\n",
      "     <img alt=\"c\" src=\"static/c.png\" style=\"width:70px;height:70px;border:0;\" title=\"C\"/>\n",
      "     <img alt=\"cpp\" src=\"static/cpp.png\" style=\"width:70px;height:80px;border:0;\" title=\"C++11,C++14\"/>\n",
      "     <img alt=\"Pyhton\" src=\"static/Python.png\" style=\"width:70px;height:70px;border:0;\" title=\"Python 2 &amp; Python 3\"/>\n",
      "     <img alt=\"HTML\" src=\"static/HTML.png\" style=\"width:70px;height:70px;border:0;\" title=\"HTML 5\"/>\n",
      "     <img alt=\"mysql\" src=\"static/mysql.png\" style=\"width:70px;height:70px;border:0;\" title=\"MySQL\"/>\n",
      "     <img alt=\"octave\" src=\"static/octave.svg\" style=\"width:70px;height:70px;border:0;\" title=\"Octave Language\"/>\n",
      "     <img alt=\"django\" src=\"static/django.svg\" style=\"width:90px;height:90px;border:0;\" title=\"Django Web Framework\"/>\n",
      "     <img alt=\"JavaScript\" src=\"static/JavaScript-logo.png\" style=\"width:90px;height:90px;border:0;\" title=\"JavaScript\"/>\n",
      "    </p>\n",
      "    <h3>\n",
      "     My Weapons\n",
      "    </h3>\n",
      "    <p>\n",
      "     <img alt=\"Git\" src=\"static/Git.png\" style=\"width:70px;height:70px;border:0;\" title=\"Git\"/>\n",
      "     <img alt=\"VSCode\" src=\"static/vscode.png\" style=\"width:70px;height:70px;border:0;\" title=\"VSCode\"/>\n",
      "     <img alt=\"jupyter\" src=\"static/jupyter.png\" style=\"width:70px;height:70px;border:0;\" title=\"jupyter notebook\"/>\n",
      "     <img alt=\"anaconda\" src=\"static/anaconda.png\" style=\"width:70px;height:70px;border:0;\" title=\"Anaconda\"/>\n",
      "    </p>\n",
      "    <hr/>\n",
      "    <br/>\n",
      "    <!--\n",
      "            https://docs.google.com/forms/d/e/1FAIpQLSfim3RiM1NLrTszkwOv2uJ8mFMfZR6WZU-qKK6oRUlgA9vjuw/viewform?usp=pp_url&entry.389706550=Karma&entry.1867581834=Bitch&entry.973008035=Hellllllllooooo-->\n",
      "    <h2>\n",
      "     Share Your Views!\n",
      "    </h2>\n",
      "    <form action=\"https://docs.google.com/forms/d/e/1FAIpQLSfim3RiM1NLrTszkwOv2uJ8mFMfZR6WZU-qKK6oRUlgA9vjuw/formResponse?\" enctype=\"text/plain\" id=\"myform\" name=\"gform\" onsubmit=\"submitted=true;\" target=\"hidden_iframe\">\n",
      "     <div class=\"fields\">\n",
      "      <div class=\"field\">\n",
      "       <input id=\"entry.389706550\" name=\"entry.389706550\" placeholder=\"First Name\" type=\"text\"/>\n",
      "      </div>\n",
      "      <div class=\"field\">\n",
      "       <input id=\"entry.1867581834\" name=\"entry.1867581834\" placeholder=\"Last Name\" type=\"text\"/>\n",
      "      </div>\n",
      "      <div class=\"field\">\n",
      "       <textarea id=\"entry.973008035\" name=\"entry.973008035\" placeholder=\"Message\" rows=\"4\"></textarea>\n",
      "      </div>\n",
      "     </div>\n",
      "     <input class=\"button\" onclick=\"msg()\" type=\"submit\" value=\"Send Feedback\"/>\n",
      "    </form>\n",
      "    <iframe id=\"hidden_iframe\" name=\"hidden_iframe\" onload=\"if(submitted) { clear()}\" style=\"display:none;\">\n",
      "    </iframe>\n",
      "    <hr/>\n",
      "    <footer>\n",
      "     <h3>\n",
      "      <br/>\n",
      "      Find me on\n",
      "      <br/>\n",
      "      <br/>\n",
      "     </h3>\n",
      "     <ul class=\"icons\">\n",
      "      <div class=\"grow\">\n",
      "       <a href=\"https://github.com/Bhupesh-V\">\n",
      "        <img alt=\"github\" src=\"static/github.svg\" style=\"width:40px;height:40px;border:0;\" title=\"Follow Me on Github \"/>\n",
      "       </a>\n",
      "       <a href=\"https://www.quora.com/profile/Bhupesh-Varshney\">\n",
      "        <img alt=\"Quora\" src=\"static/quora.png\" style=\"width:40px;height:40px;border:0;\" title=\"Follow Me on Quora \"/>\n",
      "       </a>\n",
      "       <a href=\"https://www.hackerrank.com/bhupeshv?hr_r=1\">\n",
      "        <img alt=\"hackerRank\" src=\"static/hackerrank1.png\" style=\"width:40px;height:40px;border:0;\" title=\"Follow Me on HackerRank \"/>\n",
      "       </a>\n",
      "       <a href=\"mailto:varshneybhupesh@gmail.com\">\n",
      "        <img alt=\"gmail\" src=\"static/email.png\" style=\"width:50px;height:40px;border:0;\" title=\"Send me a Mail \"/>\n",
      "       </a>\n",
      "       <a href=\"https://twitter.com/CodePervert\">\n",
      "        <img alt=\"twitter\" src=\"static/twitter.png\" style=\"width:50px;height:50px;border:0;\" title=\"Follow Me on Twitter\"/>\n",
      "       </a>\n",
      "       <a href=\"https://dev.to/bhupesh\">\n",
      "        <img alt=\"DEV Profile\" src=\"https://d2fltix0v2e0sb.cloudfront.net/dev-badge.svg\" style=\"width:50px;height:50px;border:0;\"/>\n",
      "       </a>\n",
      "       <a href=\"https://www.linkedin.com/in/bhupesh-varshney-89a0b2171\">\n",
      "        <img alt=\"LinkdeIn\" src=\"static/linkedin-icon.png\" style=\"width:40px;height:40px;border:0;\" title=\"Send Me a Connection Request\"/>\n",
      "       </a>\n",
      "      </div>\n",
      "     </ul>\n",
      "    </footer>\n",
      "   </section>\n",
      "   <!-- Footer -->\n",
      "   <footer id=\"footer\">\n",
      "    <ul class=\"copyright\">\n",
      "     <li>\n",
      "      Made with ❤️ by Bhupesh\n",
      "     </li>\n",
      "    </ul>\n",
      "    <div class=\"grow\">\n",
      "     <a href=\"https://github.com/Bhupesh-V/Bhupesh-V.github.io\">\n",
      "      <img height=\"80\" src=\"static/forkme.png\"/>\n",
      "     </a>\n",
      "    </div>\n",
      "   </footer>\n",
      "  </div>\n",
      "  <!-- Scripts -->\n",
      "  <script>\n",
      "   function msg(){\n",
      "          alert(\"Thanks for your feedback !!\");\n",
      "          var frm = document.getElementsByName('gform')[0];\n",
      "          frm.submit(); // Submit the form\n",
      "          return false; // Prevent page refresh\n",
      "      }\n",
      "      function clear(){\n",
      "          var frm = document.getElementsByName('gform')[0];\n",
      "          frm.reset();  // Reset all form data\n",
      "      }     \n",
      "      if ('addEventListener' in window) {\n",
      "        window.addEventListener('load', function() { document.body.className = document.body.className.replace(/\\bis-preload\\b/, ''); });\n",
      "        document.body.className += (navigator.userAgent.match(/(MSIE|rv:11\\.0)/) ? ' is-ie' : '');\n",
      "      }\n",
      "  </script>\n",
      " </body>\n",
      "</html> <class 'bs4.BeautifulSoup'>\n"
     ]
    }
   ],
   "source": [
    "# parsing the site using lxml parser\n",
    "soup = bs (req.text, \"lxml\")\n",
    "\n",
    "# prettify () used to print source code with proper nesting, easier to read\n",
    "print (soup.prettify (), type (soup))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Finding specific elements\n",
    "``find ()`` to find a specific tag/element.\n",
    "\n",
    "``find_all ()`` to find all the instances of the specified tag/element."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<a class=\"button\" href=\"blog.html\">Checkout My Blogs</a>\n",
      "Checkout My Blogs\n"
     ]
    }
   ],
   "source": [
    "print (soup.find (\"a\", class_=\"button\"))\n",
    "print (soup.find (\"a\", class_=\"button\").text)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Checkout My Blogs: blog.html\n",
      "Resume: https://drive.google.com/file/d/1YlOHhvkLCwEhY1iFsHppVOmtMWeKtp4X/view?usp=sharing\n",
      "Available: https://github.com/Bhupesh-V/HeckChat\n",
      "Available: https://github.com/Bhupesh-V/Algorithms\n",
      "On Going: https://github.com/Bhupesh-V/CoderBot\n",
      "Available: https://github.com/Bhupesh-V/Learn-Python-Packages\n",
      "Available: https://github.com/Bhupesh-V/30-Seconds-Of-STL\n",
      "Available: https://github.com/Bhupesh-V/EmployeeAPI\n"
     ]
    }
   ],
   "source": [
    "for link in soup.find_all (\"a\", class_=\"button\"):\n",
    "    print (link.text + \": \" + link['href'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "\n",
      "\n",
      "Bhupesh Varshney\n",
      "Open Source Enthusiast 🤓 & Code Pervert 😜 .\n",
      "Checkout My Blogs\n",
      "Resume\n",
      "\n",
      "\n",
      "\n",
      "              Hi, I am Bhupesh Varshney, 19 year old Student Developer, 2nd year Computer Science student living in New Delhi, India. I code in Python,C++,Golang,C & JavaScript.I use Linux, jupyter, VSCode as my developer environment.\n",
      "            \n",
      "\n",
      "\n",
      "Projects\n",
      "\n",
      "\n",
      "Name \n",
      "Status\n",
      "\n",
      "\n",
      "HeckChat\n",
      "Available\n",
      "\n",
      "\n",
      "Algorithms\n",
      "Available\n",
      "\n",
      "\n",
      "CoderBot\n",
      "On Going\n",
      "\n",
      "\n",
      "Learn-Python-Packages\n",
      "Available\n",
      "\n",
      "\n",
      "30-Seconds-Of-STL\n",
      "Available\n",
      "\n",
      "\n",
      "EmployeeAPI\n",
      "Available\n",
      "\n",
      "\n",
      "\n",
      "Frameworks & Technologies\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "My Weapons\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Share Your Views!\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Find me on \n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n"
     ]
    }
   ],
   "source": [
    "print (soup.find (\"section\").text)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Scraping data from YouTube"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://www.youtube.com/results?search_query=travel+blog&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=science+and+technology&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=food&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=manufacturing&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=history&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=art+and+music&sp=EgIQAQ%253D%253D\n"
     ]
    }
   ],
   "source": [
    "# declaring variables which will be needed to create the specified links\n",
    "\n",
    "yt_link = \"https://www.youtube.com\"\n",
    "categories = [\"travel+blog\", \"science+and+technology\", \"food\", \"manufacturing\", \"history\", \"art+and+music\"]\n",
    "searchstr = \"/results?search_query=\"\n",
    "only_vids = \"&sp=EgIQAQ%253D%253D\"\n",
    "\n",
    "# printing the links that will be generated\n",
    "for category in categories:\n",
    "    print (yt_link + searchstr + category + only_vids)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Starting with the Travel Blog category"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://www.youtube.com/results?search_query=travel+blog&sp=EgIQAQ%253D%253D\n",
      "<Response [200]>\n"
     ]
    }
   ],
   "source": [
    "travel_blog = yt_link + searchstr + categories[0] + only_vids\n",
    "\n",
    "print (travel_blog)\n",
    "\n",
    "req = requests.get (travel_blog)\n",
    "print (req)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "soup = bs (req.text, \"lxml\")\n",
    "\n",
    "# printing all links found at the requested page\n",
    "# for link in soup.find_all (\"a\"):\n",
    "#     print (link.prettify ())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "# printing the source code of the web-page in readable format\n",
    "# print (soup.prettify ())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Video-Title: TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE\n",
      "Description: Learn how to set up a blog Follow this Step-By-Step Tutorial\n",
      "Video-ID: i9E_Blai8vk\n",
      "\n",
      "Video-Title: How do I travel so much ! How do I earn money!!\n",
      "Description: I had the chance to fly out to Bali with my whole family this Thanksgiving for our first ever trip abroad! I wanted to document my ...\n",
      "Video-ID: e2NQE41J5eM\n",
      "\n",
      "Video-Title: GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL OUTFIT IDEAS\n",
      "Description: SUBSCRIBE - https://goo.gl/dEtSMJ ('MountainTrekker') Gimbal - https://goo.gl/Frwci2 If you have any other query feel free to ask ...\n",
      "Video-ID: -LzdIILq5vE\n",
      "\n",
      "Video-Title: 200 Days - A Trip Around the World Travel Film\n",
      "Description: Hope you enjoy MY GOA TRAVEL DIARY this video! Don't forget to subscribe and like this video Thank you for your support, love ...\n",
      "Video-ID: RcmrbNRK-jY\n",
      "\n",
      "Video-Title: How to Start a Travel Blog [2019] Travel Blogging Full-Time\n",
      "Description: My wife and I traveled to 17 countries in 200 days. This film is the story of our incredible trip! Enjoy! We used a GoPro and a Nikon ...\n",
      "Video-ID: kiNyRY5s7n8\n",
      "\n",
      "Video-Title: HOW TO TRAVEL THE PHILIPPINES\n",
      "Description: Create a Travel Blog Website for Just $3.95++ http://bit.ly/create-a-travel-blog-websiteI've been a full-time blogger ...\n",
      "Video-ID: g-7RK9cmXis\n",
      "\n",
      "Video-Title: 5 Steps to Becoming a Travel Blogger\n",
      "Description: THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVELED! You simply must put the Philippines on your bucket list. The most ...\n",
      "Video-ID: 7ByoBJYXU0k\n",
      "\n",
      "Video-Title: Welcome to Peru! | Best Essential Tips & Travel Guide\n",
      "Description: Travel blogger, Nikki Vargas, of The Pin the Map Project (voted top 100 travel blog in 2015) shares her best tips to getting started ...\n",
      "Video-ID: SL_YBLWdZb8\n",
      "\n",
      "Video-Title: How I Make Money and Travel the World\n",
      "Description: Read the full description of how I make money and travel the world, including more resources and info at ...\n",
      "Video-ID: 4OH6-fxBsQA\n",
      "\n",
      "Video-Title: TRAVEL VLOG: SANTORINI, GREECE\n",
      "Description: Thank you so much for watching! I hope you found travel and outfit inspiration for your next trip! Watch more of my travel videos ...\n",
      "Video-ID: EthqIhPtd2I\n",
      "\n",
      "Video-Title: Exploring Hong Kong: A 5-Day Itinerary (Macau Included!)\n",
      "Description: Here's a comprehensive Hong Kong travel guide itinerary of things to do for first-time travelers! (With a visit to Macau included).\n",
      "Video-ID: v3RLM9wt5s8\n",
      "\n",
      "Video-Title: Travel Vlog: Venice, An Italian Love Affair | HAUSOFCOLOR\n",
      "Description: I made my way to The Floating City of Venice last summer and it was one of the most beautiful places I've ever seen! A city full of ...\n",
      "Video-ID: hXVR4l56vZ0\n",
      "\n",
      "Video-Title: What is it like to travel in PAKISTAN?\n",
      "Description: Subscribe now: https://goo.gl/6zXZGKWatch the full series now: https://youtu.be/Xdya8eym9nMHuge thank you to Ali, CEO of ...\n",
      "Video-ID: 7mIzRYh8jGA\n",
      "\n",
      "Video-Title: 🇯🇵 Tokyo Travel Guide 🇯🇵 | Travel better in JAPAN!\n",
      "Description: Here's our Essential Tokyo Travel Guide , giving you EVERYTHING you need to know to travel better for your own ...\n",
      "Video-ID: bC9m_id_Yds\n",
      "\n",
      "Video-Title: Beautiful Thailand by Travel Blogger @joaocajuda\n",
      "Description: Follow me for more videos: Facebook: http://www.facebook.com/cajuda.pt Instagram: http://www.instagram.com/joaocajuda ...\n",
      "Video-ID: rlCVwA2A5UA\n",
      "\n",
      "Video-Title: Backpacking Around New Zealand\n",
      "Description: A month traveling around New Zealand's south and north islands - I was sent on a GoPro shoot for a 5 day kayak trip and I ...\n",
      "Video-ID: QdEsM7-_DLI\n",
      "\n",
      "Video-Title: SIARGAO, PHILIPPINES TRAVEL GUIDE (budget & itinerary)\n",
      "Description: Back at the Surfing Capital of the Philippines, Siargao! Spent 10 days on the island exploring different spots so here's the ultimate ...\n",
      "Video-ID: eRFqZ3yhwDA\n",
      "\n",
      "Video-Title: Exploring Bangkok, Thailand in 4 Days!\n",
      "Description: 4-days of fun and exciting experiences, foodie trips and brief shopping sprees in Bangkok, Thailand together with Sheraton ...\n",
      "Video-ID: ltHTDqVTqN0\n",
      "\n",
      "Video-Title: VAN LIFE | A Day in The Life | MEXICO\n",
      "Description: We have been traveling in our van in Mexico for nearly 5 months. Today we bring you along on the adventure to show you what a ...\n",
      "Video-ID: ZR7Z74UY2TY\n",
      "\n",
      "Video-Title: Oslo, Flam, & Bergen Norway Travel Vlog | As Told By\n",
      "Description: We are so excited to share our trip to Norway with y'all! We went to Oslo, Flam & Bergen! It was such a cool trip! We highly ...\n",
      "Video-ID: t2Y71Tv5Nos\n",
      "\n"
     ]
    }
   ],
   "source": [
    "# using class_ (CSS class of the element) to find all video-links, descriptions\n",
    "\n",
    "links = soup.find_all (\"a\", class_=\"yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2 yt-uix-sessionlink spf-link \")\n",
    "\n",
    "descriptions = soup.find_all (\"div\", class_=\"yt-lockup-description yt-ui-ellipsis yt-ui-ellipsis-2\")\n",
    "\n",
    "# 20 video results in one page\n",
    "for link, description in zip (links, descriptions):\n",
    "    print (\"Video-Title: \" + link.text)\n",
    "    print (\"Description: \" + description.text)\n",
    "    print (\"Video-ID: \" + link[\"href\"].split(\"=\")[1])\n",
    "    print ()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Learn how to set up a blog Follow this Step-By-Step Tutorial\n",
      "\n",
      "I had the chance to fly out to Bali with my whole family this Thanksgiving for our first ever trip abroad! I wanted to document my ...\n",
      "\n",
      "SUBSCRIBE - https://goo.gl/dEtSMJ ('MountainTrekker') Gimbal - https://goo.gl/Frwci2 If you have any other query feel free to ask ...\n",
      "\n",
      "Hope you enjoy MY GOA TRAVEL DIARY this video! Don't forget to subscribe and like this video Thank you for your support, love ...\n",
      "\n",
      "My wife and I traveled to 17 countries in 200 days. This film is the story of our incredible trip! Enjoy! We used a GoPro and a Nikon ...\n",
      "\n",
      "Create a Travel Blog Website for Just $3.95++ http://bit.ly/create-a-travel-blog-websiteI've been a full-time blogger ...\n",
      "\n",
      "THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVELED! You simply must put the Philippines on your bucket list. The most ...\n",
      "\n",
      "Travel blogger, Nikki Vargas, of The Pin the Map Project (voted top 100 travel blog in 2015) shares her best tips to getting started ...\n",
      "\n",
      "Read the full description of how I make money and travel the world, including more resources and info at ...\n",
      "\n",
      "Thank you so much for watching! I hope you found travel and outfit inspiration for your next trip! Watch more of my travel videos ...\n",
      "\n",
      "Here's a comprehensive Hong Kong travel guide itinerary of things to do for first-time travelers! (With a visit to Macau included).\n",
      "\n",
      "I made my way to The Floating City of Venice last summer and it was one of the most beautiful places I've ever seen! A city full of ...\n",
      "\n",
      "Subscribe now: https://goo.gl/6zXZGKWatch the full series now: https://youtu.be/Xdya8eym9nMHuge thank you to Ali, CEO of ...\n",
      "\n",
      "Here's our Essential Tokyo Travel Guide , giving you EVERYTHING you need to know to travel better for your own ...\n",
      "\n",
      "Follow me for more videos: Facebook: http://www.facebook.com/cajuda.pt Instagram: http://www.instagram.com/joaocajuda ...\n",
      "\n",
      "A month traveling around New Zealand's south and north islands - I was sent on a GoPro shoot for a 5 day kayak trip and I ...\n",
      "\n",
      "Back at the Surfing Capital of the Philippines, Siargao! Spent 10 days on the island exploring different spots so here's the ultimate ...\n",
      "\n",
      "4-days of fun and exciting experiences, foodie trips and brief shopping sprees in Bangkok, Thailand together with Sheraton ...\n",
      "\n",
      "We have been traveling in our van in Mexico for nearly 5 months. Today we bring you along on the adventure to show you what a ...\n",
      "\n",
      "We are so excited to share our trip to Norway with y'all! We went to Oslo, Flam & Bergen! It was such a cool trip! We highly ...\n",
      "\n"
     ]
    }
   ],
   "source": [
    "# descriptions on the page are incomplete\n",
    "for des in soup.find_all (\"div\", class_=\"yt-lockup-description yt-ui-ellipsis yt-ui-ellipsis-2\"):\n",
    "    print (des.text)\n",
    "    print ()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Issue:\n",
    "Don't know how I will get 300+ results for each category.\n",
    "\n",
    "## Fix:\n",
    "\n",
    "Use pagination links to request next page of results."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "# YouTube's pagination button's CSS selector\n",
    "buttons = soup.find_all (\"a\", attrs={\"class\": \"yt-uix-button vve-check yt-uix-sessionlink yt-uix-button-default yt-uix-button-size-default\"})\n",
    "\n",
    "# <a aria-label=\"Go to page 2\" class=\"yt-uix-button vve-check yt-uix-sessionlink yt-uix-button-default yt-uix-button-size-default\" data-sessionlink=\"itct=CAcQnKQBGAciEwjY6q2r8_TgAhUTJmgKHbHYACwo9CQ\" data-visibility-tracking=\"CAcQnKQBGAciEwjY6q2r8_TgAhUTJmgKHbHYACwo9CQ\" href=\"/results?sp=EgIQAUgU6gMA&amp;search_query=travel+blog\">\n",
    "#  <span class=\"yt-uix-button-content\">\n",
    "#   Next »\n",
    "#  </span>\n",
    "# </a>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "/results?search_query=travel+blog&sp=EgIQAUgU6gMA\n",
      "/results?sp=EgIQAUgo6gMA&search_query=travel+blog\n",
      "/results?sp=EgIQAUg86gMA&search_query=travel+blog\n",
      "/results?search_query=travel+blog&sp=EgIQAUhQ6gMA\n",
      "/results?sp=EgIQAUhk6gMA&search_query=travel+blog\n",
      "/results?sp=EgIQAUh46gMA&search_query=travel+blog\n",
      "/results?sp=EgIQAUgU6gMA&search_query=travel+blog\n",
      "https://www.youtube.com/results?sp=EgIQAUgU6gMA&search_query=travel+blog\n"
     ]
    }
   ],
   "source": [
    "# printing all pagination buttons on the site\n",
    "for button in buttons:\n",
    "    print (button[\"href\"])\n",
    "    \n",
    "# getting Next button (last pagination button for going to next page)\n",
    "next_button = buttons[-1][\"href\"]\n",
    "\n",
    "# creating link for next page\n",
    "next_button = \"https://www.youtube.com\" + str(next_button)\n",
    "print (next_button)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<Response [200]>\n"
     ]
    }
   ],
   "source": [
    "# making request to the next page linked by the Next button\n",
    "nextreq = requests.get (next_button)\n",
    "\n",
    "print (req)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "# parsing the next page\n",
    "nextsoup = bs (nextreq.text, \"lxml\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Video-Title: Beautiful Thailand by Travel Blogger @joaocajuda Count = 1\n",
      "Video-ID: rlCVwA2A5UA\n",
      "\n",
      "Video-Title: Paris Vacation Travel Guide | Expedia Count = 2\n",
      "Video-ID: AQ6GmpMu5L8\n",
      "\n",
      "Video-Title: Top 10 YouTube Travellers Count = 3\n",
      "Video-ID: 942sCY6d7kU\n",
      "\n",
      "Video-Title: Thailand Vlog Count = 4\n",
      "Video-ID: 41ssBujAS0U\n",
      "\n",
      "Video-Title: Miami Vacation Travel Guide | Expedia Count = 5\n",
      "Video-ID: 58iT2L4VQj4\n",
      "\n",
      "Video-Title: A WEEK IN PARIS | travel vlog Count = 6\n",
      "Video-ID: tKXrpRrj7Ow\n",
      "\n",
      "Video-Title: Oslo, Flam, & Bergen Norway Travel Vlog | As Told By Count = 7\n",
      "Video-ID: t2Y71Tv5Nos\n",
      "\n",
      "Video-Title: Ajmer Shatabdi Express : My FIRST Indian Train Journey - Delhi to Jaipur ( FULL JOURNEY) 🇮🇳 Count = 8\n",
      "Video-ID: eU9CXazi_3c\n",
      "\n",
      "Video-Title: Taiwan Travel Guide: A 3-Day Itinerary | Taipei + Day Tours Count = 9\n",
      "Video-ID: _ZU-bP6Z9S4\n",
      "\n",
      "Video-Title: Exploring Hong Kong: A 5-Day Itinerary (Macau Included!) Count = 10\n",
      "Video-ID: v3RLM9wt5s8\n",
      "\n",
      "Video-Title: SIARGAO, PHILIPPINES TRAVEL GUIDE (budget & itinerary) Count = 11\n",
      "Video-ID: eRFqZ3yhwDA\n",
      "\n",
      "Video-Title: How To Make a TRAVEL VIDEO - 10 Tips you need to know Count = 12\n",
      "Video-ID: MGhjvist4gk\n",
      "\n",
      "Video-Title: Exploring Bangkok, Thailand in 4 Days! Count = 13\n",
      "Video-ID: ltHTDqVTqN0\n",
      "\n",
      "Video-Title: How to Start a Travel Blog: My Top 10 Tips Count = 14\n",
      "Video-ID: mbt2Yzc35Ok\n",
      "\n",
      "Video-Title: WE'RE IN GERMANY - BERLIN FIRST IMPRESSIONS! | Germany Travel Vlog 151, 2018 Count = 15\n",
      "Video-ID: PPvai6N9YOE\n",
      "\n",
      "Video-Title: SOUTH EAST ASIA TRIP  |  VIETNAM, CAMBODIA, THAILAND, HONG KONG, TAIWAN Count = 16\n",
      "Video-ID: oQUOKfe1WKA\n",
      "\n",
      "Video-Title: I GET PAID TO TRAVEL THE WORLD - HOW I BECAME A TRAVEL BLOGGER part 1 Count = 17\n",
      "Video-ID: kYrpoSgHkTI\n",
      "\n",
      "Video-Title: THINGS I WISH KNEW before I started my TRAVEL BLOG | Little Grey Box Count = 18\n",
      "Video-ID: 0tEfRw0NZn8\n",
      "\n",
      "Video-Title: WOW!! Summer in ST. PETERSBURG RUSSIA Count = 19\n",
      "Video-ID: MxPioEoMOgc\n",
      "\n",
      "Video-Title: 24 Hours in Hangzhou, China | Travel Guide | Karlie Kloss Count = 20\n",
      "Video-ID: HmH71FGDqc8\n",
      "\n"
     ]
    }
   ],
   "source": [
    "count = 1\n",
    "\n",
    "# finding the video links in the next page\n",
    "for link in nextsoup.find_all (\"a\", class_=\"yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2 yt-uix-sessionlink spf-link \"):\n",
    "    print (\"Video-Title: \" + link.text + \" Count = \" + str (count))\n",
    "    print (\"Video-ID: \" + link[\"href\"].split(\"=\")[1])\n",
    "    print ()\n",
    "    count += 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "How to Start a Blog in 2019 Step-By-Step\n",
      "Learn how to set up a blog Follow this Step-By-Step Tutorial\n",
      "\n",
      "\n",
      "TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE\n",
      "I had the chance to fly out to Bali with my whole family this Thanksgiving for our first ever trip abroad! I wanted to document my ...\n",
      "\n",
      "\n",
      "How do I travel so much ! How do I earn money!!\n",
      "SUBSCRIBE - https://goo.gl/dEtSMJ ('MountainTrekker') Gimbal - https://goo.gl/Frwci2 If you have any other query feel free to ask ...\n",
      "\n",
      "\n",
      "GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL OUTFIT IDEAS\n",
      "Hope you enjoy MY GOA TRAVEL DIARY this video! Don't forget to subscribe and like this video Thank you for your support, love ...\n",
      "\n",
      "\n",
      "200 Days - A Trip Around the World Travel Film\n",
      "My wife and I traveled to 17 countries in 200 days. This film is the story of our incredible trip! Enjoy! We used a GoPro and a Nikon ...\n",
      "\n",
      "\n",
      "How to Start a Travel Blog [2019] Travel Blogging Full-Time\n",
      "Create a Travel Blog Website for Just $3.95++ http://bit.ly/create-a-travel-blog-websiteI've been a full-time blogger ...\n",
      "\n",
      "\n",
      "5 Steps to Becoming a Travel Blogger\n",
      "Travel blogger, Nikki Vargas, of The Pin the Map Project (voted top 100 travel blog in 2015) shares her best tips to getting started ...\n",
      "\n",
      "\n",
      "HOW TO TRAVEL THE PHILIPPINES\n",
      "THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVELED! You simply must put the Philippines on your bucket list. The most ...\n",
      "\n",
      "\n",
      "Welcome to Peru! | Best Essential Tips & Travel Guide\n",
      "\n",
      "\n",
      "TRAVEL VLOG: SANTORINI, GREECE\n",
      "Thank you so much for watching! I hope you found travel and outfit inspiration for your next trip! Watch more of my travel videos ...\n",
      "\n",
      "\n",
      "How I Make Money and Travel the World\n",
      "Read the full description of how I make money and travel the world, including more resources and info at ...\n",
      "\n",
      "\n",
      "What is it like to travel in PAKISTAN?\n",
      "Subscribe now: https://goo.gl/6zXZGKWatch the full series now: https://youtu.be/Xdya8eym9nMHuge thank you to Ali, CEO of ...\n",
      "\n",
      "\n",
      "Travel Vlog: Venice, An Italian Love Affair | HAUSOFCOLOR\n",
      "I made my way to The Floating City of Venice last summer and it was one of the most beautiful places I've ever seen! A city full of ...\n",
      "\n",
      "\n",
      "🇯🇵 Tokyo Travel Guide 🇯🇵 | Travel better in JAPAN!\n",
      "Here's our Essential Tokyo Travel Guide , giving you EVERYTHING you need to know to travel better for your own ...\n",
      "\n",
      "\n",
      "Exploring Hong Kong: A 5-Day Itinerary (Macau Included!)\n",
      "Here's a comprehensive Hong Kong travel guide itinerary of things to do for first-time travelers! (With a visit to Macau included).\n",
      "\n",
      "\n",
      "Beautiful Thailand by Travel Blogger @joaocajuda\n",
      "Follow me for more videos: Facebook: http://www.facebook.com/cajuda.pt Instagram: http://www.instagram.com/joaocajuda ...\n",
      "\n",
      "\n",
      "MALDIVES TRAVEL VLOG 🏝 COCO LILI\n",
      "INSTAGRAM: https://www.instagram.com/cocolilii 🧡SNAPCHAT: Lili.Lizi My Maldives Vlog and travel diary is finally up! I hope you ...\n",
      "\n",
      "\n",
      "SIARGAO, PHILIPPINES TRAVEL GUIDE (budget & itinerary)\n",
      "Back at the Surfing Capital of the Philippines, Siargao! Spent 10 days on the island exploring different spots so here's the ultimate ...\n",
      "\n",
      "\n",
      "VAN LIFE | A Day in The Life | MEXICO\n",
      "We have been traveling in our van in Mexico for nearly 5 months. Today we bring you along on the adventure to show you what a ...\n",
      "\n",
      "\n",
      "Taiwan Travel Guide: A 3-Day Itinerary | Taipei + Day Tours\n",
      "3 days of fun and exciting experiences filled with culture, food, and sights in Taiwan with KKday and a lucky reader who won my ...\n",
      "\n",
      "\n",
      "Thailand Full Moon Party Tips - Koh Phangan | O. Christine Travel Blog\n",
      "I went to Koh Phangan this year just for the full moon party on Haad Rin. I thought you could use these 15 tips to help ...\n",
      "\n",
      "\n"
     ]
    }
   ],
   "source": [
    "# source code copied from a blog (works, but doesn't give exactly what is needed)\n",
    "\n",
    "source = requests.get(travel_blog)\n",
    "soup = bs (source.text, 'lxml')\n",
    "\n",
    "\n",
    "for content in soup.find_all('div', class_= \"yt-lockup-content\"):\n",
    "    \n",
    "    # description may be empty and might throw exception\n",
    "    try:\n",
    "        \n",
    "        title = content.h3.a.text\n",
    "        print(title)\n",
    "\n",
    "        description = content.find('div', class_=\"yt-lockup-description yt-ui-ellipsis yt-ui-ellipsis-2\").text\n",
    "        print(description)\n",
    "\n",
    "    except Exception as e:\n",
    "        \n",
    "        description = None\n",
    "\n",
    "    print('\\n')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "# scraping description from a video's site (where video is played)\n",
    "url = \"https://www.youtube.com/watch?v=e2NQE41J5eM\"\n",
    "\n",
    "req_video = requests.get (url)\n",
    "\n",
    "soup_video = bs (req_video.text, \"lxml\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Video title: \n",
      "How do I travel so much ! How do I earn money!! \n"
     ]
    }
   ],
   "source": [
    "# getting video title\n",
    "title = soup_video.find (\"h1\", class_=\"watch-title-container\").text.split (\"\\n\")[2].rsplit ()\n",
    "\n",
    "formatted_title = \"\"\n",
    "\n",
    "for w in title:\n",
    "    formatted_title += w + \" \"\n",
    "    \n",
    "print (\"Video title: \")\n",
    "print (formatted_title)\n",
    "\n",
    "# <h1 class=\"title style-scope ytd-video-primary-info-renderer\"><yt-formatted-string force-default-style=\"\" class=\"style-scope ytd-video-primary-info-renderer\">How do I travel so much ! How do I earn money!!</yt-formatted-string></h1>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Video description: \n",
      "SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTrekker’)Gimbal - https://goo.gl/Frwci2If you have any other query feel free to ask at - www.facebook.com/groups/touristhelpline (It may not be possible for me to answer each and every query here, but other group members, travelers, and travel experts can help you)Other travel series  - # THAILAND playlist - https://goo.gl/dOUJck # EUROPE Playlist - https://goo.gl/Tlx9mJ# BANGLADESH playlist -  https://goo.gl/uw1y1v# SPITI (India) playlist - https://goo.gl/xqvvQ6# MALAYSIA playlist - https://goo.gl/2a3doKPLEASE SHARE THE VIDEOS AND LET OTHERS GET INFORMED ABOUT THIS CHANNEL My blog: www.touristhelpline.comFACEBOOK.com/page.mountaintrekkerTWITTER.com/mttrekkerindia\n"
     ]
    }
   ],
   "source": [
    "# getting video description\n",
    "print (\"Video description: \")\n",
    "\n",
    "print (soup_video.find (\"p\", id=\"eow-description\").text)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "# tring something out\n",
    "url = \"https://www.youtube.com/results?sp=EgIQAQ%253D%253D&search_query=travel+blogs\"\n",
    "\n",
    "requestURL = requests.get (url)\n",
    "\n",
    "URLsoup = bs (requestURL.text, \"lxml\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Video ID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Description</th>\n",
       "      <th>Category</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "Empty DataFrame\n",
       "Columns: [Video ID, Title, Description, Category]\n",
       "Index: []"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# creating pandas dataframe so that writing to csv file easy\n",
    "YTDf = pd.DataFrame (columns=[\"Video ID\", \"Title\", \"Description\", \"Category\"])\n",
    "\n",
    "# creating lists for storing video's ID, Title, Description, Category\n",
    "ytid = []\n",
    "yttitle =  []\n",
    "ytdes = []\n",
    "ytcat = []\n",
    "\n",
    "YTDf"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Video-Title: TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE\n",
      "Video-ID: i9E_Blai8vk\n",
      "Video description: \n",
      "I had the chance to fly out to Bali with my whole family this Thanksgiving for our first ever trip abroad! I wanted to document my memories so that I can always remember how blessed I am to have this opportunity and also share it with those who have never been to Bali.I am by no means anything close to a professional so please excuse the shaky hand and enjoy!Check out my Bali blog post on my website -http://www.leepriscilla.com/blog/sx9n...LOCATIONS:1. The Viceroy Bali (Ubud)https://www.viceroybali.com/en/introd...2. AYANA Resort & Spa (Jimbaran)http://www.ayana.com/CAMERA:Canon G9XMUSIC:Like more music and original songs?Check out David's channel: https://bit.ly/2Hhj3TB1. Naulé - Motionhttps://soundcloud.com/naulemusic/motion2. Pogo - Bloomhttps://www.youtube.com/watch?v=t_hto...3. Tom Misch - Lush Lifehttps://soundcloud.com/tommisch/lush-...4. Static Love - 1986https://soundcloud.com/ivoryoasis/sta...5. Qrion - Beachhttps://soundcloud.com/qrionqrionqrio...\n",
      "\n",
      "Video-Title: How do I travel so much ! How do I earn money!!\n",
      "Video-ID: e2NQE41J5eM\n",
      "Video description: \n",
      "SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTrekker’)Gimbal - https://goo.gl/Frwci2If you have any other query feel free to ask at - www.facebook.com/groups/touristhelpline (It may not be possible for me to answer each and every query here, but other group members, travelers, and travel experts can help you)Other travel series  - # THAILAND playlist - https://goo.gl/dOUJck # EUROPE Playlist - https://goo.gl/Tlx9mJ# BANGLADESH playlist -  https://goo.gl/uw1y1v# SPITI (India) playlist - https://goo.gl/xqvvQ6# MALAYSIA playlist - https://goo.gl/2a3doKPLEASE SHARE THE VIDEOS AND LET OTHERS GET INFORMED ABOUT THIS CHANNEL My blog: www.touristhelpline.comFACEBOOK.com/page.mountaintrekkerTWITTER.com/mttrekkerindia\n",
      "\n",
      "Video-Title: Top 10 YouTube Travellers\n",
      "Video-ID: 942sCY6d7kU\n",
      "Video description: \n",
      "Hello, and welcome to TopX, where we count down the very best that YouTube has to offer. Today we're taking you all around the world and you don’t even have to leave home, as we look at our picks for the top 10 YouTube travellers! Suggestion Tool►►http://www.WatchMojo.com/suggest Subscribe►►http://www.youtube.com/subscription_c... Facebook►►http://www.Facebook.com/WatchMojo Twitter►►http://www.Twitter.com/WatchMojo Instagram►►http://instagram.com/watchmojo Channel Page►►http://www.youtube.com/watchmojoFor this list, we've grouped together the very best YouTube travel vloggers out there.Special thanks to our user MsOlivia for submitting the idea using our interactive suggestion tool at http://www.WatchMojo.com/suggestWant a WatchMojo cup, mug, t-shirts, pen, sticker and even a water bottle?  Get them all when you order your MojoBox gift set here:http://watchmojo.com/store/WatchMojo is a leading producer of reference online video content, covering the People, Places and Trends you care about.We update DAILY with 4-5 Top 10 lists, Origins, Biographies, Versus clips on movies, video games, music, pop culture and more!\n",
      "\n",
      "Video-Title: Backpacking In Meghalaya | NorthEast India Trip | Sohra, Living Roots Bridge | Tanya Khanijow\n",
      "Video-ID: yvn79Rv0F48\n",
      "Video description: \n",
      "In this video I explored North East India, starting from Guwahati, Shillong, Cherrapunji (Sohra) and Double Decker Living Roots Bridge! It was a spontaneous Backpacking trip and amazing fun! Hope you enjoy the video. I upload new videos every Tuesday And Saturday. So subscribe to my channel and hit the bell Icon to stay notified! For all behind the scenes of my travels, you can follow me on instagram where I'm the most active with stories and image posts.  Editing software, Premiere Pro CC 2018▶ Check out my gear on Kit: https://kit.com/tanyakhanijowI'm very interactive on all social media, so let's talk? -● Instagram: https://www.instagram.com/tanyakhanijow/● Facebook: https://www.facebook.com/TanyaKhanijo...● Twitter: https://twitter.com/TanyaKhanijowThe equipment that I use - https://goo.gl/eEPmGKMusic - Only Us - Paperwhite Listen on Spotify here!http://bit.ly/pwonlyuswww.facebook.com/paperwhitemusicTwitter - @paperwhitemusicInstagram - @paperwhitemusicTitle: Ooh Boy (Future James Remix)Artist: Rose RoyceDownload: https://goo.gl/SkDVrr\n",
      "\n",
      "Video-Title: 200 Days - A Trip Around the World Travel Film\n",
      "Video-ID: RcmrbNRK-jY\n",
      "Video description: \n",
      "My wife and I traveled to 17 countries in 200 days. This film is the story of our incredible trip! Enjoy! We used a GoPro and a Nikon D7000 for all of the filming. For Business Inquiries please e.mail me at 40northdesigns@gmail.com. Website: 40northdesigns.comMusic Credits: Please check out and buy the music from these incredible artists that made this film possible. They are in order of appearance.M83 - Outro https://www.youtube.com/user/m83Eric Hutchinson - Tell the World https://www.youtube.com/user/erichutc...Vance Joy - Mess is Minehttps://www.youtube.com/user/vancejoy...Avicii - The Nightshttps://www.youtube.com/user/AviciiOf...The Kooks - Bad Habithttps://www.youtube.com/user/TheKooks...Yumi And The Weather - Must I Waithttps://www.youtube.com/user/YumiAndT...American Authors - Best Day of My Lifehttps://www.youtube.com/user/American...Tim McMorris - On Top of the Worldhttps://www.youtube.com/user/timmcmorrisThe Neighbourhood - Sweater Weatherhttps://www.youtube.com/user/TheNeigh...\n",
      "\n",
      "Video-Title: Top 10 MOST BEAUTIFUL Places in IRELAND | Essential Irish Travel Guide  🇮🇪\n",
      "Video-ID: u-UA8t2EVpA\n",
      "Video description: \n",
      "Traveling to Ireland or Northern Ireland?  From Dublin to Belfast and everything in between, these are the Top 10 Essential Things to Do on the island of Ireland. Alex and Marko the Vagabrothers guide you to the very best of the Emerald Isle.SUBSCRIBE  ► http://bit.ly/Vagabrothers ---Watch our FULL IRELAND VLOG SERIES:  http://bit.ly/2rajCaqWatch our FULL NORTHERN IRELAND SERIES: http://bit.ly/2rRNc1X---WHAT WE VLOG WITH : - BIG CAMERA ►https://bhpho.to/2gitki3 - LENS ► https://bhpho.to/2gKadhE- SNEAKY CAMERA ► https://bhpho.to/2gQ0kBW- MICROPHONE ► https://bhpho.to/2fQpW1X- DRONE ► http://amzn.to/1USOWQG- ACTION CAM ► https://bhpho.to/2gPXihd ---FOLLOW US: + INSTAGRAM  ►https://www.instagram.com/Vagabrothers+ FACEBOOK  ► https://www.facebook.com/Vagabrothers+ TWITTER  ► https://twitter.com/vagabrothers+ SNAPCHAT  ►@Vagabrothers---Personal Accounts:+ Alex  ► https://www.instagram.com/alexthevaga...+ Marko  ► https://www.instagram.com/markoayling ---MUSIC ►---Contribute to Vagabrothers #TranslationTeam: http://bit.ly/VBTranslationTeam---BOOK YOUR TRAVELS HERE: + Hotels: http://bit.ly/TripAdvisorHotelDeals + Flights: http://bit.ly/SkyScannerFlights+ Eurail Tickets: http://bit.ly/EurailPasses + Insurance: http://bit.ly/WorldNomadsInsurance---WHAT WE VLOG WITH : -- CAMERA: https://bhpho.to/2gitki3 - LENS: https://bhpho.to/2gKadhE- MICROPHONE:  https://bhpho.to/2fQpW1X- VLOG CAM: https://bhpho.to/2gQ0kBW- DRONE: http://amzn.to/1USOWQG- ACTION CAM: https://bhpho.to/2gPXihd - Suction Cup Thingy: https://bhpho.to/2gK6alk---HOW WE GET AROUND: Get your first free ride with Uber by using the code \"UberVagabrothersUE\" or clicking here: https://www.uber.com/invite/ubervagab...---P.S.  We love the Vagabuddies... Subscribe and join the squad!\n",
      "\n",
      "Video-Title: TRAVEL VLOG: SANTORINI, GREECE\n",
      "Video-ID: EthqIhPtd2I\n",
      "Video description: \n",
      "Thank you so much for watching! I hope you found travel and outfit inspiration for your next trip! Watch more of my travel videos here: https://www.youtube.com/playlist?list...SOCIAL LINKS:Twitter- https://twitter.com/tesschristineInstagram-http://instagram.com/tesschristinexoFacebook- https://www.facebook.com/Tess-Christi...Subscribe to my friends! https://www.youtube.com/user/missAlex...Outfits:1-Dress- Finders KeepersSunglasses- Princess Polly 2-Top- Forever 21Swimsuit- Fella Swim Shorts- Agolde Scarf- Mango 3-Dress- Reformation Backpack- Frye 4-Black top- Princess Polly Shorts- AgoldeShoes- Asos ----------------------------------------------Not Sponsored.\n",
      "\n",
      "Video-Title: 5 Steps to Becoming a Travel Blogger\n",
      "Video-ID: 7ByoBJYXU0k\n",
      "Video description: \n",
      "Travel blogger, Nikki Vargas, of The Pin the Map Project (voted top 100 travel blog in 2015) shares her best tips to getting started as a travel blogger and launching a travel site.This video is first in an upcoming series of \"Blog Tips\" videos explaining how to become a professional travel blogger! Subscribe to the YouTube channel and stay tuned for more videos! Share any topics you'd like to see covered below!\n",
      "\n",
      "Video-Title: EXPLORING VARANASI | Benaras Travel Vlog #1\n",
      "Video-ID: i5F7Xh9CO8U\n",
      "Video description: \n",
      "Spent an incredible week exploring the beautiful city of Varanasi, walking through the colourful gullies, relaxing by the rustic ghats and eating some amazing food, and here is part 1 of my Varanasi vlog!The walking tour we did (North Walk): https://www.roobaroowalks.com/walking...Please hit like if you enjoyed watching! 👍🏻Also, don't forget to subscribe to my channel and press the 🔔 button to be notified every time I post a new video! :)NEW VIDEOS EVERY WEEK!The Equipment I use for filming: https://kit.com/kritikagoel/kritika-s...Main vlogging camera: http://amzn.to/2fc119L Edited by me on Final Cut Pro X——LETS CHAT ON SOCIAL MEDIABlog : http://www.blogofthethings.com/ Instagram: https://www.instagram.com/blogoftheth...Facebook: https://www.facebook.com/blogofthethi...Twitter: https://twitter.com/blogofthethingsSnapchat: kritika_goel Business email: blogofthethings@gmail.com ——Songs Used:1. Stream Jai Wolf - Indian Summer (Kasbo Remix)http://smarturl.it/ksremixes2. Peaceful reflection by HookSounds http://www.hooksounds.com/Creative Commons — Attribution 4.0 International — CC BY 4.0https://creativecommons.org/licenses/...Music provided by Music for Creators https://youtu.be/AlFqm0ah5us3. Hip Hop Rap Instrumental (Crying Over You) by Chris Morrow 4 https://soundcloud.com/chris-morrow-3Creative Commons — Attribution 3.0 Unported— CC BY 3.0 http://creativecommons.org/licenses/b...Music provided by Audio Library https://youtu.be/g7KZAoj4YH04. Jalandhar by Kevin MacLeod is licensed under a Creative Commons Attribution license (https://creativecommons.org/licenses/...)Source: http://incompetech.com/music/royalty-...Artist: http://incompetech.com/——Equipment I use for filming: https://kit.com/kritikagoel/kritika-s...Sign up here to get one month free of Epidemic Sound music: http://share.epidemicsound.com/kritika——\n",
      "\n",
      "Video-Title: How to Start a Travel Blog [2019] Travel Blogging Full-Time\n",
      "Video-ID: kiNyRY5s7n8\n",
      "Video description: \n",
      "Create a Travel Blog Website for Just $3.95++ http://bit.ly/create-a-travel-blog-we...I've been a full-time blogger / travel vlogger for 9 years and transformed myself into a full-time travel blogger in the past 3 years. I will teach you how to create a website, build a brand and get you setup on the path to getting paid to travel. When I first started out in 2016, I didn't have a clue about how to take a decent photo and forget about shooting video. Today, I'm proud to say I'm halfway decent as a photographer and videographer and have racked up 800k followers on social and 1.5 million views on YouTube.// How Much Money Can You Make As a Travel Blogger?Since starting my travel influencer account, I've earned more than $200,000 from a combination of affiliate commission, paid sponsors, adsense and selling my own products. This is definitely a career that if you work hard and build yourself up, you can easily quit your job and live your dreams.// How to Make a Blog [2019] Focused on Travel BloggingMy advice for any new website is to use Wordpress. First of all, it's free, unlike SquareSpace which costs money to use and locks you into their hosting provider. With a Wordpress website, you can move it to any hosting provider (whether it be Bluehost or Hostgator when you first start out) or WPEngine when you really grow your blog and have a ton of traffic.// How to Start a Blog and Become a Full Time BloggerSetting up your first website should take no more than 15 minutes. Your steps are:Pick your domain nameSign up for your hosting planInstall WordpressInstall your themeStart bloggingSetup your blog here for just $3.95:++ http://bit.ly/create-a-travel-blog-we...// How to Write a Travel BlogThe really daunting task is shooting good photos and videos and telling stories as a travel blogger. I started out blogging not knowing a thing about how to shoot photos or videos but thanks to Youtube, I was able to teach myself everything I needed to learn. I suggest you do the same thing, start searching on YouTube and teach yourself.In this video, I walk you through exactly what my steps are to starting and making money with your own travel blog.I’ve tried almost every possible Monetization strategy and these are my proven methods that work for me:Affiliate marketing where you get paid a commission for selling somethingPaid advertisements like Crest paying me to review their white stripsAdsense revenue which I get from people watching this video and clicking on ads on my websiteFreelancing: taking photos, building websites or providing consulting to small businessesSelling a product: I have a style guide I created last year and it sells a couple of copies every month// my proven techniques as a full time travel blogger// find your speciality- I’ve been blogging full time for 9 years and have taught myself how to code and build sites from scratch. I’ve built websites with 12 million visitors per year, sites with just 50k visitors per month that made $50k in a month and have gone through a ton of website issues and total data losses and this expertise and experience is why I focus on teaching people how to make a website and to me the best place to start is where I started, with bluehost for just $3.95- Now you could copy my strategy, but building up your own credibility and experience will take awhile, plus you’d have to beat me at it :)- So instead, I’d suggest you focus on a product or service where you already have expertise or can build your expertise around- Say you want to be a travel blogger, what’s one thing you’ll bring on every trip that everyone needs? A great bag. Imagine you took a different bag on every trip and reviewed it as part of the vlog. I guarantee you’d be one of the few experts reviewing just bags and you’d be able to corner the market. And when you do your videos, it would be really hard for someone like me or anyone else to copy your knowledge base and expertise- Besides travel bags you could also focus on bug spray, sunscreen, backup batteries, etc find something you’re interested in and own it// This will be hard, but follow these tips to ensure you succeedIf you need any help creating your website and starting your travel vlog, let me know in the comments, I reply to every single one.// FOLLOW US: IG: https://www.instagram.com/lifetailored/Wei's IG: https://www.instagram.com/threadtherapy/Couple's IG: https://www.instagram.com/meetthewises/Web: https://lifetailored.com/// Best Vlogging Kit for BeginnersBest Starter Vlogging Camera: Canon 60D: https://fave.co/2wpomKJBest Vlogging Lens: Canon 10-22mm 3.5: https://fave.co/2MDQ807High-End 4K Camera for Photo/Video: Canon 5D Mark IV: https://fave.co/2vaPUTvHigh-End Zoom Lens for Photo/Video/B-roll: Canon 24m-70mm 2.8 II: https://fave.co/2AyMHSD\n",
      "\n",
      "Video-Title: Trip to North East India with YouTubers! | Sejal Kumar\n",
      "Video-ID: cM2rm0-QQPY\n",
      "Video description: \n",
      "Hey guys!! Welcome to the Monday Vlog!! This trip to Cherrapunji and Shillong in North East India was one of the best trips I have had so far! The beautiful place and amazing company made it so much fun! We reached  got to Guwahati by flight and went to the other cities by our mini bus! Comment below where you want to travel!NEW VIDEOS EVERY WEEK!JOIN THE JOURNEY TO 500K SUBSCRIBERS!Talk to me! Twitter & Instagram: @sejalkumar1195Facebook : www.facebook.com/TheClothingEditWhere we stayed: Hotel Polo Orchid My Outfits:Day 1: White top: H&MJeans and Plaid tee: ZaraDay 2: Red back less dress: http://bit.ly/2sGqWruTrekking romper: http://bit.ly/2rVcyiADay 3:  Black Top: Stalk Buy LoveBlack and Orange skirt and necklace: Nature BazaarKaraoke night: Sweater and Shorts: ZaraShoes: White Sneakers: Street Style StoreSilver flats: H&MEquipment:Sony A7 mark iiGoPro Hero 5 BlackEdited on Final Cut ProXThanks for watching!\n",
      "\n",
      "Video-Title: Top 10 Travel bloggers in India\n",
      "Video-ID: HX_pbYuBQ3Y\n",
      "Video description: \n",
      "Seeing new places, meeting different people, trying some tasty dishes will definitely make you feel like living in an alternate world.Here are the top 10 travel bloggers in India\"Sorry to say. There is a mistake in the video. The blog for Lakshmi Sharath is lakshmisharath.com (0.43)\"-----------------------------------------------------ABOUT CHAIPEDIAChaipedia is a platform to discuss and participate with a cup of chaiFOR MORE INTERESTING ARTICLES AND BLOGS VISIT: http://chaipedia.in/\"YOU WILL LOVE IT”WANT MORE FROM CHAIPEDIAWE ARE READY TO BE FOLLOWEDTWITTER     :  https://twitter.com/PediaChaiFACEBOOK    : https://www.facebook.com/Chaipedia.yo...INSTAGRAM :  https://www.instagram.com/chai_pedia------------------------------------------------------------------------------------Get your travelling gadgets from here.Travelling Bag https://www.amazon.in/s/ref=as_li_ss_....Camerahttps://www.amazon.in/s/ref=as_li_ss_....Shoeshttps://www.amazon.in/s/ref=as_li_ss_...\n",
      "\n",
      "Video-Title: GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL OUTFIT IDEAS\n",
      "Video-ID: -LzdIILq5vE\n",
      "Video description: \n",
      "Hope you enjoy MY GOA TRAVEL DIARY this video!Don't forget to subscribe and like this videoThank you for your support, love you guys! BLOG: http://thatbohogirl.com/INSTAGRAM: https://www.instagram.com/thatbohogirl/TWITTER: https://twitter.com/kritikakhuranaSNAPCHAT: That_BohoGirlFor business inquiresKritika.thatbohogirl@gmail.com\n",
      "\n",
      "Video-Title: How I Make Money and Travel the World\n",
      "Video-ID: 4OH6-fxBsQA\n",
      "Video description: \n",
      "Read the full description of how I make money and travel the world, including more resources and info at http://tourist2townie.com/make-money/...HELPFUL LINKS:Learn How to Start a Travel Blog - http://bit.ly/HowtoTravelBlogSuperstar Blogging Course - http://bit.ly/SuperStarBloggingHow a Travel Photographer Makes Money - https://youtu.be/QY__L7E7jhoHow a Travel Blogger Makes Money - https://expertvagabond.com/paid-to-tr...http://www.ytravelblog.com/how-to-mak...I have been traveling the world full-time for the past seven years, and have paid for it all through travel blogging and travel videography. The number one question I receive across social media, the blog and video comments is \"how do you make money from travel?\"In this video I explain the 8 ways that I currently make money from travel blogging, videography and marketing consulting in order to keep this dream alive!If you like the video, please subscribe this channel, give it a thumbs up, leave a comment and hit that notifications button to receive updates on my next video! FOLLOW ON SOCIAL: Instagram - http://www.instagram.com/tourist2townieFacebook - http://www.facebook.com/tourist2townieTwitter - http://www.twitter.com/tourist2townie\n",
      "\n",
      "Video-Title: Welcome to Peru! | Best Essential Tips & Travel Guide\n",
      "Video-ID: SL_YBLWdZb8\n",
      "Video description: \n",
      "Welcome to Peru! This essential travel guide will show you the best essential tips for Peru, one of Latin America's incredible countries. From Lima to Cuzco and Machu Picchu, this is the essential Peru travel guide! SUBSCRIBE  ► http://bit.ly/VagabrothersAdditional Cinematography by the talented Carlos Mason  https://www.instagram.com/carlosmason---WHAT WE VLOG WITH : - OUR FILM MAKING KIT ►  https://kit.com/Vagabrothers---FOLLOW US: + INSTAGRAM  ►https://www.instagram.com/Vagabrothers+ FACEBOOK  ► https://www.facebook.com/Vagabrothers+ TWITTER  ► https://twitter.com/vagabrothers+ SNAPCHAT  ►@Vagabrothers---Personal Accounts:+ Alex  ► YT: https://www.youtube.com/alexthevagabondIG: https://www.instagram.com/alexthevaga...+ Marko  ► YT: https://www.youtube.com/channel/UC9Ws...IG: https://www.instagram.com/markoayling ---Contribute to Vagabrothers #TranslationTeam: http://bit.ly/VBTranslationTeam---SEND US STUFF:2633 Lincoln Blvd #921 Santa Monica, CA 90405---BOOK YOUR TRAVELS HERE: + Hotels: http://bit.ly/TripAdvisorHotelDeals + Flights: http://bit.ly/SkyScannerFlights+ Eurail Tickets: http://bit.ly/EurailPasses + Insurance: http://bit.ly/WorldNomadsInsurance---HOW WE GET AROUND: Get your first free ride with Uber by using the code \"UberVagabrothersUE\" or clicking here: https://www.uber.com/invite/ubervagab...---P.S.  We love the Vagabuddies... Subscribe and join the squad!\n",
      "\n",
      "Video-Title: Travel Vlog: Venice, An Italian Love Affair | HAUSOFCOLOR\n",
      "Video-ID: hXVR4l56vZ0\n",
      "Video description: \n",
      "I made my way to The Floating City of Venice last summer and it was one of the most beautiful places I've ever seen! A city full of romance and serenity, great food, and built on water. It was an amazing experience and I hope you guys enjoyed this little adventure with me! The video is a bit lengthy, but you guys requested longer travel vlogs, so I hope this was sufficient! I love you and thanks so much for watching!  xx►Also watch these videos:• 9 Days in China: http://goo.gl/ebjmWc • Postcards From Greece: http://goo.gl/jTK1Tk• Journey To The Far East Thailand: http://goo.gl/j5jYWA • Hello Vietnam: http://goo.gl/OrA5MS• Meet Me in Morocco: https://goo.gl/3RB86N________________________________________►my socials:INSTAGRAM: http://instagram.com/hausofcolorFACEBOOK: http://www.facebook.com/hausofcolorBLOG: http://www.hausofcolorblog.comTWITTER: http://www.twitter.com/ellevSNAPCHAT: @HAUSOFCOLOR**MUSIC WANTED: If you are a producer & would like for me to use your music, please email me at: myhausofcolor@gmail.com(music agencies used for this video)• www.jinglepunks.com• www.opus1source.comCamera: • (travel/vlogs): Canon S110: http://rstyle.me/n/u2quz444e• (everything else): Canon 70D: http://rstyle.me/n/vbg6d444eEditing: Final Cut Pro XProduced by: HAUSOFCOLOR________________________________________business inquiries: myhausofcolor@gmail.com\n",
      "\n",
      "Video-Title: SIARGAO, PHILIPPINES TRAVEL GUIDE (budget & itinerary)\n",
      "Video-ID: eRFqZ3yhwDA\n",
      "Video description: \n",
      "Back at the Surfing Capital of the Philippines, Siargao! Spent 10 days on the island exploring different spots so here's the ultimate Siargao travel guide for you guys! I hope you make time to volunteer with sea movement when you visit the island and help at the beach clean up happening every Saturdays :) PLEASE BE A RESPONSIBLE TRAVELER AND HELP PROTECT THE CLEANLINESS OF EVERY PLACE THAT YOU VISIT. Comment, like, and subscribe!INSTAGRAM: @avelovinSNAPCHAT & TWITTER: @avelovinitSiargao travel vlog: https://www.youtube.com/watch?v=KT_dH...\n",
      "\n",
      "Video-Title: Top 10 Travel Vloggers\n",
      "Video-ID: v6eh9zOqDnQ\n",
      "Video description: \n",
      "Top 10 Travel Vloggers Subscribe: http://bit.ly/MojoTravels You haven’t seen the world until you’ve experienced it through the eyes of these people. Welcome to MojoTravels and today we’ll be counting down our picks for the Top 10 Best Travel Vloggers.For this list, we’re taking a look at YouTubers who travel the globe, making us all want to get off the couch and satisfy our wanderlust.10: Sailing La Vagabondehttps://www.youtube.com/channel/UCZdQ...9: Mark Wienshttps://www.youtube.com/user/migratio...8: Kristen & Siyahttps://www.youtube.com/user/hopscotc...7: Samuel & Audreyhttps://www.youtube.com/user/Backpack...6: Mr Ben Brownhttps://www.youtube.com/user/benbrown1005: Expert Vagabondhttps://www.youtube.com/user/ExpertVa...4: Gone with the Wynnshttps://www.youtube.com/user/gonewith...3, 2, 1 . . . ??#Travel # Vlogger #TravelVloggers\n",
      "\n",
      "Video-Title: HOW TO TRAVEL THE PHILIPPINES\n",
      "Video-ID: g-7RK9cmXis\n",
      "Video description: \n",
      "THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVELED! You simply must put the Philippines on your bucket list. The most beautiful landscapes and the most incredible people.All Philippines Vlogs in the order they occured:https://www.youtube.com/playlist?list...If you're coming to the Philippines, I have made a complete video guide for you! https://lostleblanc.myshopify.com/col...Join Team Get Lost and Subscribe!Instagram LostLeBlancFacebook Lost LeBlancSnapChat  LostLeBlancTwitter LostLeBlanc--------------------------------------My Essential Equipment:GoPro Hero 4 Silver (vlogging camera) http://amzn.to/2a3UqIU--------------------------------------\n",
      "\n",
      "Video-Title: TRAVELLING ALONE AS A 15 YEAR OLD IN INDIA! | DELHI | Mallika Vlogs\n",
      "Video-ID: fxnQ6cWmvQU\n",
      "Video description: \n",
      "Hey Internet!Thank you for watching this video. Like, comment & subscribe!What do i use to film?Canon EOS 600 D -https://amzn.to/2rY6N10Lights -Meike FC-100 Macro Ring Flash/Light for Canon - https://amzn.to/2Iu9VwMiPhone 6 - https://amzn.to/2k8R1NxGorilla Pod- https://amzn.to/2k8mK1hTripod- https://amzn.to/2Iy0dpnProducts I use-Shampoo- https://amzn.to/2KBUcZcHair serum- https://amzn.to/2k8RJKHTell me how i can improve in the comment section below!Twitterhttps://twitter.com/yessmallikaInstagramhttps://instagram.com/yesmallikaFacebookhttps://www.facebook.com/mallix.offic...Add me on Snapchat@mallix_officialCopyright Disclaimer Under Section 107 of the Copyright Act 1976, allowance is made for \"fair use\" for purposes such as criticism, comment, news reporting, teaching, scholarship, and research. Fair use is a use permitted by copyright statute that might otherwise be infringing. Non-profit, educational or personal use tips the balance in favor of fair use.If you see this give this video a big thumbs up or comment PANDA\n",
      "\n"
     ]
    }
   ],
   "source": [
    "links = URLsoup.find_all (\"a\", class_=\"yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2 yt-uix-sessionlink spf-link \")\n",
    "\n",
    "# temporary link for making request to video's site\n",
    "templink = yt_link\n",
    "\n",
    "for link in links:\n",
    "    print (\"Video-Title: \" + link.text)\n",
    "    print (\"Video-ID: \" + link[\"href\"].split(\"=\")[1])\n",
    "    \n",
    "    ytid.append (link[\"href\"].split(\"=\")[1])\n",
    "    yttitle.append (link.text)\n",
    "    \n",
    "    # creating link to a video\n",
    "    templink += link[\"href\"]\n",
    "    \n",
    "    # making request to that video's poge\n",
    "    tempreq = requests.get (templink)\n",
    "    tempsoup = bs (tempreq.text, \"lxml\")\n",
    "    \n",
    "    # scraping full video description\n",
    "    print (\"Video description: \")\n",
    "    print (tempsoup.find (\"p\", id=\"eow-description\").text)\n",
    "    \n",
    "    ytdes.append (tempsoup.find (\"p\", id=\"eow-description\").text)\n",
    "    ytcat.append (\"travel\")\n",
    "    print ()\n",
    "\n",
    "    # sleeping the thread to NOT get flagged by YouTube (making request in inhuman times same as DDoS attack)\n",
    "    sleep (2)\n",
    "    templink = yt_link"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Video ID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Description</th>\n",
       "      <th>Category</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>i9E_Blai8vk</td>\n",
       "      <td>TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE</td>\n",
       "      <td>I had the chance to fly out to Bali with my wh...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>e2NQE41J5eM</td>\n",
       "      <td>How do I travel so much ! How do I earn money!!</td>\n",
       "      <td>SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTr...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>942sCY6d7kU</td>\n",
       "      <td>Top 10 YouTube Travellers</td>\n",
       "      <td>Hello, and welcome to TopX, where we count dow...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>yvn79Rv0F48</td>\n",
       "      <td>Backpacking In Meghalaya | NorthEast India Tri...</td>\n",
       "      <td>In this video I explored North East India, sta...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>RcmrbNRK-jY</td>\n",
       "      <td>200 Days - A Trip Around the World Travel Film</td>\n",
       "      <td>My wife and I traveled to 17 countries in 200 ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>u-UA8t2EVpA</td>\n",
       "      <td>Top 10 MOST BEAUTIFUL Places in IRELAND | Esse...</td>\n",
       "      <td>Traveling to Ireland or Northern Ireland?  Fro...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>EthqIhPtd2I</td>\n",
       "      <td>TRAVEL VLOG: SANTORINI, GREECE</td>\n",
       "      <td>Thank you so much for watching! I hope you fou...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>7ByoBJYXU0k</td>\n",
       "      <td>5 Steps to Becoming a Travel Blogger</td>\n",
       "      <td>Travel blogger, Nikki Vargas, of The Pin the M...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>i5F7Xh9CO8U</td>\n",
       "      <td>EXPLORING VARANASI | Benaras Travel Vlog #1</td>\n",
       "      <td>Spent an incredible week exploring the beautif...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>kiNyRY5s7n8</td>\n",
       "      <td>How to Start a Travel Blog [2019] Travel Blogg...</td>\n",
       "      <td>Create a Travel Blog Website for Just $3.95++ ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>cM2rm0-QQPY</td>\n",
       "      <td>Trip to North East India with YouTubers! | Sej...</td>\n",
       "      <td>Hey guys!! Welcome to the Monday Vlog!! This t...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>HX_pbYuBQ3Y</td>\n",
       "      <td>Top 10 Travel bloggers in India</td>\n",
       "      <td>Seeing new places, meeting different people, t...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>-LzdIILq5vE</td>\n",
       "      <td>GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL O...</td>\n",
       "      <td>Hope you enjoy MY GOA TRAVEL DIARY this video!...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>4OH6-fxBsQA</td>\n",
       "      <td>How I Make Money and Travel the World</td>\n",
       "      <td>Read the full description of how I make money ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>SL_YBLWdZb8</td>\n",
       "      <td>Welcome to Peru! | Best Essential Tips &amp; Trave...</td>\n",
       "      <td>Welcome to Peru! This essential travel guide w...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>hXVR4l56vZ0</td>\n",
       "      <td>Travel Vlog: Venice, An Italian Love Affair | ...</td>\n",
       "      <td>I made my way to The Floating City of Venice l...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>eRFqZ3yhwDA</td>\n",
       "      <td>SIARGAO, PHILIPPINES TRAVEL GUIDE (budget &amp; it...</td>\n",
       "      <td>Back at the Surfing Capital of the Philippines...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>v6eh9zOqDnQ</td>\n",
       "      <td>Top 10 Travel Vloggers</td>\n",
       "      <td>Top 10 Travel Vloggers Subscribe: http://bit.l...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>g-7RK9cmXis</td>\n",
       "      <td>HOW TO TRAVEL THE PHILIPPINES</td>\n",
       "      <td>THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVE...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>fxnQ6cWmvQU</td>\n",
       "      <td>TRAVELLING ALONE AS A 15 YEAR OLD IN INDIA! | ...</td>\n",
       "      <td>Hey Internet!Thank you for watching this video...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       Video ID                                              Title  \\\n",
       "0   i9E_Blai8vk      TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE   \n",
       "1   e2NQE41J5eM    How do I travel so much ! How do I earn money!!   \n",
       "2   942sCY6d7kU                          Top 10 YouTube Travellers   \n",
       "3   yvn79Rv0F48  Backpacking In Meghalaya | NorthEast India Tri...   \n",
       "4   RcmrbNRK-jY     200 Days - A Trip Around the World Travel Film   \n",
       "5   u-UA8t2EVpA  Top 10 MOST BEAUTIFUL Places in IRELAND | Esse...   \n",
       "6   EthqIhPtd2I                     TRAVEL VLOG: SANTORINI, GREECE   \n",
       "7   7ByoBJYXU0k               5 Steps to Becoming a Travel Blogger   \n",
       "8   i5F7Xh9CO8U        EXPLORING VARANASI | Benaras Travel Vlog #1   \n",
       "9   kiNyRY5s7n8  How to Start a Travel Blog [2019] Travel Blogg...   \n",
       "10  cM2rm0-QQPY  Trip to North East India with YouTubers! | Sej...   \n",
       "11  HX_pbYuBQ3Y                    Top 10 Travel bloggers in India   \n",
       "12  -LzdIILq5vE  GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL O...   \n",
       "13  4OH6-fxBsQA              How I Make Money and Travel the World   \n",
       "14  SL_YBLWdZb8  Welcome to Peru! | Best Essential Tips & Trave...   \n",
       "15  hXVR4l56vZ0  Travel Vlog: Venice, An Italian Love Affair | ...   \n",
       "16  eRFqZ3yhwDA  SIARGAO, PHILIPPINES TRAVEL GUIDE (budget & it...   \n",
       "17  v6eh9zOqDnQ                             Top 10 Travel Vloggers   \n",
       "18  g-7RK9cmXis                      HOW TO TRAVEL THE PHILIPPINES   \n",
       "19  fxnQ6cWmvQU  TRAVELLING ALONE AS A 15 YEAR OLD IN INDIA! | ...   \n",
       "\n",
       "                                          Description Category  \n",
       "0   I had the chance to fly out to Bali with my wh...   travel  \n",
       "1   SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTr...   travel  \n",
       "2   Hello, and welcome to TopX, where we count dow...   travel  \n",
       "3   In this video I explored North East India, sta...   travel  \n",
       "4   My wife and I traveled to 17 countries in 200 ...   travel  \n",
       "5   Traveling to Ireland or Northern Ireland?  Fro...   travel  \n",
       "6   Thank you so much for watching! I hope you fou...   travel  \n",
       "7   Travel blogger, Nikki Vargas, of The Pin the M...   travel  \n",
       "8   Spent an incredible week exploring the beautif...   travel  \n",
       "9   Create a Travel Blog Website for Just $3.95++ ...   travel  \n",
       "10  Hey guys!! Welcome to the Monday Vlog!! This t...   travel  \n",
       "11  Seeing new places, meeting different people, t...   travel  \n",
       "12  Hope you enjoy MY GOA TRAVEL DIARY this video!...   travel  \n",
       "13  Read the full description of how I make money ...   travel  \n",
       "14  Welcome to Peru! This essential travel guide w...   travel  \n",
       "15  I made my way to The Floating City of Venice l...   travel  \n",
       "16  Back at the Surfing Capital of the Philippines...   travel  \n",
       "17  Top 10 Travel Vloggers Subscribe: http://bit.l...   travel  \n",
       "18  THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVE...   travel  \n",
       "19  Hey Internet!Thank you for watching this video...   travel  "
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "YTDf = pd.DataFrame (ytid, columns=[\"Video ID\"])\n",
    "YTDf[\"Title\"] = yttitle\n",
    "YTDf[\"Description\"] = ytdes\n",
    "YTDf[\"Category\"] = ytcat\n",
    "YTDf"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Test code\n",
    "\n",
    "**NOTE**: Above code being used to test out stuff required.\n",
    "\n",
    "Below code doesn't work properly. Request being sent to the wrong site. Results getting repeated."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "for category in categories:\n",
    "    \n",
    "    link = yt_link + searchstr + category + only_vids\n",
    "    \n",
    "    links = URLsoup.find_all (\"a\", class_=\"yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2 yt-uix-sessionlink spf-link \")\n",
    "\n",
    "    templink = yt_link\n",
    "    \n",
    "    count = 0\n",
    "    \n",
    "    while (count < 300):\n",
    "        \n",
    "        for link in links:\n",
    "            try:\n",
    "            \n",
    "                print (\"Video-Title: \" + link.text)\n",
    "                print (\"Video-ID: \" + link[\"href\"].split(\"=\")[1])\n",
    "        \n",
    "                ytid.append (link[\"href\"].split(\"=\")[1])\n",
    "                yttitle.append (link.text)\n",
    "        \n",
    "                templink += link[\"href\"]\n",
    "                tempreq = requests.get (templink)\n",
    "                tempsoup = bs (tempreq.text, \"lxml\")\n",
    "        \n",
    "                print (\"Video description: \")\n",
    "                print (tempsoup.find (\"p\", id=\"eow-description\").text)\n",
    "        \n",
    "                ytdes.append (tempsoup.find (\"p\", id=\"eow-description\").text)\n",
    "            \n",
    "            except Exception as e:\n",
    "                ytdes.append (\"\")\n",
    "                ytcat.append (category.split (\"+\")[0])\n",
    "            \n",
    "            print ()\n",
    "        \n",
    "            sleep (5)\n",
    "            templink = yt_link\n",
    "            count += 1\n",
    "            "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Final code:\n",
    "\n",
    "*(which works)*"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://www.youtube.com/results?search_query=travel+blog&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=science+and+technology&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=food&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=manufacturing&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=history&sp=EgIQAQ%253D%253D\n",
      "https://www.youtube.com/results?search_query=art+and+music&sp=EgIQAQ%253D%253D\n"
     ]
    }
   ],
   "source": [
    "yt_link = \"https://www.youtube.com\"\n",
    "categories = [\"travel+blog\", \"science+and+technology\", \"food\", \"manufacturing\", \"history\", \"art+and+music\"]\n",
    "searchstr = \"/results?search_query=\"\n",
    "only_vids = \"&sp=EgIQAQ%253D%253D\"\n",
    "\n",
    "for category in categories:\n",
    "    print (yt_link + searchstr + category + only_vids)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [],
   "source": [
    "# creating empty lists to fill details in\n",
    "\n",
    "vidID = []\n",
    "vidTitle = []\n",
    "vidDescription = []\n",
    "vidCateogry = []"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "travel done.\n",
      "science done.\n",
      "food done.\n",
      "manufacturing done.\n",
      "history done.\n",
      "art done.\n",
      "Done all categories.\n"
     ]
    }
   ],
   "source": [
    "for category in categories:\n",
    "    \n",
    "    # link of category\n",
    "    link = yt_link + searchstr + category + only_vids\n",
    "\n",
    "    # first request\n",
    "    req =  requests.get (link)\n",
    "\n",
    "    # first soup\n",
    "    soup = bs (req.text, \"lxml\")\n",
    "\n",
    "    # finding all links in first page\n",
    "    links = soup.find_all (\"a\", class_=\"yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2 yt-uix-sessionlink spf-link \")\n",
    "\n",
    "    # setting count to 0 to get required results\n",
    "    count = 0\n",
    "\n",
    "    while (count < 400):\n",
    "        \n",
    "        # temporary link to get description\n",
    "        templink = yt_link\n",
    "    \n",
    "        # iteratiing over the links\n",
    "        for link in links:\n",
    "        \n",
    "            # description might be empty so putting code in try-except block\n",
    "            try:\n",
    "                # appending video ID\n",
    "                vidID.append (link[\"href\"].split(\"=\")[1])\n",
    "                # appending video Title\n",
    "                vidTitle.append (link.text)\n",
    "                # print (str (count) + \". \" + link.text)\n",
    "            \n",
    "                # getting temporary link to make a request to get video description\n",
    "                templink += link[\"href\"]\n",
    "            \n",
    "                # making request and soupifying\n",
    "                tempreq = requests.get (templink)\n",
    "                sleep (2.5)\n",
    "                tempsoup = bs (tempreq.text, \"lxml\")\n",
    "            \n",
    "                # appending video Description\n",
    "                vidDescription.append (tempsoup.find (\"p\", id=\"eow-description\").text)\n",
    "            \n",
    "            except Exception as e:\n",
    "                \n",
    "                vidDescription.append (\"\")\n",
    "            \n",
    "            # appending video Category\n",
    "            vidCateogry.append (category.split (\"+\")[0])\n",
    "            templink = yt_link\n",
    "            count += 1        \n",
    "    \n",
    "        # finding pagination buttons\n",
    "        buttons = soup.find_all (\"a\", class_=\"yt-uix-button vve-check yt-uix-sessionlink yt-uix-button-default yt-uix-button-size-default\")\n",
    "    \n",
    "        # finding Next button\n",
    "        next_button = buttons[-1][\"href\"]\n",
    "        next_button = \"https://www.youtube.com\" + str(next_button)\n",
    "    \n",
    "        # making request on the Next button\n",
    "        nextreq = requests.get (next_button)\n",
    "    \n",
    "        nextsoup = bs (nextreq.text, \"lxml\")\n",
    "    \n",
    "        # new list of links\n",
    "        links = nextsoup.find_all (\"a\", class_=\"yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2 yt-uix-sessionlink spf-link \")\n",
    "        # setting soup as nextsoup to find next page's pagination buttton\n",
    "        soup = nextsoup\n",
    "    \n",
    "    # done message for each category\n",
    "    print (category.split (\"+\")[0] + \" done.\")\n",
    "\n",
    "print (\"Done all categories.\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unique count = 2111\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Video ID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Description</th>\n",
       "      <th>Category</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>e2NQE41J5eM</td>\n",
       "      <td>How do I travel so much ! How do I earn money!!</td>\n",
       "      <td>SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTr...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>i9E_Blai8vk</td>\n",
       "      <td>TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE</td>\n",
       "      <td>I had the chance to fly out to Bali with my wh...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>-LzdIILq5vE</td>\n",
       "      <td>GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL O...</td>\n",
       "      <td>Hope you enjoy MY GOA TRAVEL DIARY this video!...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>7ByoBJYXU0k</td>\n",
       "      <td>5 Steps to Becoming a Travel Blogger</td>\n",
       "      <td>Travel blogger, Nikki Vargas, of The Pin the M...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>7mIzRYh8jGA</td>\n",
       "      <td>What is it like to travel in PAKISTAN?</td>\n",
       "      <td>Subscribe now: https://goo.gl/6zXZGKWatch the ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>EthqIhPtd2I</td>\n",
       "      <td>TRAVEL VLOG: SANTORINI, GREECE</td>\n",
       "      <td>Thank you so much for watching! I hope you fou...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>g-7RK9cmXis</td>\n",
       "      <td>HOW TO TRAVEL THE PHILIPPINES</td>\n",
       "      <td>THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVE...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>SL_YBLWdZb8</td>\n",
       "      <td>Welcome to Peru! | Best Essential Tips &amp; Trave...</td>\n",
       "      <td>Welcome to Peru! This essential travel guide w...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>ZR7Z74UY2TY</td>\n",
       "      <td>VAN LIFE | A Day in The Life | MEXICO</td>\n",
       "      <td>We have been traveling in our van in Mexico fo...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>RcmrbNRK-jY</td>\n",
       "      <td>200 Days - A Trip Around the World Travel Film</td>\n",
       "      <td>My wife and I traveled to 17 countries in 200 ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>MGhjvist4gk</td>\n",
       "      <td>How To Make a TRAVEL VIDEO - 10 Tips you need ...</td>\n",
       "      <td>With your trip just ahead, it's time to learn ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>kiNyRY5s7n8</td>\n",
       "      <td>How to Start a Travel Blog [2019] Full-Time Tr...</td>\n",
       "      <td>Create a Travel Blog Website for Just $3.95++ ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>41ssBujAS0U</td>\n",
       "      <td>Thailand Vlog</td>\n",
       "      <td>Make sure to give my video a thumbsups and com...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>4OH6-fxBsQA</td>\n",
       "      <td>How I Make Money and Travel the World</td>\n",
       "      <td>Read the full description of how I make money ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Rbn0cxbl28M</td>\n",
       "      <td>You Won't Believe This is India... 2!</td>\n",
       "      <td>Did you know India has the most beautiful whit...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>U1llp-h7wcw</td>\n",
       "      <td>Thailand Full Moon Party Tips - Koh Phangan | ...</td>\n",
       "      <td>I went to Koh Phangan this year just for the f...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>hXVR4l56vZ0</td>\n",
       "      <td>Travel Vlog: Venice, An Italian Love Affair | ...</td>\n",
       "      <td>I made my way to The Floating City of Venice l...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Siw4ehlUMsE</td>\n",
       "      <td>Celebrating Holi in india Rishikesh  Haridwar ...</td>\n",
       "      <td>Holi, the festival of color and love, also sig...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>942sCY6d7kU</td>\n",
       "      <td>Top 10 YouTube Travellers</td>\n",
       "      <td>Hello, and welcome to TopX, where we count dow...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>NmyvSWq7l2E</td>\n",
       "      <td>MALDIVES TRAVEL VLOG 🏝 COCO LILI</td>\n",
       "      <td>🧡INSTAGRAM: https://www.instagram.com/cocolili...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>F0AT_7uVbeo</td>\n",
       "      <td>Japan Travel Guide - How to travel Japan</td>\n",
       "      <td>Welcome to my Japan travel guide for first-tim...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Siw4ehlUMsE</td>\n",
       "      <td>Celebrating Holi in india Rishikesh  Haridwar ...</td>\n",
       "      <td>Holi, the festival of color and love, also sig...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>rlCVwA2A5UA</td>\n",
       "      <td>Beautiful Thailand by Travel Blogger @joaocajuda</td>\n",
       "      <td>Follow me for more videos:Facebook: http://www...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>U1llp-h7wcw</td>\n",
       "      <td>Thailand Full Moon Party Tips - Koh Phangan | ...</td>\n",
       "      <td>I went to Koh Phangan this year just for the f...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>41ssBujAS0U</td>\n",
       "      <td>Thailand Vlog</td>\n",
       "      <td>Make sure to give my video a thumbsups and com...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>tKXrpRrj7Ow</td>\n",
       "      <td>A WEEK IN PARIS | travel vlog</td>\n",
       "      <td>Come along on a week in Paris with me! I meant...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>kYrpoSgHkTI</td>\n",
       "      <td>I GET PAID TO TRAVEL THE WORLD - HOW I BECAME ...</td>\n",
       "      <td>This is probably my most requested video of al...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>NmyvSWq7l2E</td>\n",
       "      <td>MALDIVES TRAVEL VLOG 🏝 COCO LILI</td>\n",
       "      <td>🧡INSTAGRAM: https://www.instagram.com/cocolili...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>ltHTDqVTqN0</td>\n",
       "      <td>Exploring Bangkok, Thailand in 4 Days!</td>\n",
       "      <td>4-days of fun and exciting experiences, foodie...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>MGhjvist4gk</td>\n",
       "      <td>How To Make a TRAVEL VIDEO - 10 Tips you need ...</td>\n",
       "      <td>With your trip just ahead, it's time to learn ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2370</th>\n",
       "      <td>DnnTcjw3upg</td>\n",
       "      <td>Abstract Expressionist Art and Music</td>\n",
       "      <td>Abstract Expressionist Art Video with Music</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2371</th>\n",
       "      <td>zw2EQ1Gz1SI</td>\n",
       "      <td>Art and Music</td>\n",
       "      <td>Provided to YouTube by Believe SASArt and Musi...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2372</th>\n",
       "      <td>tsMN29C_9RA</td>\n",
       "      <td>Art &amp; Culture Mexico | Traditional Music from ...</td>\n",
       "      <td>Today, we speak about typical melodies from th...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2373</th>\n",
       "      <td>Jajicmx2pCU</td>\n",
       "      <td>Cosey Fanni Tutti on how she wrote Art Sex Mus...</td>\n",
       "      <td>Founder of industrial music pioneers Throbbing...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2374</th>\n",
       "      <td>gwDkvazf6CQ</td>\n",
       "      <td>Art and Music of Shawn Ealy</td>\n",
       "      <td>Music and art of Shawn Ealy</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2375</th>\n",
       "      <td>TPRdqYNe9pM</td>\n",
       "      <td>Dead Cities 001 - Floorplans for Dead Cities -...</td>\n",
       "      <td>In this 4 minute software improvisation I use ...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2376</th>\n",
       "      <td>xTOxp1bEiDw</td>\n",
       "      <td>Samsung Galaxy S8: How to Add Music Album Cove...</td>\n",
       "      <td>Learn how you can add music album cover art im...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2377</th>\n",
       "      <td>-zODGev1l4k</td>\n",
       "      <td>Art and Music: Desenhando Goku Super Saiyan De...</td>\n",
       "      <td>•Gostou e quer ajudar ? Like e Favorito já aju...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2378</th>\n",
       "      <td>opCtBc8aKMM</td>\n",
       "      <td>DRIP : Performance Art with Dance, Music, Visu...</td>\n",
       "      <td>Performance art entertainment that combines pe...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2379</th>\n",
       "      <td>WSez3Ruwa_g</td>\n",
       "      <td>How Do You Music: Special MIDI ART Edition!!!!!!!</td>\n",
       "      <td>help support these tutorials at: https://www.p...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2380</th>\n",
       "      <td>rpgBNzzCvbE</td>\n",
       "      <td>Shri Mataji about Music Dance Art (Canberra 19...</td>\n",
       "      <td>HH Shri Mataji Nirmala Devi the founder of Sah...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2381</th>\n",
       "      <td>B3t64uAnNic</td>\n",
       "      <td>Talking Heads' David Byrne talks music industr...</td>\n",
       "      <td>David Byrne is best known for his music with T...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2382</th>\n",
       "      <td>yvPK0qKB8m4</td>\n",
       "      <td>THY ART IS MURDER - Slaves Beyond Death (OFFIC...</td>\n",
       "      <td>Official music video for \"Slaves Beyond Death\"...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2383</th>\n",
       "      <td>7uQih-OuZpE</td>\n",
       "      <td>Elmas Mehmet &amp; Dean Kopri - Elan / Kitee Inter...</td>\n",
       "      <td>über YouTube Capture</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2384</th>\n",
       "      <td>xkxXqZYJ0qU</td>\n",
       "      <td>Teentaal | Pandit Bhavani Shankar Kathak | Per...</td>\n",
       "      <td>Teentaal by Pandit Bhavani Shankar Kathak. Enj...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2385</th>\n",
       "      <td>dSMiYzBEPY8</td>\n",
       "      <td>Psychosocial programs like art therapy and mus...</td>\n",
       "      <td>Childhood cancer is a family disease in that i...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2386</th>\n",
       "      <td>3ckbuwq5VLM</td>\n",
       "      <td>Teentaal | Aditya Kalyanpur &amp; B. Nateshan | Ju...</td>\n",
       "      <td>Jugalbandi : Aditya Kalyanpur Tabla And B Nate...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2387</th>\n",
       "      <td>ihWYx-QJ95I</td>\n",
       "      <td>Gentle With Myself-Positive Affirmations-art b...</td>\n",
       "      <td>This is a beautiful visual meditation with the...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2388</th>\n",
       "      <td>9A0SbfvzNOc</td>\n",
       "      <td>light art &amp; music performance wiersma &amp; smeets</td>\n",
       "      <td>schijnvertoningenlight show with 3 overhead pr...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2389</th>\n",
       "      <td>p67tWv_cL90</td>\n",
       "      <td>Apne Kirdar Ko | Munnawar Masoom | Ghazal Numa...</td>\n",
       "      <td>Watch this beautiful Ghazal Numa Qawwali Apne ...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2390</th>\n",
       "      <td>dUcmnhV8iZw</td>\n",
       "      <td>Kartik Naach: An art of storytelling through d...</td>\n",
       "      <td>Kartik Naach: An art of storytelling through d...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2391</th>\n",
       "      <td>vK3xgCmpXdk</td>\n",
       "      <td>Art Deco - Lana Del Rey</td>\n",
       "      <td>SUPPORT THE CHANNEL✅Paypal - https://paypal.me...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2392</th>\n",
       "      <td>duNCLM8kfDY</td>\n",
       "      <td>Dig Through My Mind ☕️ (Art, Coffee, Editing, ...</td>\n",
       "      <td>today we chat about artist style, what coffee ...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2393</th>\n",
       "      <td>rfgLh-Z4o-4</td>\n",
       "      <td>How To Download FREE Music With Album Art Andr...</td>\n",
       "      <td>Free music and album art download.Whats good p...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2394</th>\n",
       "      <td>CF7R5XU1cJ8</td>\n",
       "      <td>360 Alien Space Run Visual Mix - Mind Chill Mu...</td>\n",
       "      <td>Reset your mood with Mind Chill 360 music visu...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2395</th>\n",
       "      <td>mjYadAwxPwM</td>\n",
       "      <td>Krishna Bhajans | Bela Shende | Main Girdhar K...</td>\n",
       "      <td>Krishna Bhajans : Main Girdhar Ke Ghar Jaun by...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2396</th>\n",
       "      <td>t4TcJF0uJbk</td>\n",
       "      <td>Capoeira: The Brazilian Martial Art - MMA, Dan...</td>\n",
       "      <td>This is my capoeria classes Roda that happened...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2397</th>\n",
       "      <td>8hT2G2ew6-c</td>\n",
       "      <td>Oriental Art and Sufi Music</td>\n",
       "      <td>Oriental Art and Sufi Music</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2398</th>\n",
       "      <td>wa74jjh_qSo</td>\n",
       "      <td>Pune: Art and music festival organised at Kore...</td>\n",
       "      <td>An art and music festival has been organised a...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2399</th>\n",
       "      <td>-YuRlFWijAM</td>\n",
       "      <td>\"Astra\" -- Art and Music \"Astra\" by Jeremy Webb</td>\n",
       "      <td>\"Astra\" -- Art and Music \"Astra\" by Jeremy Webb</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2400 rows × 4 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         Video ID                                              Title  \\\n",
       "0     e2NQE41J5eM    How do I travel so much ! How do I earn money!!   \n",
       "1     i9E_Blai8vk      TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE   \n",
       "2     -LzdIILq5vE  GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL O...   \n",
       "3     7ByoBJYXU0k               5 Steps to Becoming a Travel Blogger   \n",
       "4     7mIzRYh8jGA             What is it like to travel in PAKISTAN?   \n",
       "5     EthqIhPtd2I                     TRAVEL VLOG: SANTORINI, GREECE   \n",
       "6     g-7RK9cmXis                      HOW TO TRAVEL THE PHILIPPINES   \n",
       "7     SL_YBLWdZb8  Welcome to Peru! | Best Essential Tips & Trave...   \n",
       "8     ZR7Z74UY2TY              VAN LIFE | A Day in The Life | MEXICO   \n",
       "9     RcmrbNRK-jY     200 Days - A Trip Around the World Travel Film   \n",
       "10    MGhjvist4gk  How To Make a TRAVEL VIDEO - 10 Tips you need ...   \n",
       "11    kiNyRY5s7n8  How to Start a Travel Blog [2019] Full-Time Tr...   \n",
       "12    41ssBujAS0U                                      Thailand Vlog   \n",
       "13    4OH6-fxBsQA              How I Make Money and Travel the World   \n",
       "14    Rbn0cxbl28M              You Won't Believe This is India... 2!   \n",
       "15    U1llp-h7wcw  Thailand Full Moon Party Tips - Koh Phangan | ...   \n",
       "16    hXVR4l56vZ0  Travel Vlog: Venice, An Italian Love Affair | ...   \n",
       "17    Siw4ehlUMsE  Celebrating Holi in india Rishikesh  Haridwar ...   \n",
       "18    942sCY6d7kU                          Top 10 YouTube Travellers   \n",
       "19    NmyvSWq7l2E                   MALDIVES TRAVEL VLOG 🏝 COCO LILI   \n",
       "20    F0AT_7uVbeo           Japan Travel Guide - How to travel Japan   \n",
       "21    Siw4ehlUMsE  Celebrating Holi in india Rishikesh  Haridwar ...   \n",
       "22    rlCVwA2A5UA   Beautiful Thailand by Travel Blogger @joaocajuda   \n",
       "23    U1llp-h7wcw  Thailand Full Moon Party Tips - Koh Phangan | ...   \n",
       "24    41ssBujAS0U                                      Thailand Vlog   \n",
       "25    tKXrpRrj7Ow                      A WEEK IN PARIS | travel vlog   \n",
       "26    kYrpoSgHkTI  I GET PAID TO TRAVEL THE WORLD - HOW I BECAME ...   \n",
       "27    NmyvSWq7l2E                   MALDIVES TRAVEL VLOG 🏝 COCO LILI   \n",
       "28    ltHTDqVTqN0             Exploring Bangkok, Thailand in 4 Days!   \n",
       "29    MGhjvist4gk  How To Make a TRAVEL VIDEO - 10 Tips you need ...   \n",
       "...           ...                                                ...   \n",
       "2370  DnnTcjw3upg               Abstract Expressionist Art and Music   \n",
       "2371  zw2EQ1Gz1SI                                      Art and Music   \n",
       "2372  tsMN29C_9RA  Art & Culture Mexico | Traditional Music from ...   \n",
       "2373  Jajicmx2pCU  Cosey Fanni Tutti on how she wrote Art Sex Mus...   \n",
       "2374  gwDkvazf6CQ                        Art and Music of Shawn Ealy   \n",
       "2375  TPRdqYNe9pM  Dead Cities 001 - Floorplans for Dead Cities -...   \n",
       "2376  xTOxp1bEiDw  Samsung Galaxy S8: How to Add Music Album Cove...   \n",
       "2377  -zODGev1l4k  Art and Music: Desenhando Goku Super Saiyan De...   \n",
       "2378  opCtBc8aKMM  DRIP : Performance Art with Dance, Music, Visu...   \n",
       "2379  WSez3Ruwa_g  How Do You Music: Special MIDI ART Edition!!!!!!!   \n",
       "2380  rpgBNzzCvbE  Shri Mataji about Music Dance Art (Canberra 19...   \n",
       "2381  B3t64uAnNic  Talking Heads' David Byrne talks music industr...   \n",
       "2382  yvPK0qKB8m4  THY ART IS MURDER - Slaves Beyond Death (OFFIC...   \n",
       "2383  7uQih-OuZpE  Elmas Mehmet & Dean Kopri - Elan / Kitee Inter...   \n",
       "2384  xkxXqZYJ0qU  Teentaal | Pandit Bhavani Shankar Kathak | Per...   \n",
       "2385  dSMiYzBEPY8  Psychosocial programs like art therapy and mus...   \n",
       "2386  3ckbuwq5VLM  Teentaal | Aditya Kalyanpur & B. Nateshan | Ju...   \n",
       "2387  ihWYx-QJ95I  Gentle With Myself-Positive Affirmations-art b...   \n",
       "2388  9A0SbfvzNOc     light art & music performance wiersma & smeets   \n",
       "2389  p67tWv_cL90  Apne Kirdar Ko | Munnawar Masoom | Ghazal Numa...   \n",
       "2390  dUcmnhV8iZw  Kartik Naach: An art of storytelling through d...   \n",
       "2391  vK3xgCmpXdk                            Art Deco - Lana Del Rey   \n",
       "2392  duNCLM8kfDY  Dig Through My Mind ☕️ (Art, Coffee, Editing, ...   \n",
       "2393  rfgLh-Z4o-4  How To Download FREE Music With Album Art Andr...   \n",
       "2394  CF7R5XU1cJ8  360 Alien Space Run Visual Mix - Mind Chill Mu...   \n",
       "2395  mjYadAwxPwM  Krishna Bhajans | Bela Shende | Main Girdhar K...   \n",
       "2396  t4TcJF0uJbk  Capoeira: The Brazilian Martial Art - MMA, Dan...   \n",
       "2397  8hT2G2ew6-c                        Oriental Art and Sufi Music   \n",
       "2398  wa74jjh_qSo  Pune: Art and music festival organised at Kore...   \n",
       "2399  -YuRlFWijAM    \"Astra\" -- Art and Music \"Astra\" by Jeremy Webb   \n",
       "\n",
       "                                            Description Category  \n",
       "0     SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTr...   travel  \n",
       "1     I had the chance to fly out to Bali with my wh...   travel  \n",
       "2     Hope you enjoy MY GOA TRAVEL DIARY this video!...   travel  \n",
       "3     Travel blogger, Nikki Vargas, of The Pin the M...   travel  \n",
       "4     Subscribe now: https://goo.gl/6zXZGKWatch the ...   travel  \n",
       "5     Thank you so much for watching! I hope you fou...   travel  \n",
       "6     THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVE...   travel  \n",
       "7     Welcome to Peru! This essential travel guide w...   travel  \n",
       "8     We have been traveling in our van in Mexico fo...   travel  \n",
       "9     My wife and I traveled to 17 countries in 200 ...   travel  \n",
       "10    With your trip just ahead, it's time to learn ...   travel  \n",
       "11    Create a Travel Blog Website for Just $3.95++ ...   travel  \n",
       "12    Make sure to give my video a thumbsups and com...   travel  \n",
       "13    Read the full description of how I make money ...   travel  \n",
       "14    Did you know India has the most beautiful whit...   travel  \n",
       "15    I went to Koh Phangan this year just for the f...   travel  \n",
       "16    I made my way to The Floating City of Venice l...   travel  \n",
       "17    Holi, the festival of color and love, also sig...   travel  \n",
       "18    Hello, and welcome to TopX, where we count dow...   travel  \n",
       "19    🧡INSTAGRAM: https://www.instagram.com/cocolili...   travel  \n",
       "20    Welcome to my Japan travel guide for first-tim...   travel  \n",
       "21    Holi, the festival of color and love, also sig...   travel  \n",
       "22    Follow me for more videos:Facebook: http://www...   travel  \n",
       "23    I went to Koh Phangan this year just for the f...   travel  \n",
       "24    Make sure to give my video a thumbsups and com...   travel  \n",
       "25    Come along on a week in Paris with me! I meant...   travel  \n",
       "26    This is probably my most requested video of al...   travel  \n",
       "27    🧡INSTAGRAM: https://www.instagram.com/cocolili...   travel  \n",
       "28    4-days of fun and exciting experiences, foodie...   travel  \n",
       "29    With your trip just ahead, it's time to learn ...   travel  \n",
       "...                                                 ...      ...  \n",
       "2370        Abstract Expressionist Art Video with Music      art  \n",
       "2371  Provided to YouTube by Believe SASArt and Musi...      art  \n",
       "2372  Today, we speak about typical melodies from th...      art  \n",
       "2373  Founder of industrial music pioneers Throbbing...      art  \n",
       "2374                        Music and art of Shawn Ealy      art  \n",
       "2375  In this 4 minute software improvisation I use ...      art  \n",
       "2376  Learn how you can add music album cover art im...      art  \n",
       "2377  •Gostou e quer ajudar ? Like e Favorito já aju...      art  \n",
       "2378  Performance art entertainment that combines pe...      art  \n",
       "2379  help support these tutorials at: https://www.p...      art  \n",
       "2380  HH Shri Mataji Nirmala Devi the founder of Sah...      art  \n",
       "2381  David Byrne is best known for his music with T...      art  \n",
       "2382  Official music video for \"Slaves Beyond Death\"...      art  \n",
       "2383                               über YouTube Capture      art  \n",
       "2384  Teentaal by Pandit Bhavani Shankar Kathak. Enj...      art  \n",
       "2385  Childhood cancer is a family disease in that i...      art  \n",
       "2386  Jugalbandi : Aditya Kalyanpur Tabla And B Nate...      art  \n",
       "2387  This is a beautiful visual meditation with the...      art  \n",
       "2388  schijnvertoningenlight show with 3 overhead pr...      art  \n",
       "2389  Watch this beautiful Ghazal Numa Qawwali Apne ...      art  \n",
       "2390  Kartik Naach: An art of storytelling through d...      art  \n",
       "2391  SUPPORT THE CHANNEL✅Paypal - https://paypal.me...      art  \n",
       "2392  today we chat about artist style, what coffee ...      art  \n",
       "2393  Free music and album art download.Whats good p...      art  \n",
       "2394  Reset your mood with Mind Chill 360 music visu...      art  \n",
       "2395  Krishna Bhajans : Main Girdhar Ke Ghar Jaun by...      art  \n",
       "2396  This is my capoeria classes Roda that happened...      art  \n",
       "2397                        Oriental Art and Sufi Music      art  \n",
       "2398  An art and music festival has been organised a...      art  \n",
       "2399    \"Astra\" -- Art and Music \"Astra\" by Jeremy Webb      art  \n",
       "\n",
       "[2400 rows x 4 columns]"
      ]
     },
     "execution_count": 51,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "YTDf = pd.DataFrame (columns=[\"Video ID\", \"Title\", \"Description\", \"Category\"])\n",
    "YTDf[\"Video ID\"] = vidID\n",
    "YTDf[\"Title\"] = vidTitle\n",
    "YTDf[\"Description\"] = vidDescription\n",
    "YTDf[\"Category\"] = vidCateogry\n",
    "\n",
    "# counting all unique results\n",
    "print (\"Unique count = \" + str (len (YTDf[\"Video ID\"].unique ())))\n",
    "\n",
    "# seeing how Dataframe looks like (with all results)\n",
    "YTDf"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Video ID</th>\n",
       "      <th>Title</th>\n",
       "      <th>Description</th>\n",
       "      <th>Category</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>e2NQE41J5eM</td>\n",
       "      <td>How do I travel so much ! How do I earn money!!</td>\n",
       "      <td>SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTr...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>i9E_Blai8vk</td>\n",
       "      <td>TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE</td>\n",
       "      <td>I had the chance to fly out to Bali with my wh...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>-LzdIILq5vE</td>\n",
       "      <td>GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL O...</td>\n",
       "      <td>Hope you enjoy MY GOA TRAVEL DIARY this video!...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>7ByoBJYXU0k</td>\n",
       "      <td>5 Steps to Becoming a Travel Blogger</td>\n",
       "      <td>Travel blogger, Nikki Vargas, of The Pin the M...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>7mIzRYh8jGA</td>\n",
       "      <td>What is it like to travel in PAKISTAN?</td>\n",
       "      <td>Subscribe now: https://goo.gl/6zXZGKWatch the ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>EthqIhPtd2I</td>\n",
       "      <td>TRAVEL VLOG: SANTORINI, GREECE</td>\n",
       "      <td>Thank you so much for watching! I hope you fou...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>g-7RK9cmXis</td>\n",
       "      <td>HOW TO TRAVEL THE PHILIPPINES</td>\n",
       "      <td>THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVE...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>SL_YBLWdZb8</td>\n",
       "      <td>Welcome to Peru! | Best Essential Tips &amp; Trave...</td>\n",
       "      <td>Welcome to Peru! This essential travel guide w...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>ZR7Z74UY2TY</td>\n",
       "      <td>VAN LIFE | A Day in The Life | MEXICO</td>\n",
       "      <td>We have been traveling in our van in Mexico fo...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>RcmrbNRK-jY</td>\n",
       "      <td>200 Days - A Trip Around the World Travel Film</td>\n",
       "      <td>My wife and I traveled to 17 countries in 200 ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>MGhjvist4gk</td>\n",
       "      <td>How To Make a TRAVEL VIDEO - 10 Tips you need ...</td>\n",
       "      <td>With your trip just ahead, it's time to learn ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>kiNyRY5s7n8</td>\n",
       "      <td>How to Start a Travel Blog [2019] Full-Time Tr...</td>\n",
       "      <td>Create a Travel Blog Website for Just $3.95++ ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>41ssBujAS0U</td>\n",
       "      <td>Thailand Vlog</td>\n",
       "      <td>Make sure to give my video a thumbsups and com...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>4OH6-fxBsQA</td>\n",
       "      <td>How I Make Money and Travel the World</td>\n",
       "      <td>Read the full description of how I make money ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Rbn0cxbl28M</td>\n",
       "      <td>You Won't Believe This is India... 2!</td>\n",
       "      <td>Did you know India has the most beautiful whit...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>U1llp-h7wcw</td>\n",
       "      <td>Thailand Full Moon Party Tips - Koh Phangan | ...</td>\n",
       "      <td>I went to Koh Phangan this year just for the f...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>hXVR4l56vZ0</td>\n",
       "      <td>Travel Vlog: Venice, An Italian Love Affair | ...</td>\n",
       "      <td>I made my way to The Floating City of Venice l...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Siw4ehlUMsE</td>\n",
       "      <td>Celebrating Holi in india Rishikesh  Haridwar ...</td>\n",
       "      <td>Holi, the festival of color and love, also sig...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>942sCY6d7kU</td>\n",
       "      <td>Top 10 YouTube Travellers</td>\n",
       "      <td>Hello, and welcome to TopX, where we count dow...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>NmyvSWq7l2E</td>\n",
       "      <td>MALDIVES TRAVEL VLOG 🏝 COCO LILI</td>\n",
       "      <td>🧡INSTAGRAM: https://www.instagram.com/cocolili...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>F0AT_7uVbeo</td>\n",
       "      <td>Japan Travel Guide - How to travel Japan</td>\n",
       "      <td>Welcome to my Japan travel guide for first-tim...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>rlCVwA2A5UA</td>\n",
       "      <td>Beautiful Thailand by Travel Blogger @joaocajuda</td>\n",
       "      <td>Follow me for more videos:Facebook: http://www...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>tKXrpRrj7Ow</td>\n",
       "      <td>A WEEK IN PARIS | travel vlog</td>\n",
       "      <td>Come along on a week in Paris with me! I meant...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>kYrpoSgHkTI</td>\n",
       "      <td>I GET PAID TO TRAVEL THE WORLD - HOW I BECAME ...</td>\n",
       "      <td>This is probably my most requested video of al...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>ltHTDqVTqN0</td>\n",
       "      <td>Exploring Bangkok, Thailand in 4 Days!</td>\n",
       "      <td>4-days of fun and exciting experiences, foodie...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>RY5nz7vTXEk</td>\n",
       "      <td>ആനവണ്ടി ഫാൻസിനൊപ്പം കണ്ണൂർ പൈതൽമലയിലേക്ക് ഒരു ...</td>\n",
       "      <td>ആനവണ്ടി ഫാൻസ്‌ ഫെയ്‌സ്ബുക്ക് കൂട്ടായ്മയുടെ ഒരു...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>58iT2L4VQj4</td>\n",
       "      <td>Miami Vacation Travel Guide | Expedia</td>\n",
       "      <td>http://www.expedia.com/Miami.d178286....With i...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>mbt2Yzc35Ok</td>\n",
       "      <td>How to Start a Travel Blog: My Top 10 Tips</td>\n",
       "      <td>How to Start a Travel Blog↠ SUBSCRIBE for solo...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>HmH71FGDqc8</td>\n",
       "      <td>24 Hours in Hangzhou, China | Travel Guide | K...</td>\n",
       "      <td>Beautiful city, beautiful people, beautiful tr...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>g-XZUq3No_U</td>\n",
       "      <td>TRAVEL VLOG: HAVANA, CUBA + Tips &amp; Advice!</td>\n",
       "      <td>This one was filmed slightly different but we ...</td>\n",
       "      <td>travel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2369</th>\n",
       "      <td>WV5Wdlbc7QI</td>\n",
       "      <td>MUSIC IS MY ART (NIAMAT SALAAMAT) VIDEO SONG |...</td>\n",
       "      <td>Presenting Music is My Art (Niamat Salaamat) V...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2370</th>\n",
       "      <td>DnnTcjw3upg</td>\n",
       "      <td>Abstract Expressionist Art and Music</td>\n",
       "      <td>Abstract Expressionist Art Video with Music</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2371</th>\n",
       "      <td>zw2EQ1Gz1SI</td>\n",
       "      <td>Art and Music</td>\n",
       "      <td>Provided to YouTube by Believe SASArt and Musi...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2372</th>\n",
       "      <td>tsMN29C_9RA</td>\n",
       "      <td>Art &amp; Culture Mexico | Traditional Music from ...</td>\n",
       "      <td>Today, we speak about typical melodies from th...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2373</th>\n",
       "      <td>Jajicmx2pCU</td>\n",
       "      <td>Cosey Fanni Tutti on how she wrote Art Sex Mus...</td>\n",
       "      <td>Founder of industrial music pioneers Throbbing...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2374</th>\n",
       "      <td>gwDkvazf6CQ</td>\n",
       "      <td>Art and Music of Shawn Ealy</td>\n",
       "      <td>Music and art of Shawn Ealy</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2375</th>\n",
       "      <td>TPRdqYNe9pM</td>\n",
       "      <td>Dead Cities 001 - Floorplans for Dead Cities -...</td>\n",
       "      <td>In this 4 minute software improvisation I use ...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2376</th>\n",
       "      <td>xTOxp1bEiDw</td>\n",
       "      <td>Samsung Galaxy S8: How to Add Music Album Cove...</td>\n",
       "      <td>Learn how you can add music album cover art im...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2377</th>\n",
       "      <td>-zODGev1l4k</td>\n",
       "      <td>Art and Music: Desenhando Goku Super Saiyan De...</td>\n",
       "      <td>•Gostou e quer ajudar ? Like e Favorito já aju...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2378</th>\n",
       "      <td>opCtBc8aKMM</td>\n",
       "      <td>DRIP : Performance Art with Dance, Music, Visu...</td>\n",
       "      <td>Performance art entertainment that combines pe...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2379</th>\n",
       "      <td>WSez3Ruwa_g</td>\n",
       "      <td>How Do You Music: Special MIDI ART Edition!!!!!!!</td>\n",
       "      <td>help support these tutorials at: https://www.p...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2380</th>\n",
       "      <td>rpgBNzzCvbE</td>\n",
       "      <td>Shri Mataji about Music Dance Art (Canberra 19...</td>\n",
       "      <td>HH Shri Mataji Nirmala Devi the founder of Sah...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2381</th>\n",
       "      <td>B3t64uAnNic</td>\n",
       "      <td>Talking Heads' David Byrne talks music industr...</td>\n",
       "      <td>David Byrne is best known for his music with T...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2382</th>\n",
       "      <td>yvPK0qKB8m4</td>\n",
       "      <td>THY ART IS MURDER - Slaves Beyond Death (OFFIC...</td>\n",
       "      <td>Official music video for \"Slaves Beyond Death\"...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2383</th>\n",
       "      <td>7uQih-OuZpE</td>\n",
       "      <td>Elmas Mehmet &amp; Dean Kopri - Elan / Kitee Inter...</td>\n",
       "      <td>über YouTube Capture</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2384</th>\n",
       "      <td>xkxXqZYJ0qU</td>\n",
       "      <td>Teentaal | Pandit Bhavani Shankar Kathak | Per...</td>\n",
       "      <td>Teentaal by Pandit Bhavani Shankar Kathak. Enj...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2385</th>\n",
       "      <td>dSMiYzBEPY8</td>\n",
       "      <td>Psychosocial programs like art therapy and mus...</td>\n",
       "      <td>Childhood cancer is a family disease in that i...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2386</th>\n",
       "      <td>3ckbuwq5VLM</td>\n",
       "      <td>Teentaal | Aditya Kalyanpur &amp; B. Nateshan | Ju...</td>\n",
       "      <td>Jugalbandi : Aditya Kalyanpur Tabla And B Nate...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2387</th>\n",
       "      <td>ihWYx-QJ95I</td>\n",
       "      <td>Gentle With Myself-Positive Affirmations-art b...</td>\n",
       "      <td>This is a beautiful visual meditation with the...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2388</th>\n",
       "      <td>9A0SbfvzNOc</td>\n",
       "      <td>light art &amp; music performance wiersma &amp; smeets</td>\n",
       "      <td>schijnvertoningenlight show with 3 overhead pr...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2389</th>\n",
       "      <td>p67tWv_cL90</td>\n",
       "      <td>Apne Kirdar Ko | Munnawar Masoom | Ghazal Numa...</td>\n",
       "      <td>Watch this beautiful Ghazal Numa Qawwali Apne ...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2391</th>\n",
       "      <td>vK3xgCmpXdk</td>\n",
       "      <td>Art Deco - Lana Del Rey</td>\n",
       "      <td>SUPPORT THE CHANNEL✅Paypal - https://paypal.me...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2392</th>\n",
       "      <td>duNCLM8kfDY</td>\n",
       "      <td>Dig Through My Mind ☕️ (Art, Coffee, Editing, ...</td>\n",
       "      <td>today we chat about artist style, what coffee ...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2393</th>\n",
       "      <td>rfgLh-Z4o-4</td>\n",
       "      <td>How To Download FREE Music With Album Art Andr...</td>\n",
       "      <td>Free music and album art download.Whats good p...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2394</th>\n",
       "      <td>CF7R5XU1cJ8</td>\n",
       "      <td>360 Alien Space Run Visual Mix - Mind Chill Mu...</td>\n",
       "      <td>Reset your mood with Mind Chill 360 music visu...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2395</th>\n",
       "      <td>mjYadAwxPwM</td>\n",
       "      <td>Krishna Bhajans | Bela Shende | Main Girdhar K...</td>\n",
       "      <td>Krishna Bhajans : Main Girdhar Ke Ghar Jaun by...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2396</th>\n",
       "      <td>t4TcJF0uJbk</td>\n",
       "      <td>Capoeira: The Brazilian Martial Art - MMA, Dan...</td>\n",
       "      <td>This is my capoeria classes Roda that happened...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2397</th>\n",
       "      <td>8hT2G2ew6-c</td>\n",
       "      <td>Oriental Art and Sufi Music</td>\n",
       "      <td>Oriental Art and Sufi Music</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2398</th>\n",
       "      <td>wa74jjh_qSo</td>\n",
       "      <td>Pune: Art and music festival organised at Kore...</td>\n",
       "      <td>An art and music festival has been organised a...</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2399</th>\n",
       "      <td>-YuRlFWijAM</td>\n",
       "      <td>\"Astra\" -- Art and Music \"Astra\" by Jeremy Webb</td>\n",
       "      <td>\"Astra\" -- Art and Music \"Astra\" by Jeremy Webb</td>\n",
       "      <td>art</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2113 rows × 4 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         Video ID                                              Title  \\\n",
       "0     e2NQE41J5eM    How do I travel so much ! How do I earn money!!   \n",
       "1     i9E_Blai8vk      TRAVEL VLOG ∙ Welcome to Bali | PRISCILLA LEE   \n",
       "2     -LzdIILq5vE  GOA TRAVEL DIARY | FOUR DAYS IN GOA | TRAVEL O...   \n",
       "3     7ByoBJYXU0k               5 Steps to Becoming a Travel Blogger   \n",
       "4     7mIzRYh8jGA             What is it like to travel in PAKISTAN?   \n",
       "5     EthqIhPtd2I                     TRAVEL VLOG: SANTORINI, GREECE   \n",
       "6     g-7RK9cmXis                      HOW TO TRAVEL THE PHILIPPINES   \n",
       "7     SL_YBLWdZb8  Welcome to Peru! | Best Essential Tips & Trave...   \n",
       "8     ZR7Z74UY2TY              VAN LIFE | A Day in The Life | MEXICO   \n",
       "9     RcmrbNRK-jY     200 Days - A Trip Around the World Travel Film   \n",
       "10    MGhjvist4gk  How To Make a TRAVEL VIDEO - 10 Tips you need ...   \n",
       "11    kiNyRY5s7n8  How to Start a Travel Blog [2019] Full-Time Tr...   \n",
       "12    41ssBujAS0U                                      Thailand Vlog   \n",
       "13    4OH6-fxBsQA              How I Make Money and Travel the World   \n",
       "14    Rbn0cxbl28M              You Won't Believe This is India... 2!   \n",
       "15    U1llp-h7wcw  Thailand Full Moon Party Tips - Koh Phangan | ...   \n",
       "16    hXVR4l56vZ0  Travel Vlog: Venice, An Italian Love Affair | ...   \n",
       "17    Siw4ehlUMsE  Celebrating Holi in india Rishikesh  Haridwar ...   \n",
       "18    942sCY6d7kU                          Top 10 YouTube Travellers   \n",
       "19    NmyvSWq7l2E                   MALDIVES TRAVEL VLOG 🏝 COCO LILI   \n",
       "20    F0AT_7uVbeo           Japan Travel Guide - How to travel Japan   \n",
       "22    rlCVwA2A5UA   Beautiful Thailand by Travel Blogger @joaocajuda   \n",
       "25    tKXrpRrj7Ow                      A WEEK IN PARIS | travel vlog   \n",
       "26    kYrpoSgHkTI  I GET PAID TO TRAVEL THE WORLD - HOW I BECAME ...   \n",
       "28    ltHTDqVTqN0             Exploring Bangkok, Thailand in 4 Days!   \n",
       "30    RY5nz7vTXEk  ആനവണ്ടി ഫാൻസിനൊപ്പം കണ്ണൂർ പൈതൽമലയിലേക്ക് ഒരു ...   \n",
       "31    58iT2L4VQj4              Miami Vacation Travel Guide | Expedia   \n",
       "32    mbt2Yzc35Ok         How to Start a Travel Blog: My Top 10 Tips   \n",
       "33    HmH71FGDqc8  24 Hours in Hangzhou, China | Travel Guide | K...   \n",
       "34    g-XZUq3No_U         TRAVEL VLOG: HAVANA, CUBA + Tips & Advice!   \n",
       "...           ...                                                ...   \n",
       "2369  WV5Wdlbc7QI  MUSIC IS MY ART (NIAMAT SALAAMAT) VIDEO SONG |...   \n",
       "2370  DnnTcjw3upg               Abstract Expressionist Art and Music   \n",
       "2371  zw2EQ1Gz1SI                                      Art and Music   \n",
       "2372  tsMN29C_9RA  Art & Culture Mexico | Traditional Music from ...   \n",
       "2373  Jajicmx2pCU  Cosey Fanni Tutti on how she wrote Art Sex Mus...   \n",
       "2374  gwDkvazf6CQ                        Art and Music of Shawn Ealy   \n",
       "2375  TPRdqYNe9pM  Dead Cities 001 - Floorplans for Dead Cities -...   \n",
       "2376  xTOxp1bEiDw  Samsung Galaxy S8: How to Add Music Album Cove...   \n",
       "2377  -zODGev1l4k  Art and Music: Desenhando Goku Super Saiyan De...   \n",
       "2378  opCtBc8aKMM  DRIP : Performance Art with Dance, Music, Visu...   \n",
       "2379  WSez3Ruwa_g  How Do You Music: Special MIDI ART Edition!!!!!!!   \n",
       "2380  rpgBNzzCvbE  Shri Mataji about Music Dance Art (Canberra 19...   \n",
       "2381  B3t64uAnNic  Talking Heads' David Byrne talks music industr...   \n",
       "2382  yvPK0qKB8m4  THY ART IS MURDER - Slaves Beyond Death (OFFIC...   \n",
       "2383  7uQih-OuZpE  Elmas Mehmet & Dean Kopri - Elan / Kitee Inter...   \n",
       "2384  xkxXqZYJ0qU  Teentaal | Pandit Bhavani Shankar Kathak | Per...   \n",
       "2385  dSMiYzBEPY8  Psychosocial programs like art therapy and mus...   \n",
       "2386  3ckbuwq5VLM  Teentaal | Aditya Kalyanpur & B. Nateshan | Ju...   \n",
       "2387  ihWYx-QJ95I  Gentle With Myself-Positive Affirmations-art b...   \n",
       "2388  9A0SbfvzNOc     light art & music performance wiersma & smeets   \n",
       "2389  p67tWv_cL90  Apne Kirdar Ko | Munnawar Masoom | Ghazal Numa...   \n",
       "2391  vK3xgCmpXdk                            Art Deco - Lana Del Rey   \n",
       "2392  duNCLM8kfDY  Dig Through My Mind ☕️ (Art, Coffee, Editing, ...   \n",
       "2393  rfgLh-Z4o-4  How To Download FREE Music With Album Art Andr...   \n",
       "2394  CF7R5XU1cJ8  360 Alien Space Run Visual Mix - Mind Chill Mu...   \n",
       "2395  mjYadAwxPwM  Krishna Bhajans | Bela Shende | Main Girdhar K...   \n",
       "2396  t4TcJF0uJbk  Capoeira: The Brazilian Martial Art - MMA, Dan...   \n",
       "2397  8hT2G2ew6-c                        Oriental Art and Sufi Music   \n",
       "2398  wa74jjh_qSo  Pune: Art and music festival organised at Kore...   \n",
       "2399  -YuRlFWijAM    \"Astra\" -- Art and Music \"Astra\" by Jeremy Webb   \n",
       "\n",
       "                                            Description Category  \n",
       "0     SUBSCRIBE - https://goo.gl/dEtSMJ (‘MountainTr...   travel  \n",
       "1     I had the chance to fly out to Bali with my wh...   travel  \n",
       "2     Hope you enjoy MY GOA TRAVEL DIARY this video!...   travel  \n",
       "3     Travel blogger, Nikki Vargas, of The Pin the M...   travel  \n",
       "4     Subscribe now: https://goo.gl/6zXZGKWatch the ...   travel  \n",
       "5     Thank you so much for watching! I hope you fou...   travel  \n",
       "6     THIS IS MY FAVOURITE COUNTRY I HAVE EVER TRAVE...   travel  \n",
       "7     Welcome to Peru! This essential travel guide w...   travel  \n",
       "8     We have been traveling in our van in Mexico fo...   travel  \n",
       "9     My wife and I traveled to 17 countries in 200 ...   travel  \n",
       "10    With your trip just ahead, it's time to learn ...   travel  \n",
       "11    Create a Travel Blog Website for Just $3.95++ ...   travel  \n",
       "12    Make sure to give my video a thumbsups and com...   travel  \n",
       "13    Read the full description of how I make money ...   travel  \n",
       "14    Did you know India has the most beautiful whit...   travel  \n",
       "15    I went to Koh Phangan this year just for the f...   travel  \n",
       "16    I made my way to The Floating City of Venice l...   travel  \n",
       "17    Holi, the festival of color and love, also sig...   travel  \n",
       "18    Hello, and welcome to TopX, where we count dow...   travel  \n",
       "19    🧡INSTAGRAM: https://www.instagram.com/cocolili...   travel  \n",
       "20    Welcome to my Japan travel guide for first-tim...   travel  \n",
       "22    Follow me for more videos:Facebook: http://www...   travel  \n",
       "25    Come along on a week in Paris with me! I meant...   travel  \n",
       "26    This is probably my most requested video of al...   travel  \n",
       "28    4-days of fun and exciting experiences, foodie...   travel  \n",
       "30    ആനവണ്ടി ഫാൻസ്‌ ഫെയ്‌സ്ബുക്ക് കൂട്ടായ്മയുടെ ഒരു...   travel  \n",
       "31    http://www.expedia.com/Miami.d178286....With i...   travel  \n",
       "32    How to Start a Travel Blog↠ SUBSCRIBE for solo...   travel  \n",
       "33    Beautiful city, beautiful people, beautiful tr...   travel  \n",
       "34    This one was filmed slightly different but we ...   travel  \n",
       "...                                                 ...      ...  \n",
       "2369  Presenting Music is My Art (Niamat Salaamat) V...      art  \n",
       "2370        Abstract Expressionist Art Video with Music      art  \n",
       "2371  Provided to YouTube by Believe SASArt and Musi...      art  \n",
       "2372  Today, we speak about typical melodies from th...      art  \n",
       "2373  Founder of industrial music pioneers Throbbing...      art  \n",
       "2374                        Music and art of Shawn Ealy      art  \n",
       "2375  In this 4 minute software improvisation I use ...      art  \n",
       "2376  Learn how you can add music album cover art im...      art  \n",
       "2377  •Gostou e quer ajudar ? Like e Favorito já aju...      art  \n",
       "2378  Performance art entertainment that combines pe...      art  \n",
       "2379  help support these tutorials at: https://www.p...      art  \n",
       "2380  HH Shri Mataji Nirmala Devi the founder of Sah...      art  \n",
       "2381  David Byrne is best known for his music with T...      art  \n",
       "2382  Official music video for \"Slaves Beyond Death\"...      art  \n",
       "2383                               über YouTube Capture      art  \n",
       "2384  Teentaal by Pandit Bhavani Shankar Kathak. Enj...      art  \n",
       "2385  Childhood cancer is a family disease in that i...      art  \n",
       "2386  Jugalbandi : Aditya Kalyanpur Tabla And B Nate...      art  \n",
       "2387  This is a beautiful visual meditation with the...      art  \n",
       "2388  schijnvertoningenlight show with 3 overhead pr...      art  \n",
       "2389  Watch this beautiful Ghazal Numa Qawwali Apne ...      art  \n",
       "2391  SUPPORT THE CHANNEL✅Paypal - https://paypal.me...      art  \n",
       "2392  today we chat about artist style, what coffee ...      art  \n",
       "2393  Free music and album art download.Whats good p...      art  \n",
       "2394  Reset your mood with Mind Chill 360 music visu...      art  \n",
       "2395  Krishna Bhajans : Main Girdhar Ke Ghar Jaun by...      art  \n",
       "2396  This is my capoeria classes Roda that happened...      art  \n",
       "2397                        Oriental Art and Sufi Music      art  \n",
       "2398  An art and music festival has been organised a...      art  \n",
       "2399    \"Astra\" -- Art and Music \"Astra\" by Jeremy Webb      art  \n",
       "\n",
       "[2113 rows x 4 columns]"
      ]
     },
     "execution_count": 52,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# how Dataframe looks like without duplicate results\n",
    "YTDf.drop_duplicates ()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [],
   "source": [
    "# creating .csv file by dropping the duplicate results\n",
    "YTDf.drop_duplicates ().to_csv (\"YTDataset.csv\", index=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Resources followed to learn Web Scraping:\n",
    "\n",
    "1. https://www.crummy.com/software/BeautifulSoup/bs4/doc/\n",
    "2. https://allofyourbases.com/2017/10/08/web-scraping-youtube-in-python/\n",
    "3. https://allofyourbases.com/2017/11/08/webcrawling-youtube-pagination-in-python/\n",
    "4. https://www.youtube.com/watch?v=0_VZ7NpVw1Y\n",
    "5. https://www.youtube.com/watch?v=PI1-1TtFz50\n",
    "6. https://www.youtube.com/watch?v=ng2o98k983k\n",
    "\n",
    "### Learning web-scraping took the whole time, so wasn't able to do classification. \n",
    "\n",
    "However, if had to classify then would go with RNN to classify based on the video-title and the video-description (after cleaning up both since they contain emojis, affiliate links, other links which are not useful)."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}