Youtube-Data-Harvesting

Project Descriptions:

This app is build for to extract the youtube channel data

• The problem statement is to create a Streamlit application that allows users to access and analyze data from YouTube Channels:

  • Using _Google API we retrieve all the relevant data for a YouTube channel ID.

    | Channel name | Subscribers | Total video count | Playlist ID | Video ID | Likes| Comments of each video |

  • Store the data in a MongoDB database.

  • Ability to collect data form the YouTube channels and store them in the data lake by clicking a button.

---

Languages and Tools:

To run this app

python -m streamlit run app.py or streamlit run app.py

NOTE

• provide your api key for the youtube
• provide your sql user, database name, password.
• provide your mongodb database name.

Basic Requirements:

• Python 3.10
• googleapiclient
• mysql_connector
• Pandas
• Streamlit
• Numpy
• pymongo

Local Setup:

1. Clone the Repository:

git clone git@github.com:AJIN-B/Youtube-data-Harvesting.git
cd Youtube-data-Harvesting

2. Set Up a Virtual Environment (Optional but Recommended):

# For macOS and Linux:
python3 -m venv venv

# For Windows:
python -m venv venv

3. Activate the Virtual Environment:

# For macOS and Linux:
source venv/bin/activate

# For Windows:
.\venv\Scripts\activate

4. Install Required Dependencies:

pip install -r requirements.txt

5. Set up the Environment Variables:

# add the following Keys

API_KEY="Your Youtube API KEY"

HOST="Your HOST ID"

USER="Your USER ID"

PASSWORD="Your PASSWORD"

PORT="Your PORT"

DATABASE_NAME="Your DATABASE NAME"

6. Run:

python -m streamlit run app.py 
or 
streamlit run app.py

After running the command, Streamlit will provide a local URL (usually http://localhost:8501/) which you can open in your web browser to access application.

=======

sample screenshot