Skip to content
Permalink
main
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?

Python-Spark-Structured-Streaming-Tutorial/README.md

Go to file
 
 
Cannot retrieve contributors at this time
Python Spark Structured Streaming with Twitter tutorial Setup the project Configure the settings Run application
38 lines (25 sloc) 631 Bytes
Raw Blame
Open in GitHub Desktop

Python Spark Structured Streaming with Twitter tutorial

Setup the project

Configure a virtual environment:

python -m venv venv
source venv/bin/activate

Install the requirements:

pip install -r requirements.txt

Configure the settings

Copy the settings.py.example file to settings.py and configure the variables.

cp settings.py.example settings.py

Run application

First, run the Twitter streaming application:

python twitter_streaming.py

After that, run the Spark sentiment analysis application:

python spark_streaming_sentiment_analysis.py