Skip to content

/aws-glue-tutorial

AWS Glue tutorial for data developers.
spark pyspark aws-glue tutorial
Python
  1. Python 100.0%
Branch: master
Find File
Clone or download

Clone with HTTPS

Use Git or checkout with SVN using the web URL.

Download ZIP

Launching GitHub Desktop...

If nothing happens, download GitHub Desktop and try again.

Launching GitHub Desktop...

If nothing happens, download GitHub Desktop and try again.

Launching Xcode...

If nothing happens, download Xcode and try again.

Launching Visual Studio...

If nothing happens, download the GitHub extension for Visual Studio and try again.

Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md
glue_script.py
movie_data.txt

README.md

AWS Glue tutorial

AWS Glue tutorial for data developers.

This is a complementary repository for this AWS Glue tutorial with Spark and Python for data developers.

DynamicFrame vs DataFrame in AWS Glue

Note the difference between DynamicFrame and DataFrame. DataFrame is Spark native table like structure. DynamicFrame class is an attempt from AWS to address limitations of the DataFrame.

DynamicFrames might be handy to read and write data. Often the data processing is more efficient with standard PySpark functions.

You can’t perform that action at this time.