Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

big_data_coursework

Worked on creating a storage bucket in Google Cloud Platform and then creating different variations of clusters (master nodes, worker nodes and storage) to read and write data from our script to the cloud. Spark and Tensorflow libraries were used and understanding their interplay was a key discovery. Additionally worked on understanding the importance of caching and where in the process would it provide the most speed.

About

Reading and writing images on the cloud through Google Cloud Platform using Spark and Tensorflow libraries

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages