Skip to content

Implemented MapReduce using Java 8 streams for Weather Station Objects. The purpose of this task is the method countTemperatures(t1,t2,r) in the class WeatherStation returns a list which contains two pairs: 1) temperature t1 paired with the number of times a temperature in the interval [t1-r..t1+r] has been measured so far by any of the weather …

Notifications You must be signed in to change notification settings

ronanmmurphy/Spark-Java8-Streams-MapReduce

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

Spark-Java-8-Streams-MapReduce

Implemented MapReduce using Spark RDD and Java 8 streams for Weather Station Objects. The purpose of this task is parellel stream method countTemperatures(t1,t2,r) in the class WeatherStation which returns a list which contains two pairs:

  1. temperature t1 paired with the number of times a temperature in the interval [t1-r..t1+r] has been measured so far by any of the weather stations in stations
  2. temperature t2 paired with the number of times a temperature in the interval [t2-r..t2+r] has been measured so far by any of the weather stations in stations. The Java8 version of the method emulates MapReduce accomplised without Clustering frameworks like Hadoop, but mapping to (key,value) pairs which are reduced with sum computation at the end of the stream. The other method maxTemperature returns the highest temperature recorded bewteen the interval.

About

Implemented MapReduce using Java 8 streams for Weather Station Objects. The purpose of this task is the method countTemperatures(t1,t2,r) in the class WeatherStation returns a list which contains two pairs: 1) temperature t1 paired with the number of times a temperature in the interval [t1-r..t1+r] has been measured so far by any of the weather …

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages