Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Fetching contributors…

Cannot retrieve contributors at this time

29 lines (21 sloc) 1.323 kb

New Features

  • ScoobiApp trait for making scoobi apps even easier
  • Single import import com.nicta.scoobi.Scoobi._
  • IO support for avro
  • Sequence files automatically convert to/from writable
  • Distributed Objects and DList reduction methods (e.g. reduce, product, min, etc.)
  • Testing support
  • Matrix and vector extensions

Changes

  • All methods of Scoobi object are now in Conf object
  • DList.use(x: DObject) has been removed as part of a complete redesign of Distributed Objects
  • To avoid hiding the scala types, the TextInput pattern matcher helpers have been renamed: Int to AnInt, Float to AFloat, Double to ADouble, Long to ALong.

Improvements

  • New website and User Guide
  • Lots of bug fixes
  • Improvements in optimizer
  • MSCR now imposes less overhead on objects that need no fusion
  • Join/coGroup API cleaned up, and performance improved
  • Better support for other filesystems such as S3
  • Refactoring of data input and output APIs making user extensions easier to add

Jump to Line
Something went wrong with that request. Please try again.