v0.4.0a1

This is the release notes of v0.4.0a1. See here for the complete list of solved issues and merged PRs.

Announcements

Due to the end-of-life (EOL) of Python 2 in January 1, 2020, from v0.4.0a1 on, v0.4.x series will no longer support Python 2, for Python 2.7 users, please use 0.3.x series.

Changes that break compatibility

• Operand now supports stages(#934), reduction operands as well as those operands whose tiled chunks contain map or reduce phases cannot be serialized between this and former versions.

New Features

• Tensor
  • Implements mt.histogram and mt.histogram_bin_edges (#876)
  • Add mt.partition support (#889)
  • Implements mt.{percentile, quantile, median} (#898)
  • Support Einstein summation convention (#888)
  • Add mt.fill_diagonal support (#918)
  • Support mars.tensor.spatial.distance.{pdist, cdist, squareform} (#894)
• DataFrame
  • Support creating DataFrame from dict whose values are tensors (#903)
  • Support DataFrame and Series count (#900)
  • Implement mean operator for DataFrame and Series (#907)
  • Implements DataFrame.quantile and Series.quantile (#911)
  • Add comparison functions for DataFrame (#921)
  • Support df.reset_index and series.reset_index (#915)
• Learn
  • Add pairwise distances support for learn (#926)
  • Implement MarsDataset to integrate with PyTorch (#937)
• Others
  • Add function objects implementation for tokenizer (#893)

Enhancements

• Use default args for super() (#878)
• Skip preparing specified chunks when preparing for execution (#891)
• Accelerate LU when input has one chunk (#905)
• Add support for AnyReference in serialization (#874)
• Merge operands representing multiple stages of one single operand (#934)

Tests

• Add TestExecutor that serde graph every time when executing to ensure all operands work well with serialize (#880)
• Fix possible failure of testIterativeTilingWithoutEtcd for Python 3.5 in CI (#896)
• Switch coverage service to codecov (#909)
• Remove *_pb2.py to reduce chances of code conflict (#913)
• Fix failures in Windows tests (#938)

Others

• Drop support for Python 2 (#872)
• Further remove py27-related imports (#875)