Readings for Streaming

Paper List of 2013

MillWheel: fault-tolerant stream processing at internet scale VLDB 2013

Sketch-based geometric monitoring of distributed stream queries VLDB 2013

Streaming algorithms for k-core decomposition VLDB 2013

Integrating scale out and fault tolerance in stream processing using operator state management SIGMOD 2013

Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams SIGMOD 2013

Robust Distributed Stream Processing ICDE 2013

Publicly Verifiable Grouped Aggregation Queries on Outsourced Data Streams ICDE 2013

Discretized streams: Fault-tolerant streaming computation at scale SOSP 2013

Paper List of 2014

S-Store: a streaming NewSQL system for big velocity applications VLDB 2014

Summingbird: a framework for integrating batch and online MapReduce computations VLDB 2014

Trill: a high-performance incremental query processor for diverse analytics VLDB 2014

Partitioning functions for stateful data parallelism in stream processing VLDBJ 2014

Storm @Twitter SIGMOD 2014

Continuous Fragmented Skylines over Distributed Streams ICDE 2014

Paper List of 2015

The dataflow model: a practical approach to balancing correctness, latency, and cost in massive-scale, unbounded, out-of-order data processing VLDB 2015

S-Store: Streaming Meets Transaction Processing VLDB 2015

General Incremental Sliding-Window Aggregation VLDB 2015

Monitoring Distributed Streams using Convex Decompositions VLDB 2015

Twitter Heron: Stream Processing at Scale SIGMOD 2015

Scalable Distributed Stream Join Processing SIGMOD 2015

SCREEN: Stream Data Cleaning under Speed Constraints SIGMOD 2015

CE-Storm: Confidential Elastic Processing of Data Streams SIGMOD 2015

ChronoStream: Elastic stateful stream computation in the cloud ICDE 2015

The power of both choices: Practical load balancing for distributed stream processing engines ICDE 2015

Paper List of 2016

Streaming Similarity Self-Join VLDB 2016

THEMIS: Fairness in Federated Stream Processing under Overload SIGMOD 2016

Time adaptive sketches (ada-sketches) for summarizing data streams SIGMOD 2016

Range Thresholding on Streams SIGMOD 2016

SABER: Window-Based Hybrid Stream Processing for Heterogeneous Architectures SIGMOD 2016

Scalable Approximate Query Tracking over Highly Distributed Data Streams SIGMOD 2016

Augmented Sketch: Faster and More Accurate Stream Processing SIGMOD 2016

Quality-driven disorder handling for m-way sliding window stream joins ICDE 2016

When two choices are not enough: Balancing at scale in Distributed Stream Processing ICDE 2016

Paper List of 2017

Toward High-Performance Distributed Stream Processing via Approximate Fault ToleranceVLDB 2017

Computing Longest Increasing Subsequences over Sequential Data StreamsVLDB 2017

Finding Persistent Items in Data StreamsVLDB 2017

Estimating Quantiles from the Union of Historical and Streaming DataVLDB 2017

A Holistic View of Stream Partitioning CostsVLDB 2017

Pyramid Sketch: a Sketch Framework for Frequency Estimation of Data StreamsVLDB 2017

Samza: Stateful Scalable Stream Processing at LinkedInVLDB 2017

State Management in Apache FlinkVLDB 2017

Dhalion: Self-Regulating Stream Processing in HeronVLDB 2017

Twitter Heron: Towards Extensible Streaming Engines ICDE 2017

Integrative Dynamic Reconfiguration in a Parallel Stream Processing Engine ICDE 2017

Monitoring the Top-m Rank Aggregation of Spatial Objects in Streaming Queries ICDE 2017

Revisiting the Design of Data Stream Processing Systems on Multi-Core Processors ICDE 2017

Distributed Publish/Subscribe Query Processing on the Spatio-Textual Data Stream ICDE 2017

Drizzle: Fast and adaptable stream processing at scale SOSP 2017

Paper List of 2018

Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing SystemsVLDB 2018

Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM StreamsVLDB 2018

Providing Streaming Joins as a Service at FacebookVLDB 2018

Megaphone: Latency-conscious state migration for distributed streaming dataflowsVLDB 2018

Cold Filter: A Meta-Framework for Faster and More Accurate Stream Processing SIGMOD 2018

Distinct Sampling on Streaming Data with Near-Duplicates PODS 2018

Data Streams with Bounded Deletions PODS 2018

Waterwheel: Realtime Indexing and Temporal Range Query Processing over Massive Data Streams ICDE 2018

FAST: Frequency-Aware Indexing for Spatio-Textual Data Streams ICDE 2018

List of Classic Papers

Exploiting k-constraints to reduce memory overhead in continuous queries over data streams TODS 2004

Approximate join processing over data streams SIGMOD 2003

Evaluating Window Joins over Punctuated Streams CIKM 2003

Adaptive load shedding for windowed stream joins CIKM 2005

Evaluating window joins over unbounded streams ICDE 2003

How soccer players would do stream joins SIGMOD 2011

The design of the borealis stream processing engine CIDR 2005

Streaming queries over streaming data VLDB 2002

S4: Distributed stream computing platform ICDMW 2010

Characterizing memory requirements for queries over continuous data streams TODS 2004

Processing sliding window multi-joins in continuous queries over data streams VLDB 2003

Scalable stream join processing with expensive predicates: workload distribution and adaptation by time-slicing EDBT 2009

SQPR: Stream query planning with reuse ICDE 2011

Query planning for continuous aggregation queries over a network of data aggregators TKDE 2012

Dynamic query evaluation plans

Optimization of dynamic query evaluation plans SIGMOD 1994