frankmcsherry
Follow
Create your own GitHub profile
Sign up for your own profile on GitHub, the best place to host code, manage projects, and build software alongside 50 million developers.
Sign up
Popular repositories
999 contributions in the last year
Contribution activity
October 2020
Created a pull request in MaterializeInc/materialize that received 5 comments
Use MapFilterProject and arrangement keys for fast path queries
Our fast path queries are able to directly read values out of arrangements when the query has a certain "easy" structure. This PR broadens that str…
+213
−200
•
5
comments
- better move filters between dataflows
- re-use allocation for quickselect
- Reintroduce filter and projection in dataflow
- WIP: use filters to index into arrangement
- [coord] Determine only valid timestamps
- Deduplicate expressions in group key
- Clear predicates for bare `Get` expressions
- Clear predicate pushdown for unguarded gets
- wip: start pushing down projections
- Diagnostic queries doc: Add section for looking for skewed operators.
- wip: pushdown mfp
- sql: remove dead materialized parameter for peeks
- Don't reuse a RowArena for MapFilterProject
- dataflow: optimize TopK memory usage
- Joins: Use the new struct in various transformations.
- dataflow: optimize reduce memory usage.
- Fuse Map/Filter/Project operators on top of a Get
- Create a join utility to avoid repeating code everywhere in joins.
- coord: document antichain assumption
- Deduplicate expressions in group key
- WIP Enable converting filter -> join when an index is available.
Created an issue in MaterializeInc/materialize that received 3 comments
Reduce duplication between keys and rows of an arrangement.
Our arrangements arrange data by a key, maintaining the whole row because that is the plan. However, in cases where we don't have good information …
3
comments