apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
See what the GitHub community is most excited about today.
Apache Spark - A unified analytics engine for large-scale data processing
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
TheHive: a Scalable, Open Source and Free Security Incident Response Platform
Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
Rocket Chip Generator
Source code for Twitter's Recommendation Algorithm
Lightweight, modular, and extensible library for functional programming.
Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala
Spark RAPIDS plugin - accelerate Apache Spark with GPUs
The Scala 3 compiler, also known as Dotty.
sbt, the interactive build tool
Open-source high-performance RISC-V processor
An Agile RISC-V SoC Design Framework with in-order cores, out-of-order cores, accelerators, and more
The pure asynchronous runtime for Scala
The batteries-included testing and formal verification library for Chisel-based RTL designs.
A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.
An open protocol for secure data sharing
CMAK is a tool for managing Apache Kafka clusters
In-memory dimensional time series database.