Skip to content

api-evangelist/apache-spark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 

Repository files navigation

Apache Spark (apache-spark)

Apache Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Java, Scala, Python and R, and an optimized engine that supports general execution graphs.

URL: Visit APIs.json URL

Tags:

  • big data, analytics, distributed computing, machine learning, streaming, apache

Timestamps

  • Created: 2024-01-01
  • Modified: 2024-01-01

APIs

Apache Spark REST API

REST API for monitoring Spark applications, accessing cluster information, and managing Spark jobs through the Spark UI backend.

Human URL: https://spark.apache.org/docs/latest/monitoring.html

Tags:

  • monitoring, metrics, jobs, stages

Properties

Spark SQL API

Spark module for structured data processing with DataFrame and Dataset APIs. Provides SQL interface and supports various data sources.

Human URL: https://spark.apache.org/sql/

Tags:

  • sql, dataframes, structured data

Properties

Spark Streaming API

Scalable, high-throughput, fault-tolerant stream processing of live data streams.

Human URL: https://spark.apache.org/streaming/

Tags:

  • streaming, real-time, data processing

Properties

MLlib (Machine Learning Library)

Spark's scalable machine learning library consisting of common learning algorithms and utilities, including classification, regression, clustering, and collaborative filtering.

Human URL: https://spark.apache.org/mllib/

Tags:

  • machine learning, algorithms, ml, data science

Properties

GraphX API

Spark API for graphs and graph-parallel computation with a collection of graph algorithms and builders.

Human URL: https://spark.apache.org/graphx/

Tags:

  • graphs, graph processing, analytics

Properties

Common Properties

Maintainers

FN: Apache Software Foundation

Email: dev@spark.apache.org

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors