Skip to content

Commit

Permalink
Preparing the draft for Jet chapter.
Browse files Browse the repository at this point in the history
  • Loading branch information
Serdaro committed Oct 25, 2017
1 parent df711fa commit a69b96f
Show file tree
Hide file tree
Showing 2 changed files with 31 additions and 0 deletions.
1 change: 1 addition & 0 deletions documentation.index
Original file line number Diff line number Diff line change
Expand Up @@ -107,6 +107,7 @@ src/DistributedQuery.md
src/FastAggregations.md
src/Projections.md
src/ContinuousQueryCache.md
src/HazelcastJet.md
src/Transactions.md
src/XATransactions.md
src/JCache.md
Expand Down
30 changes: 30 additions & 0 deletions src/HazelcastJet.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@


# Hazelcast Jet

![Note](images/NoteSmall.jpg) ***NOTE:*** *This chapter briefly describes Hazelcast Jet. For detailed information and Jet documentation, please visit [jet.hazelcast.org](https://jet.hazelcast.org/).*


Hazelcast Jet, an Apache 2 licensed open source project and built on top of the Hazelcast IMDG platform, is a distributed processing engine for large data sets. With Hazelcast IMDG providing storage functionality, Jet performs parallel execution to enable data-intensive applications to operate in near real-time. This parallel execution is achieved by using green threads (threads that are scheduled by a runtime library or VM) to optimize the utilization of the computing resources. Jet uses directed acyclic graphs (DAG) to model the relationships between individual steps of the data processing. Therefore, it can execute both batch- and stream-based data processing applications.

Hazelcast Jet is appropriate for applications that require a near real-time experience such as sensor updates in IoT architectures (house thermostats, lighting systems, etc.), in-store e-commerce systems and social media platforms. Typical use cases include the following:

- Real-time (low-latency) stream processing
- Implementing Change Data Capture (CDC)
- Moving from batch to stream processing
- Fast batch processing
- Internet-of-things (IoT) data ingestion, processing and storage
- Data processing microservice architectures

The aforementioned applications produce massive amounts of data that need near real-time processing. Hazelcast Jet achieves this by processing the incoming records as soon as possible, hence lowering the latency, and ingesting the data at high-velocity. Execution model of Jet and keeping both the computation and data storage in memory enables breakthrough application speeds. Since Jet uses Hazelcast IMDG’s discovery mechanisms, it can be used both on-premises and cloud environments.

Following is the logical architecture of Hazelcast Jet

image







0 comments on commit a69b96f

Please sign in to comment.