Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
87 changes: 75 additions & 12 deletions docs/en/cloud/manage/jan2025_faq/dimensions.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,38 +29,101 @@ Data transfer and ClickPipes pricing will not apply to legacy plans, i.e. Develo

Data transfer prices will **not** be tiered as usage increases. Note that the pricing varies by region and cloud service provider.

## ClickPipes Pricing
## ClickPipes Pricing FAQ

### Why are we introducing a pricing model for ClickPipes now?

To offer a reliable, large-scale, data ingestion service we decided to initially launch ClickPipes for free. The idea was to gather feedback, refine features, and ensure it meets user needs. As the platform has grown and effectively stood the test of time by moving trillions of rows, introducing a pricing model allows us to continue improving the service, maintaining the infrastructure, and providing dedicated support and new connectors.
We decided to initially launch ClickPipes for free with the idea to gather feedback, refine features,
and ensure it meets user needs.
As the GA platform has grown and effectively stood the test of time by moving trillions of rows,
introducing a pricing model allows us to continue improving the service,
maintaining the infrastructure, and providing dedicated support and new connectors.

### What are ClickPipes replicas?

ClickPipes ingests data from remote data sources via a dedicated infrastructure
that runs and scales independently of the ClickHouse Cloud service.
For this reason, it uses dedicated compute replicas.
The diagrams below show a simplified architecture.

For streaming ClickPipes, ClickPipes replicas access the remote data sources (e.g., a Kafka broker),
pull the data, process and ingest it into the destination ClickHouse service.

![ClickPipes Replicas - Streaming ClickPipes](images/external_clickpipes_pricing_faq_1.png)

In the case of object storage ClickPipes,
the ClickPipes replica orchestrates the data loading task
(identifying files to copy, maintaining the state, and moving partitions),
while the data is pulled directly from the ClickHouse service.

![ClickPipes Replicas - Object Storage ClickPipes](images/external_clickpipes_pricing_faq_2.png)

### What is the default number of replicas and their size?

Each ClickPipe defaults to 1 replica that is provided with 2 GiB of RAM and 0.5 vCPU.
This corresponds to **0.25** ClickHouse compute units (1 unit = 8 GiB RAM, 2 vCPUs).

### Can ClickPipes replicas be scaled?

Currently, only ClickPipes for streaming can be scaled horizontally
by adding more replicas each with a base unit of **0.25** ClickHouse compute units.
Vertical scaling is also available on demand for specific use cases (adding more CPU and RAM per replica).

### How many ClickPipes replicas do I need?

It depends on the workload throughput and latency requirements.
We recommend starting with the default value of 1 replica, measuring your latency, and adding replicas if needed.
Keep in mind that for Kafka ClickPipes, you also have to scale the Kafka broker partitions accordingly.
The scaling controls are available under “settings” for each streaming ClickPipe.

![ClickPipes Replicas - How many ClickPipes replicas do I need?](images/external_clickpipes_pricing_faq_3.png)

### What does the ClickPipes pricing structure look like?

It consists of two dimensions:

* **Compute**: Price per unit per hour. Compute represents the cost of running the ClickPipes replicas, whether they actively ingest data or not. It applies to all ClickPipes types.
* **Ingested data**: per GB pricing. The ingested data rate applies to all streaming ClickPipes (Kafka, Confluent, Amazon MSK, Amazon Kinesis, Redpanda, WarpStream, and Azure Event Hubs) for the data transferred via the replica pods.
- **Compute**: Price per unit per hour
Compute represents the cost of running the ClickPipes replica pods whether they actively ingest data or not.
It applies to all ClickPipes types.
- **Ingested data**: per GB pricing
The ingested data rate applies to all streaming ClickPipes
(Kafka, Confluent, Amazon MSK, Amazon Kinesis, Redpanda, WarpStream,
Azure Event Hubs) for the data transferred via the replica pods.
The ingested data size (GB) is charged based on bytes received from the source (uncompressed or compressed).

### What are the ClickPipes public prices?

- Compute: `$0.20` per unit per hour
- Ingested data: `$0.04` per GB
- Compute: \$0.20 per unit per hour ($0.05 per replica per hour)
- Ingested data: $0.04 per GB

### How does it look in an illustrative example?

For example, ingesting 1 TB of data over 24 hours using the Kafka connector using a single replica (0.25 compute unit) will cost:

`0.25 x 0.20 x 24 + 0.04 x 1000 = $41.2`
$$
(0.25 \times 0.20 \times 24) + (0.04 \times 1000) = \$41.2
$$

For object storage connectors (S3 and GCS), only the ClickPipes compute cost is incurred since the ClickPipes pod is not processing data but only orchestrating the transfer, which is operated by the underlying ClickHouse service:
For object storage connectors (S3 and GCS),
only the ClickPipes compute cost is incurred since the ClickPipes pod is not processing data
but only orchestrating the transfer which is operated by the underlying ClickHouse service:

`0.25 x 0.20 x 24 = $1.2`
$$
0.25 \times 0,20 \times 24 = \$1.2
$$

### When does the new pricing model take effect?

The new pricing model will take effect for all organizations created after **January 27th, 2025**.
The new pricing model will take effect for all organizations created after January 27th, 2025.

### What happens to current users?

Existing users that have not migrated to the new plan will have a **8 week grace period** during which the ClickPipes service will continue to be offered for free. Billing will automatically start for ClickPipes for existing users on **March 24th, 2025.**
Existing users will have a **60-day grace period** where the ClickPipes service continues to be offered for free.
Billing will automatically start for ClickPipes for existing users on **March 24th, 2025.**

### How does ClickPipes pricing compare to the market?

The philosophy behind ClickPipes pricing is
to cover the operating costs of the platform while offering an easy and reliable way to move data to ClickHouse Cloud.
From that angle, our market analysis revealed that we are positioned competitively.


Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.