Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch insert into CK but get more records. #84

Closed
sogngenWang opened this issue Apr 8, 2019 · 1 comment
Closed

Batch insert into CK but get more records. #84

sogngenWang opened this issue Apr 8, 2019 · 1 comment

Comments

@sogngenWang
Copy link

JDBC version in pom.xml

com.github.housepower clickhouse-native-jdbc 1.6-stable net.jpountz.lz4 lz4

ClickHouse version

ru.yandex.clickhouse clickhouse-jdbc 0.1.52 net.jpountz.lz4 lz4 guava com.google.guava

Error logs

no error logs

Steps to reproduce

I use Java language.
First, I use spark to query Hive table to produce a DataSet.Which count is 2w record.
Then, I use spark.forearchPartition ,and use iterator to insert into ck which is preparestatement ,and I count the number I have inserted . It's also 20000 record.
Finally, when the job have completed, there is no error logs. It seems every thing is ok (Because I have catch all exception and print messages but get nothing error). But when I query clickhouse use client , it show it has 360736 record in db.

Other descriptions

At first, I use distribute table , and I thought it is the reason which cause this problem . Then I alter the target table as a normal table,but it has no use. And I have try to insert about 17,000,000 record to a distribute table ,but I query about 200,000,000+ records in clickhouse client.

@zhang2014
Copy link
Contributor

there is a conflict between clickhouse-jdbc and clickhouse-native-jdbc, which means you can only select one dependency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants