-
Notifications
You must be signed in to change notification settings - Fork 89
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Initial add TableStore streaming source #366
Conversation
emr-tablestore/pom.xml
Outdated
@@ -18,7 +18,7 @@ | |||
<dependency> | |||
<groupId>org.apache.spark</groupId> | |||
<artifactId>spark-core_${scala.binary.version}</artifactId> | |||
<scope>provided</scope> | |||
<scope>provided</scope> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
indent
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fixed
emr-tablestore/.scalafmt.conf
Outdated
@@ -0,0 +1,9 @@ | |||
version=2.0.0-RC5 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This file can be deleted?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fixed
@@ -0,0 +1,13 @@ | |||
package org.apache.spark.sql.aliyun.tablestore |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
missing license header
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
all files add license header
jCols.obj.map { case (name, jvalue) => | ||
(name, jvalue.values.asInstanceOf[Map[String, String]]) | ||
jCols.obj.map { | ||
case (name, jvalue) => |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
minor: previous code style is just ok
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
checkout to the previous version
)(@transient val sqlContext: SQLContext) extends Sink with Logging { | ||
)(@transient val sqlContext: SQLContext) | ||
extends Sink | ||
with Logging { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
minor: keep the previous code style here and other places
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
import com.alicloud.openservices.tablestore.model.tunnel.internal.{ | ||
CheckpointRequest, | ||
GetCheckpointRequest | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
minor: keep in same line
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
cbddf67
to
f4d3636
Compare
LGTM,thanks |
Initial add TableStore streaming source