Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CARBONDATA-1048] Updated Hive Guide #912

Closed
wants to merge 1 commit into from

Conversation

anubhav100
Copy link
Contributor

No description provided.

@asfbot
Copy link

asfbot commented May 12, 2017

Can one of the admins verify this patch?

2 similar comments
@asfbot
Copy link

asfbot commented May 12, 2017

Can one of the admins verify this patch?

@asfbot
Copy link

asfbot commented May 12, 2017

Can one of the admins verify this patch?

@CarbonDataQA
Copy link

Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2019/

@CarbonDataQA
Copy link

Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2020/

@anubhav100 anubhav100 changed the base branch from hive to master May 26, 2017 18:59
@anubhav100 anubhav100 changed the base branch from master to hive May 26, 2017 19:02
add hive integration to assembly

alter CarbonInputFormat to implement mapred.InputFormat

add a hive serde for carbon

add hive integration to assembly

fix error in getQueryModel

add debug info

add debug info

add debug info

add debug info

fix error in CarbonRecordReader

use ArrayWritable for CarbonRecordReader

fix error in initializing CarbonRecordReader

fix error in initializing CarbonRecordReader

fix error in initializing CarbonRecordReader

fix error in initializing CarbonRecordReader

修改InputFormat的返回值

把需要查的列设置到carbon里去

fix nullpoint exception

add catalyst depedency

add catalyst depedency

add catalyst depedency

fix error in intializing carbon error

add a new hive carbon recordreader

添加把object序列化成ArrayWritable的代码

short/int等数据类型在Carbon当中实际上是Long类型

use right inspector

use right inspector

fix long can't cast int error

fix decimal cast error

column size is not equal to column type

column size is not equal to column type

column size is not equal to column type

column size is not equal to column type

fix ObjInspector error

fix ObjInspector error

fix ObjInspector error

add a new hive input split

should not combine path

add support for timestamp

clean codes

remove unused codes

support Date and TimeStamp type

add basic hive integration

alter code style

alter code style

alter code style

alter code style

change create table statement

alter CarbonSerde test case

alter CarbonSerde test case

add carbondata-hive to test classpath

add carbondata-hive to test classpath

use hive compatible schema

exclude kryo

exclude kryo

make a new profile for hive 1.2.1

remove carbon-hive from parent and assembly pom

use groupId to apache hive in pom.xml

remote hadoop-yarn-api, but HadoopFileExample will throw exception when debugging in IDEA

change profile name

add quick start guide for basic hive integration module

add private for properties

add some params for hive to read subdirectories recursively
@anubhav100 anubhav100 changed the base branch from hive to master May 26, 2017 19:05
@asfbot
Copy link

asfbot commented May 26, 2017

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/carbondata-pr-spark-2.1/168/

@asfbot
Copy link

asfbot commented May 26, 2017

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/carbondata-pr-spark-2.1/169/

@asfbot
Copy link

asfbot commented May 26, 2017

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/carbondata-pr-spark-2.1/172/

@asfbot
Copy link

asfbot commented May 26, 2017

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/carbondata-pr-spark-1.6/166/

Build result: ABORTED

[...truncated 703.76 KB...]17/05/26 12:33:56 AUDIT UnsafeInmemoryHolder: [qnode3.quenda.co][jenkins][Thread-10210]Processing unsafe inmemory rows page with size : 2200017/05/26 12:33:56 AUDIT UnsafeInmemoryHolder: [qnode3.quenda.co][jenkins][Thread-10210]Processing unsafe inmemory rows page with size : 2200017/05/26 12:33:56 AUDIT UnsafeInmemoryHolder: [qnode3.quenda.co][jenkins][Thread-10210]Processing unsafe inmemory rows page with size : 2200017/05/26 12:33:56 AUDIT UnsafeInmemoryHolder: [qnode3.quenda.co][jenkins][Thread-10210]Processing unsafe inmemory rows page with size : 200017/05/26 12:33:57 AUDIT CarbonDataRDDFactory$: [qnode3.quenda.co][jenkins][Thread-1]Data load is successful for default.carbon_load517/05/26 12:33:58 AUDIT CarbonDataRDDFactory$: [qnode3.quenda.co][jenkins][Thread-1]Data load request has been received for table default.carbon_load517/05/26 12:34:00 AUDIT CarbonDataRDDFactory$: [qnode3.quenda.co][jenkins][Thread-1]Data load is successful for default.carbon_load517/05/26 12:34:02 AUDIT CarbonDataRDDFactory$: [qnode3.quenda.co][jenkins][Thread-1]Compaction request received for table default.carbon_load5Build timed out (after 70 minutes). Marking the build as aborted.[WARNING] Failed to notify spy hudson.maven.Maven3Builder$JenkinsEventSpy: java.util.concurrent.ExecutionException: Invalid object ID 16 iota=22[WARNING] Failed to notify spy hudson.maven.Maven3Builder$JenkinsEventSpy: java.util.concurrent.ExecutionException: Invalid object ID 16 iota=22Build was abortedchannel stopped[WARNING] Failed to notify spy hudson.maven.Maven3Builder$JenkinsEventSpy: hudson.remoting.Channel$OrderlyShutdown[INFO] ------------------------------------------------------------------------[INFO] Reactor Summary:[INFO] [INFO] Apache CarbonData :: Parent ........................ SUCCESS [ 12.891 s][INFO] Apache CarbonData :: Common ........................ SUCCESS [ 13.722 s][INFO] Apache CarbonData :: Core .......................... SUCCESS [03:08 min][INFO] Apache CarbonData :: Processing .................... SUCCESS [ 45.322 s][INFO] Apache CarbonData :: Hadoop ........................ SUCCESS [ 31.739 s]Setting status of 58a65a7 to FAILURE with url https://builds.apache.org/job/carbondata-pr-spark-1.6/166/ and message: 'Build finished. 'Using context: Jenkins (Spark 1.6): Maven clean install

@asfbot
Copy link

asfbot commented May 26, 2017

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/carbondata-pr-spark-1.6/167/

Build result: ABORTED

[...truncated 741.53 KB...] at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)Caused by: org.apache.maven.plugin.MojoFailureException: Timed out after 0 seconds waiting for forked process to complete. at org.scalatest.tools.maven.AbstractScalaTestMojo.runForkingOnce(AbstractScalaTestMojo.java:319) at org.scalatest.tools.maven.AbstractScalaTestMojo.runScalaTest(AbstractScalaTestMojo.java:242) at org.scalatest.tools.maven.TestMojo.execute(TestMojo.java:106) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) ... 31 more[ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging.[ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles:[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException[ERROR] [ERROR] After correcting the problems, you can resume the build with the command[ERROR] mvn -rf :carbondata-spark-common-testchannel stoppedSetting status of 82d3763 to FAILURE with url https://builds.apache.org/job/carbondata-pr-spark-1.6/167/ and message: 'Build finished. 'Using context: Jenkins (Spark 1.6): Maven clean install

@chenliang613
Copy link
Contributor

retest this please

@asfbot
Copy link

asfbot commented May 28, 2017

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/carbondata-pr-spark-2.1/209/
Test PASSed.

@chenliang613
Copy link
Contributor

retest this please

@asfgit
Copy link

asfgit commented Jul 13, 2017

Can one of the admins verify this patch?

1 similar comment
@asfgit
Copy link

asfgit commented Jul 13, 2017

Can one of the admins verify this patch?

@CarbonDataQA
Copy link

Build Success with Spark 1.6, Please check CI http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/476/

@CarbonDataQA
Copy link

Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/3065/

@anubhav100 anubhav100 closed this Jul 13, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants