-
Notifications
You must be signed in to change notification settings - Fork 132
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
hi,i just follow you steps to compile ,install indexR .after finished, i just insert data by hive,and then i use drill to scan data,no data return.do you know why? the log has no error #14
Comments
|
@flowbehappy the account zhang110912 is others i just use temporary. extra info : the drill version is 1.9.0 |
Then you should specified properties in
And make sure you have synchronized among all drillbit nodes and indexr-tool. |
@flowbehappy yes ,i had configured the location of hdfs , and i make sure the conf among all drillbit nodes are same ,the indexr-tool also. |
Can you post your hive create table schema, IndexR table schema, and the And print all files under table location path. e.g. |
the hive create table schema:the indexr.config .properties is :indexr.zk.addr=host-170-12:2181,host-170-13:2181,host-170-14:2181 the schema is :{ the detail of drill query:the location of table test:the log is :Apache Drill Tue Jan 17 08:54:47 CST 2017 Terminating drillbit pid 24818 Intermediate Configuration and Plugin files, in order of precedence: Override File: file:/home/zhou/apache-drill-1.9.0/conf/drill-override.conf 2017-01-17 08:55:05,367 [main] DEBUG o.a.drill.common.config.DrillConfig - Setting up DrillConfig object. 2017-01-17 08:55:07,367 [main] DEBUG o.a.drill.exec.rpc.user.UserServer - Server of type UserServer started on port 31010. 2017-01-17 08:55:07,482 [main] INFO o.a.d.c.s.persistence.ScanResult - loading 65 classes for org.apache.drill.exec.physical.base.PhysicalOperator took 39ms 2017-01-17 08:55:09,047 [main] INFO o.a.d.c.s.persistence.ScanResult - loading 6 classes for org.apache.drill.exec.store.dfs.FormatPlugin took 0ms 2017-01-17 08:55:09,051 [main] INFO o.a.d.c.s.persistence.ScanResult - loading 7 classes for org.apache.drill.common.logical.FormatPluginConfig took 0ms 2017-01-17 08:55:09,051 [main] INFO o.a.d.c.s.persistence.ScanResult - loading 7 classes for org.apache.drill.common.logical.FormatPluginConfig took 0ms 2017-01-17 08:55:09,790 [main] INFO o.a.d.e.s.indexr.IndexRStoragePlugin - Plugin started 2017-01-17 08:55:09,907 [Curator-ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Got cache changed --> updating endpoints 2017-01-17 08:55:09,912 [Curator-ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Got cache changed --> updating endpoints 2017-01-17 08:55:09,922 [Curator-ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Got cache changed --> updating endpoints 2017-01-17 08:55:09,938 [Curator-ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Got cache changed --> updating endpoints 2017-01-17 08:55:09,946 [main] INFO o.a.drill.exec.server.rest.WebServer - Setting up HTTP connector for web server 2017-01-17 08:55:10,009 [Curator-ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Got cache changed --> updating endpoints 2017-01-17 08:55:10,171 [Curator-ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Got cache changed --> updating endpoints 2017-01-17 08:55:10,204 [Curator-ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Got cache changed --> updating endpoints 2017-01-17 08:55:10,731 [main] INFO o.apache.drill.exec.server.Drillbit - Startup completed (3420 ms). 2017-01-17 08:55:52,962 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] INFO o.a.d.c.s.persistence.ScanResult - loading 7 classes for org.apache.drill.common.logical.FormatPluginConfig took 0ms 2017-01-17 08:55:52,962 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] INFO o.a.d.c.s.persistence.ScanResult - loading 7 classes for org.apache.drill.common.logical.FormatPluginConfig took 0ms 2017-01-17 08:55:53,076 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.drill.exec.store.SchemaFactory - Took 141 ms to register schemas. 2017-01-17 08:55:53,470 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.p.s.h.DefaultSqlHandler - HEP:Window Function rewrites (20ms): 2017-01-17 08:55:53,477 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.p.s.h.DefaultSqlHandler - HEP_BOTTOM_UP:Directory Prune Planning (5ms): 2017-01-17 08:55:53,530 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.s.indexr.ScanWrokProvider - =============== calStat totalRowCount:1, passRowCount:1, passPackCount:1, statScanRowCount:1, maxPw: 2 2017-01-17 08:55:53,552 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.store.indexr.IndexRGroupScan - =============== getScanStats, scanRowCount: 1 2017-01-17 08:55:53,553 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.store.indexr.IndexRGroupScan - =============== getScanStats, scanRowCount: 1 2017-01-17 08:55:53,554 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.store.indexr.IndexRGroupScan - =============== getScanStats, scanRowCount: 1 2017-01-17 08:55:53,597 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.store.indexr.IndexRGroupScan - =============== getMaxParallelizationWidth 2 2017-01-17 08:55:53,610 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.store.indexr.IndexRGroupScan - =============== getScanStats, scanRowCount: 1 2017-01-17 08:55:53,620 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.store.indexr.IndexRGroupScan - =============== getScanStats, scanRowCount: 1 2017-01-17 08:55:53,628 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.store.indexr.IndexRGroupScan - =============== getScanStats, scanRowCount: 1 2017-01-17 08:55:53,763 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.e.p.f.SimpleParallelizer - Remote fragment: 2017-01-17 08:55:53,763 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.d.exec.rpc.control.WorkEventBus - Adding fragment status listener for queryId 27829467-0663-aa9b-bac3-7144f9d76eaf. Data: 2017-01-17 08:55:53,869 [27829467-0663-aa9b-bac3-7144f9d76eaf:foreman] DEBUG o.a.drill.exec.work.foreman.Foreman - 27829467-0663-aa9b-bac3-7144f9d76eaf: State change requested STARTING --> RUNNING 2017-01-17 08:55:54,206 [CONTROL-rpc-event-queue] DEBUG o.a.d.exec.rpc.control.ControlServer - Sending response with Sender 1644047567 2017-01-17 08:55:54,736 [CONTROL-rpc-event-queue] DEBUG o.a.d.exec.work.foreman.QueryManager - Foreman is still waiting for completion message from 1 nodes containing 2 fragments 2017-01-17 08:55:54,773 [CONTROL-rpc-event-queue] DEBUG o.a.d.exec.rpc.control.ControlServer - Sending response with Sender 716621325 2017-01-17 08:55:55,134 [27829467-0663-aa9b-bac3-7144f9d76eaf:frag:0:0] DEBUG o.a.d.exec.compile.ClassTransformer - Done compiling (bytecode size=986 B, time:188 millis). 2017-01-17 08:55:55,153 [CONTROL-rpc-event-queue] DEBUG o.a.drill.exec.work.foreman.Foreman - 27829467-0663-aa9b-bac3-7144f9d76eaf: State change requested RUNNING --> COMPLETED |
Looks like you have misconfigured
According to your hive create table schema, it should be
|
@flowbehappy |
Please make sure hive table location and IndexR table location are pointed to the same direction. Otherwise they cannot see each other. Also check your core-site.xml and hdfs-site.xml in both Hive and Drill. Make sure they are in the same Hadoop system. |
hi, the same error occurs to me, but I cannot find the way to solve this problem. my indexr.config.properties everywhere is the same, and hive works well. I insert data in hive , query them successfully, but get an empty talbe in drill, i.e, return nothing. please help me! |
a log info maybe help you infer the issue:
warn :o.a.d.e.s.i.IndexRScanBatchCreator- ==========subScan fragment 0 have not record reader to assign .
any response will be aprreciated
The text was updated successfully, but these errors were encountered: