[SUPPORT] hive2.1.1 MR cannot be queried based on hive partition

[liujinhui1994]

Tips before filing an issue

• Have you gone through our FAQs?

• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.

• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced

A clear and concise description of the problem.

To Reproduce

Steps to reproduce the behavior:

1. Synchronize a hudi partition table
2. select * from table where ds=‘2020-03-08’
3. It is found that no results are returned, but the results can be seen using spark

Expected behavior

A clear and concise description of what you expected to happen.

Environment Description

• Hudi version : 0.6.0 or 0.7.0 or 0.8.0

• Spark version : 2.4.4

• Hive version :2.1.1

• Hadoop version :3.0.0

• Storage (HDFS/S3/GCS..) :HDFS

• Running on Docker? (yes/no) :否

Additional context

Add any other context about the problem here.

Stacktrace

The query returns no results

[bvaradar]

Can you enable INFO/DEBUG logs on Hive side and add logs. Can you also provide description of the table 'desc formateed <table_name>' in hive and the listing of .hoodie folder ?

[nsivabalan]

@liujinhui1994 : Can you provide the details that Balaji have asked.
Also, few clarifications.

1. You mean to say that, if you don't provide any partition filters ("select * from table") in hive, it works. But only when you provide a partition filter(select * from table where ds=‘2020-03-08’), you don't see any results. Is my understanding right?
2. Have you tried listing all partitions for Hudi Table in hive using beeline or some other tool. Can you paste the output.
3. Can you provide us w/ all hive sync related configs you set with hudi while writing.
4. How is hive sync executed? do you use standalone Hive sync tool, or do you enable hive sync as part of hudi write.

once you respond, can you please remove "awaiting-user-response" label for the issue. If possible add "awaiting-community-help" label.

[n3nash]

@liujinhui1994 Are you able to provide information that @nsivabalan and @bvaradar have asked ? We can help triage this issue, if not, I will close this ticket soon.

[liujinhui1994]

It seems that it can be closed first. Recently we mainly use spark/presto. If I meet later, I will find a way to locate it in detail. Thank you for your attention.
@n3nash