Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#4927] improvement(catalog): extract a common HMS module #4928

Merged
merged 2 commits into from
Sep 18, 2024

Conversation

mchades
Copy link
Contributor

@mchades mchades commented Sep 12, 2024

What changes were proposed in this pull request?

extract a common HMS module

Why are the changes needed?

Fix: #4927

Does this PR introduce any user-facing change?

no

How was this patch tested?

CI passed

@mchades mchades force-pushed the hms-module branch 4 times, most recently from 326ec7f to 6fcf97a Compare September 13, 2024 07:08
@mchades mchades force-pushed the hms-module branch 2 times, most recently from 56e46d0 to 9ae4544 Compare September 13, 2024 15:06
datanucleus-core = "4.1.17"
datanucleus-api-jdo = "4.2.4"
datanucleus-rdbms = "4.1.19"
datanucleus-jdo = "3.2.0-m3"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are they just used for test? If not, you should also update the license.bin.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I saw they are already in.

DataNucleus

Apache Derby

sd.getNumBuckets(),
sd.getBucketCols().stream().map(NamedReference::field).toArray(Expression[]::new));
}
Distribution distribution = ConvertUtil.getDistribution(table);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CovertUtil seems not so reasonable, maybe "HiveUtil" or "HiveTableUtil", "HiveTableConverter"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

renamed to HiveTableConverter

import org.apache.gravitino.exceptions.NoSuchPartitionException;
import org.apache.gravitino.hms.miniHMS.MiniHiveMetastoreService;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we change the package name to "o.a.g.hive.hms.xxx", it is weird that the package name has uppercase letters...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

renamed

@@ -16,7 +16,7 @@
* specific language governing permissions and limitations
* under the License.
*/
package org.apache.gravitino.catalog.hive.dyn;
package org.apache.gravitino.hms.dyn;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would change to "xxx.hive.dyn"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

Copy link
Contributor

@jerryshao jerryshao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@jerryshao jerryshao merged commit 3433967 into apache:main Sep 18, 2024
26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Subtask] extract a common HMS module
2 participants