Commits on Jul 3, 2022

1. [HUDI-3730] Improve meta sync class design and hierarchies (apache#5754) …

   
   Co-authored-by: jian.feng <fengjian428@gmial.com>
   Co-authored-by: jian.feng <jian.feng@shopee.com>

   

   3 people authored and xushiyan committed Jul 3, 2022
   Copy the full SHA

   d4cd131 View commit details

   Browse the repository at this point in the history

2. [HUDI-3730] Refactor metasync classes

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   aa60621 View commit details

   Browse the repository at this point in the history

3. fix usage in hudi-sync/hudi-hive-sync

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   783d8bd View commit details

   Browse the repository at this point in the history

4. fix usage in hudi-sync/hudi-hive-sync

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   f54c59f View commit details

   Browse the repository at this point in the history

5. renaming

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   797bb26 View commit details

   Browse the repository at this point in the history

6. renaming

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   151cdda View commit details

   Browse the repository at this point in the history

7. move classes

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   62a9c05 View commit details

   Browse the repository at this point in the history

8. fix usage in datahub sync and aws glue sync

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   a0ac3ad View commit details

   Browse the repository at this point in the history

9. fix usage in gcp sync

   

   xushiyan committed Jul 3, 2022
   Copy the full SHA

   76da5d3 View commit details

   Browse the repository at this point in the history

10. fix usage in adb sync

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    f0f8020 View commit details

    Browse the repository at this point in the history

11. fix usage

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    a736c79 View commit details

    Browse the repository at this point in the history

12. move back part extractors

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    60f52cd View commit details

    Browse the repository at this point in the history

13. fix UT in adb sync

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    51a1a00 View commit details

    Browse the repository at this point in the history

14. remove interfaces

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    ca40034 View commit details

    Browse the repository at this point in the history

15. fix import

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    ec67ad5 View commit details

    Browse the repository at this point in the history

16. fix java boolean type

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    47a5af3 View commit details

    Browse the repository at this point in the history

17. fix style

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    65cd6ed View commit details

    Browse the repository at this point in the history

18. adjust sync tool constructor

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    69c7e25 View commit details

    Browse the repository at this point in the history

19. more fixes

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    97e7dd8 View commit details

    Browse the repository at this point in the history

20. [HUDI-3730] fix TestHiveSyncContext

    

    jian.feng authored and xushiyan committed Jul 3, 2022
    Copy the full SHA

    6cacee9 View commit details

    Browse the repository at this point in the history

21. use setPropertyIfNonNull

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    fa7c496 View commit details

    Browse the repository at this point in the history

22. fix SyncUtilHelpers

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    11d3df9 View commit details

    Browse the repository at this point in the history

23. fix license SparkDataSourceTableUtils

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    f4bd48e View commit details

    Browse the repository at this point in the history

24. remove unused method and test

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    5ee4227 View commit details

    Browse the repository at this point in the history

25. fix spark datasource options NPE

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    5fd03d3 View commit details

    Browse the repository at this point in the history

26. [WIP][Hudi 3730] fix u ts (#10)

    

    fengjian428 authored and xushiyan committed Jul 3, 2022
    Copy the full SHA

    0ba5d62 View commit details

    Browse the repository at this point in the history

27. Hudi 3730 u tsfixand add (#11) …

    * [HUDI-3730] fix TestHiveSyncTool
    
    * [HUDI-3730] fix TestHiveSyncTool : getHiveConf, getDefaultValue
    
    * [HUDI-3730] fix TestHiveSyncTool : Use TypedProperties in internal method, getDefaultValue
    
    Co-authored-by: jian.feng <jian.feng@shopee.com>

    

    2 people authored and xushiyan committed Jul 3, 2022
    Copy the full SHA

    0406f1d View commit details

    Browse the repository at this point in the history

28. more fixes

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    709ff4a View commit details

    Browse the repository at this point in the history

29. more fix

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    2b17c2c View commit details

    Browse the repository at this point in the history

30. temp disable TestHiveSyncGlobalCommitTool

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    7c16293 View commit details

    Browse the repository at this point in the history

31. use HiveSyncConfigHolder to avoid import problem in spark datasource

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    6b1f81b View commit details

    Browse the repository at this point in the history

32. fix configs

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    ea40d50 View commit details

    Browse the repository at this point in the history

33. fix npe

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    bc3dff3 View commit details

    Browse the repository at this point in the history

34. revert SerializableConfiguration and use Configuration

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    39c05d2 View commit details

    Browse the repository at this point in the history

35. temp disable ITTestHoodieDataSource

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    86866ff View commit details

    Browse the repository at this point in the history

36. fix datahub sync config

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    73fd717 View commit details

    Browse the repository at this point in the history

37. add ut in datahub sync config

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    0193b00 View commit details

    Browse the repository at this point in the history

38. [HUDI-3730] fix global tools UT (#12) …

    * [HUDI-3730] fix global tools UT
    
    * [HUDI-3730] fix global tools UT
    
    Co-authored-by: jian.feng <jian.feng@shopee.com>

    

    2 people authored and xushiyan committed Jul 3, 2022
    Copy the full SHA

    802015e View commit details

    Browse the repository at this point in the history

39. revert IT disable

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    982bc22 View commit details

    Browse the repository at this point in the history

40. fix get database name

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    7c945de View commit details

    Browse the repository at this point in the history

41. fix multiple help args issue

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    7cc5fa0 View commit details

    Browse the repository at this point in the history

42. fix IT

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    b38bc32 View commit details

    Browse the repository at this point in the history

43. remove metasync interface

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    acf3943 View commit details

    Browse the repository at this point in the history

44. [HUDI-3730] add global tools UT (#13) …

    Co-authored-by: jian.feng <jian.feng@shopee.com>

    

    2 people authored and xushiyan committed Jul 3, 2022
    Copy the full SHA

    6305914 View commit details

    Browse the repository at this point in the history

45. fix style

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    9757ddf View commit details

    Browse the repository at this point in the history

46. fix rebase

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    3565896 View commit details

    Browse the repository at this point in the history

47. address comments

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    0091988 View commit details

    Browse the repository at this point in the history

48. add a UT and docs

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    712cf9c View commit details

    Browse the repository at this point in the history

49. fix getStorageSchema() impl. and remove redundant docs

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    55b7bc1 View commit details

    Browse the repository at this point in the history

50. remove deprecated scanTablePartitions()

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    9b072f3 View commit details

    Browse the repository at this point in the history

51. use static imports

    

    xushiyan committed Jul 3, 2022
    Copy the full SHA

    c95a9d1 View commit details

    Browse the repository at this point in the history