Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[POC][core] GcsClient async binding, aka remove PythonGcsClient. #45289

Draft
wants to merge 28 commits into
base: master
Choose a base branch
from
Draft

[POC][core] GcsClient async binding, aka remove PythonGcsClient. #45289

wants to merge 28 commits into from

Commits on May 23, 2024

  1. POC Gcs Client async binding 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    435d87d View commit details
    Browse the repository at this point in the history

  2. add 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    d853fa6 View commit details
    Browse the repository at this point in the history

  3. internal_kv_get and internal_kv_put and type converters 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    52c0bb2 View commit details
    Browse the repository at this point in the history

  4. add test 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    4a82a95 View commit details
    Browse the repository at this point in the history

  5. split out to a .pxi file 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    2ff561a View commit details
    Browse the repository at this point in the history

  6. cosmetic 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    c2fd255 View commit details
    Browse the repository at this point in the history

  7. backport postprocess callbacks 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    9958ef4 View commit details
    Browse the repository at this point in the history

  8. add internal kv APIs sync and async to MyGcsClient 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    900c984 View commit details
    Browse the repository at this point in the history

  9. update 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    022ce3a View commit details
    Browse the repository at this point in the history

  10. internal kv ok 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    6792366 View commit details
    Browse the repository at this point in the history

  11. add @Property address 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b9433e5 View commit details
    Browse the repository at this point in the history

  12. Create a singleton io context and thread, and place standalone gcs cl… 

    …ient on it.

Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    d2ed905 View commit details
    Browse the repository at this point in the history

  13. cluster_id and ctors 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    349642f View commit details
    Browse the repository at this point in the history

  14. check alive and replace gcs aio client 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    1f79626 View commit details
    Browse the repository at this point in the history

  15. Initial POC to replace PythonGcsClient (on internal kv) 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 23, 2024
    Configuration menu
    Copy the full SHA
    9438b09 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. add timeout to get_all_job_info 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 28, 2024
    Configuration menu
    Copy the full SHA
    ff06b24 View commit details
    Browse the repository at this point in the history

  2. lint 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 28, 2024
    Configuration menu
    Copy the full SHA
    17f5e7d View commit details
    Browse the repository at this point in the history

  3. fix proto parsing 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 28, 2024
    Configuration menu
    Copy the full SHA
    1ecf342 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. fix address format error 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 29, 2024
    Configuration menu
    Copy the full SHA
    c72f409 View commit details
    Browse the repository at this point in the history

  2. format 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 29, 2024
    Configuration menu
    Copy the full SHA
    3841558 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. more tag 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed May 30, 2024
    Configuration menu
    Copy the full SHA
    14df2b4 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2024

  1. Merge branch 'master' into poc-gcs-client-binding

    @rynewang
    rynewang authored Jun 8, 2024
    Configuration menu
    Copy the full SHA
    49df2b3 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge remote-tracking branch 'origin/master' into poc-gcs-client-binding 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    a2f2b4d View commit details
    Browse the repository at this point in the history

  2. mark bad test 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b30debd View commit details
    Browse the repository at this point in the history

  3. Add autoscaler stub methods to GcsClient 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2819d11 View commit details
    Browse the repository at this point in the history

  4. add autoscaler bindings 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8b36485 View commit details
    Browse the repository at this point in the history

  5. remove "Sync" in method names 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b4ad225 View commit details
    Browse the repository at this point in the history

  6. more methods 

    Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
    @rynewang
    rynewang committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    56473da View commit details
    Browse the repository at this point in the history