Skip to content

Add compute_cluster_local_world_size to VertexAiGraphStoreConfig and GraphStoreInfo#380

Merged
kmontemayor2-sc merged 4 commits intomainfrom
kmonte/add-process-count
Nov 17, 2025
Merged

Add compute_cluster_local_world_size to VertexAiGraphStoreConfig and GraphStoreInfo#380
kmontemayor2-sc merged 4 commits intomainfrom
kmonte/add-process-count

Conversation

@kmontemayor2-sc
Copy link
Copy Markdown
Collaborator

@kmontemayor2-sc kmontemayor2-sc commented Nov 13, 2025

Scope of work done

We need to expose this somehow in our code, I am planning on updating our VAI service job launch code to set the env variable in a subsequent PR.

We need this as we need "number clients" which is client machines x "processes / client machine" when setting up server code glt server/client mode.

I want to put this in the config as I feel like it's more centralized and we require the config anyways to launch graph store jobs.
The alternative here is to have some cross/cluster information sharing with torch rpc but I feel like that's more involved, especially as we are going to control the server main (for now).

Where is the documentation for this feature?: N/A

Did you add automated tests or write a test plan?

Updated Changelog.md? NO

Ready for code review?: NO

@kmontemayor2-sc
Copy link
Copy Markdown
Collaborator Author

/unit_test

@kmontemayor2-sc
Copy link
Copy Markdown
Collaborator Author

/integration_test

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Nov 13, 2025

GiGL Automation

@ 24:26:02UTC : 🔄 Unit Test started.

@ 01:32:01UTC : ✅ Workflow completed successfully.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Nov 13, 2025

GiGL Automation

@ 24:26:09UTC : 🔄 Integration Test started.

@ 01:44:10UTC : ✅ Workflow completed successfully.

Comment thread python/gigl/distributed/utils/networking.py Outdated
Comment thread proto/snapchat/research/gbml/gigl_resource_config.proto Outdated
Comment thread python/gigl/distributed/utils/networking.py
Comment thread python/gigl/env/distributed.py Outdated
Comment thread python/gigl/distributed/utils/networking.py
@kmontemayor2-sc kmontemayor2-sc changed the title Add num_processes_per_compute to VertexAiGraphStoreConfig and GraphStoreInfo Add compute_cluster_local_world_size to VertexAiGraphStoreConfig and GraphStoreInfo Nov 17, 2025
@kmontemayor2-sc kmontemayor2-sc marked this pull request as ready for review November 17, 2025 18:06
@kmontemayor2-sc kmontemayor2-sc added this pull request to the merge queue Nov 17, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Nov 17, 2025
@kmontemayor2-sc kmontemayor2-sc added this pull request to the merge queue Nov 17, 2025
Merged via the queue into main with commit e590c8e Nov 17, 2025
5 checks passed
@kmontemayor2-sc kmontemayor2-sc deleted the kmonte/add-process-count branch November 17, 2025 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants