Skip to content

Conversation

@DragonStuff
Copy link
Contributor

@DragonStuff DragonStuff commented Oct 15, 2025

Adds a filter for VastAI offers by config.regions, which uses jp-japan for example. At the moment, most provider computes pass locations=self.config.regions to pre-filter (AWS, Azure, GCP, OCI, Vultr, Runpod, Lambda, DigitalOcean, Cudo, etc.). Because the server later filters regions by exact equality to offer.region, region constraints still worked if you used the provider’s slug (e.g., jp-japan).

Essentially with this addition, the backend pre-filters by exact location slug early; which means fewer items processed.

PS: I'm thinking that there could be some kind of abstraction in the future that groups offers automatically. For us, picking inference within a certain region really matters for latency. We want to have our application's compute as close as possible to our GPU workloads to reduce latency.

Testing internally at the moment, marked as draft.

@DragonStuff DragonStuff deleted the add-geoloc-vast branch October 15, 2025 06:53
@DragonStuff DragonStuff restored the add-geoloc-vast branch October 15, 2025 06:57
@DragonStuff DragonStuff reopened this Oct 15, 2025
@DragonStuff DragonStuff marked this pull request as ready for review October 15, 2025 07:23
@DragonStuff DragonStuff changed the title feat(VastAICompute): add support for region fix(VastAICompute): filter region before offer Oct 15, 2025
@r4victor r4victor merged commit 5461b20 into dstackai:master Oct 16, 2025
55 of 56 checks passed
@r4victor
Copy link
Collaborator

@DragonStuff, thanks for the PR. Regarding the grouping, we were thinking about introducing generic dstack locations so that users can refer to them instead of provider-specific locations but this a) involves too much work to add and maintain a mapping for each provider and b) it's hard to come up with good location list suitable for every provider.

Maybe we could allow regex-like patterns in region names for filtering to support filtering by us-* for vastai if this suits you. Feel free to share your ideas.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants