Skip to content

Conversation

@clee2000
Copy link
Contributor

@clee2000 clee2000 commented Aug 22, 2025

I want the pricing information for each runner by calling the API

basically caches the data on s3

the file looks like https://ossci-metrics.s3.us-east-1.amazonaws.com/ec2_pricing.json.gz

@vercel
Copy link

vercel bot commented Aug 22, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Preview Updated (UTC)
torchci Ignored Ignored Preview Nov 13, 2025 4:39pm

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 22, 2025
@clee2000 clee2000 marked this pull request as ready for review August 22, 2025 23:21
@clee2000 clee2000 force-pushed the csl/ti_ec2_pricing_info branch from fc18637 to 7cdb8dc Compare November 6, 2025 19:24
@clee2000 clee2000 changed the title [TestInsights] Script for generating ec2 pricing info [file report] get costs from straight from aws Nov 6, 2025
@clee2000 clee2000 requested a review from a team November 6, 2025 19:25
@clee2000 clee2000 changed the title [file report] get costs from straight from aws [file report] get costs from aws Nov 6, 2025
return config


def get_ec2_instance_for_label(label: str) -> dict[str, Optional[str]]:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a note that this wouldn't work with H100 and teams are using this nowadays to run tests, e.g. https://github.com/pytorch/pytorch/blob/main/.github/workflows/h100-symm-mem.yml. Handling that is probably out of scope, but it's something we want to keep in mind I guess

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Anyway, this seems like an expected setup anyway because MacOS is also not here

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not really sure how to calculate h100 or mac cost atm since if I understand correctly, it's a reservation so there isn't really a per hour or per second cost

@clee2000 clee2000 force-pushed the csl/ti_ec2_pricing_info branch from 7cdb8dc to 833dd30 Compare November 12, 2025 23:08
@clee2000 clee2000 changed the title [file report] get costs from aws [file report] upload costs to file on aws Nov 12, 2025
@clee2000 clee2000 changed the title [file report] upload costs to file on aws [file report] upload costs to file on s3 Nov 12, 2025
@clee2000 clee2000 merged commit 0cecaa5 into main Nov 13, 2025
7 checks passed
@clee2000 clee2000 deleted the csl/ti_ec2_pricing_info branch November 13, 2025 16:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants