Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload the colmap rrd file to gcloud #1666

Merged
merged 3 commits into from
Mar 22, 2023
Merged

Upload the colmap rrd file to gcloud #1666

merged 3 commits into from
Mar 22, 2023

Conversation

jleibs
Copy link
Member

@jleibs jleibs commented Mar 21, 2023

This dependency logic is a bit awkward, but in lieu of a larger workflow reorganization this is the easiest path to uploading an rrd file to gcloud.

In short: we generate an rrd file when producing the wheels (and also need the wheels in order to produce the colmap rrd). This means any time we build wheels we will also upload an rrd file, but this is the same conditions where we upload the web asserts.

In the future it would be nice to have wheel-building, rrd-generation, and web-uploading all in a single workflow instead of the way they are split up at the moment. The "python vs rust" partitioning isn't actually buying us much.

Checklist

@jleibs jleibs added the 🕸️ web regarding running the viewer in a browser label Mar 21, 2023
@jleibs jleibs marked this pull request as ready for review March 21, 2023 23:28
* Serve a different index.html and url for the hosted app.rerun.io

* Add index_bundled.html

* Finish comment

* consistent naming for colmap_fiat.rrd
@emilk
Copy link
Member

emilk commented Mar 22, 2023

In the future it would be nice to have wheel-building, rrd-generation, and web-uploading all in a single workflow instead of the way they are split up at the moment. The "python vs rust" partitioning isn't actually buying us much.

I agree

parent: false

- name: "Upload RRD (tagged)"
if: startsWith(github.ref, 'refs/tags/v')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should do if: startsWith(github.ref, 'refs/tags/v') || github.ref == 'refs/tags/latest' here and elsewhere to always get a latest web viewer automatically

Copy link
Member Author

@jleibs jleibs Mar 22, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally agree but I'm going to handle the latest / prerelease logic a bit differently in another PR. There's a bit of a mess around what does / doesn't trigger a workflow. github.ref doesn't mean "this commit happens to be tagged with latest" but rather "pushing the tag latest is what triggered this workflow." But running the whole pipeline a second time (including wheel building on all platforms) seems heavy-handed to effectively update a pointer.

@jleibs jleibs merged commit 4b52ef0 into main Mar 22, 2023
@jleibs jleibs deleted the jleibs/upload_rrd branch March 22, 2023 11:52
@emilk emilk changed the title Upload the colmap rrd file to gcloud. Upload the colmap rrd file to gcloud Mar 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🕸️ web regarding running the viewer in a browser
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants