New home view

[mausworks]

Description

This removes the /projects view in favor of a new more flexible "home" view, where other things than Projects can be displayed, such as all Job and Interactive Runs.

Features

• Remove the /projects page and fix any inbound links
• Redirect /projects to /?tab=projects
• Move projects to the new home page and align components with new design
• Update the Project selector menu with the new design
• Implement interactive job runs under "all runs"
• Implement all job runs under "all runs"
  • Make the back-end support querying of multiple (or all) projects
  • Implement filtering, pagination, etc... in the new front-end based on the new API.

Checklist

• I have manually tested my changes and I am happy with the result.
• The documentation reflects the changes.
• The PR branch is set up to merge into dev instead of master.

[mausworks]

Seems like there is no polling, because the view doesn't update for me

@ricklamers haha, no you're right. 🤦 😂

Fixed: f8c2263

[fruttasecca]

I'm hitting a snag with orchest-api not coming up. Also doesn't produce log. Retried as clean installation, no luck. @fruttasecca did you experience this at some point?

Update: I expect this to be a migration conflict related to Alembic. Was able to resolve when I made sure I started without state and installing directly from dev only after building all container images.

I believe the cause is/are branching migrations between what's on dev and this branch, easily fixed/verified, e.g. try bash scripts/migration_manager.sh orchest-api merge heads

[mausworks]

Is showing 5 per page the default? Seems a bit low. Maybe go with 10?

@ricklamers updated to 8 now! Do you still think 10?

[mausworks]

Creating a new project in the project drawer gives me:

@ricklamers this is also fixed now 👍

[mausworks]

@iannbing

Quite a big PR to review even per commit.

Yeah, I'm sorry. The PR touches on pretty much every entity in some way (examples, projects, jobs, pipelines, job runs), making it naturally quite large. 😬

there are definitely some work to be done regarding the inconsistency between the old contexts and the new zustand stores.

I have now removed projectUuid, project, pipeline, and pipelines from the project context entirely. useActiveProject, useActivePipeline, useProjectPipelines can be used instead. projectUuid is available in useCurrentQuery.

[ricklamers]

When I load a project the main pipeline is not loaded:

I just created a new project, added a step to the pipeline and clicked on JupyterLab.

E.g. clicking the pipeline in the pipeline sessions element in the lower left corner doesn't open the pipeline either.

Console:

Warning FailedMount 0s (x7 over 32s) kubelet Mo │
│ untVolume.SetUp failed for volume "ssh-key-5615fd61-52b3-4a4d-b │
│ ed6-4c0297bccd11" : secret "ssh-key-5615fd61-52b3-4a4d-bed6-4c0 │
│ 297bccd11" not found

Looks like this was because of some old state related to SSH keys

[ricklamers]

LGTM! @mausworks for pres