Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy with morph, in buildkite, with vault and terraform #37

Merged
merged 86 commits into from Jan 21, 2021

Conversation

grahamc
Copy link
Contributor

@grahamc grahamc commented Jan 14, 2021

what a mess of a PR, there is a lot of goop in the repo to clean up.

include a possibly working customdata partitioning scheme for evaluators
Copy link
Contributor

@cole-h cole-h left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Woohoo!

ci/terraform-import.yml Outdated Show resolved Hide resolved
enter-env.sh Outdated Show resolved Hide resolved
make-targets.sh Outdated Show resolved Hide resolved
make-targets.sh Outdated
cat <<EOF > "$scratch/default.nix"
{
network = {
pkgs = import <nixpkgs> {};
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:(

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is why we need that ALLOW_UNFREE bit, and if we simply set the config here, we wouldn't need the environment variable. Agreed on :(. Maybe you can help get away from this?

nixops/modules/default.nix Show resolved Hide resolved
enter-env.sh Outdated
@@ -0,0 +1,106 @@
#!/usr/bin/env nix-shell
#!nix-shell -i bash -I nixpkgs=channel:nixos-unstable-small -p bashInteractive vault awscli jq openssh
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should only need either -I nixpkgs= or NIX_PATH, right?

terraform/base/packet.tf Outdated Show resolved Hide resolved
terraform/base/packet.tf Outdated Show resolved Hide resolved
terraform/base/packet.tf Outdated Show resolved Hide resolved
terraform/shell.nix Outdated Show resolved Hide resolved
@cole-h
Copy link
Contributor

cole-h commented Jan 15, 2021

Also, dunno if this is on me (e.g. my Firefox configuration) or not, but something seems to be up with Grafana. Any graph I try to make just gives me a is undefined, and I can't find any endpoint that gives me access to the ofborg_queue_evaluator_in_progress -- and other -- metrics. Maybe related to the rabbitmq host change? Dunno. Weird stuff.

grahamc and others added 15 commits January 16, 2021 09:30
No need to do the nix-shell --run dance, since enter-env.sh is already
run using the shell.nix.
./enter-env.sh already includes the shell.nix environment.
terraform/enumerate-servers.sh: shell.nix is one dir up
ci: don't depend on deploy-boot
This ensures we can deploy even if we are low on space.

No blocking, but still `concurrency: 1`.
ci: collect garbage before dry activation
coreutils is necessary for `wc -l`.
ci: collect garbage per machine
@grahamc grahamc merged commit 62353ba into master Jan 21, 2021
@grahamc grahamc deleted the vaulty-deploy branch January 21, 2021 21:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants