Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Moving KMS to github to prepare open sourcing #1

Merged
merged 41 commits into from
Jan 22, 2024
Merged
Show file tree
Hide file tree
Changes from 9 commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
e597cf3
moving code from dev repo
beejones Jan 9, 2024
9be7487
Setup devcontainer
beejones Jan 10, 2024
da11f88
make sure all make commands work by default
beejones Jan 10, 2024
d0f9053
cleanup
beejones Jan 11, 2024
e6d9c72
Create docker container from devcontainer
beejones Jan 15, 2024
d5cd81c
prepare adding workflow
beejones Jan 16, 2024
2b39aa1
Rerun workflow
beejones Jan 16, 2024
ea54837
rerun ci
beejones Jan 16, 2024
440e951
Update ci.yml
beejones Jan 16, 2024
bf42f98
split ci and devcontainer
beejones Jan 17, 2024
feaee7a
Merge branch 'beejones/initial-setup' of https://github.com/microsoft…
beejones Jan 17, 2024
86c77eb
update ci
beejones Jan 17, 2024
7722230
fix ci
beejones Jan 17, 2024
f30bf36
update ci
beejones Jan 17, 2024
721d7a5
update ci
beejones Jan 17, 2024
ba57219
rerun ci
beejones Jan 17, 2024
0f5df77
rerun
beejones Jan 17, 2024
403ece3
move back to dev10
beejones Jan 17, 2024
8a46119
have to rename the devcontainer.json file for ci
beejones Jan 17, 2024
43edf24
updating devcontainer.json
beejones Jan 17, 2024
effdfed
update build in devcontainer
beejones Jan 17, 2024
c97217b
add npm i during setup
beejones Jan 17, 2024
4e65204
testing failing workflow
beejones Jan 17, 2024
49e45ed
undo the failing ci workglow. CI nicely failed when e2e fails
beejones Jan 17, 2024
8606992
Adding lint
beejones Jan 17, 2024
6ed3c51
remove lint fix
beejones Jan 17, 2024
0e01227
Move node installation to dockerfile
DomAyre Jan 17, 2024
e17b485
Merge branch 'beejones/initial-setup' into node-in-dockerfile
DomAyre Jan 17, 2024
730d22c
Merge pull request #2 from microsoft/node-in-dockerfile
DomAyre Jan 17, 2024
29e9ba6
Add copyright headers to source code
DomAyre Jan 19, 2024
4ca95e8
Add a notice file
DomAyre Jan 19, 2024
450419a
Fix auto formatting mistakes
DomAyre Jan 19, 2024
79a9c08
Add contributing and trademark files
DomAyre Jan 19, 2024
d73b64a
Add lint
beejones Jan 22, 2024
2c786aa
Merge branch 'beejones/initial-setup' of https://github.com/microsoft…
beejones Jan 22, 2024
7638c31
Merge pull request #4 from microsoft/oss-compliance
beejones Jan 22, 2024
0abd392
try fixing creation of ci container
beejones Jan 22, 2024
eda46f2
remove managed CCF from readme
beejones Jan 22, 2024
f4c4826
retry ci
beejones Jan 22, 2024
8c9009c
fix ci
beejones Jan 22, 2024
b32509a
sync devcontainer and ci
beejones Jan 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 45 additions & 0 deletions .devcontainer/Dockerfile.devcontainer
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
# Base container image which is built nightly
# Used as a starting point to make building other containers fast

ARG BASE_CCF_IMAGE=5.0.0-dev10-virtual
ARG ENVIRONMENT=devcontainer

# ignore this hadolint error as BASE_IMAGE contains an image tag
# hadolint ignore=DL3006
FROM mcr.microsoft.com/ccf/app/dev:${BASE_CCF_IMAGE} as base

# Custom Deps
RUN apt-get update && apt-get install -y \
python3-pip \
openssh-client \
make \
libuv1 \
jq \
lsof \
sudo \
tar \
default-jre

RUN apt-get -y autoremove \
&& apt-get -y clean

# Setup tinkey
ENV TINKEY_VERSION=tinkey-1.10.1
RUN curl -O https://storage.googleapis.com/tinkey/$TINKEY_VERSION.tar.gz
RUN tar -xzvf $TINKEY_VERSION.tar.gz
RUN cp tinkey /usr/bin/
RUN cp tinkey_deploy.jar /usr/bin/
RUN rm tinkey tinkey_deploy.jar tinkey.bat $TINKEY_VERSION.tar.gz

WORKDIR /app

# Define ci
FROM base as ci
RUN pip install -U -r ./requirements.txt


# Define a devcontainer stage that includes the dist directory
FROM base as devcontainer
COPY ./dist ./dist
COPY requirements.txt .
RUN pip install -U -r ./requirements.txt
30 changes: 30 additions & 0 deletions .devcontainer/devcontainer.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
{
"name": "Privacy Sandbox Dev",
"build": {
"dockerfile": "Dockerfile.devcontainer",
"context": ".."
},
"features": {
"ghcr.io/devcontainers/features/docker-in-docker:2": {
"version": "latest",
"enableNonRootDocker": "true",
"moby": "true"
},
"ghcr.io/devcontainers/features/common-utils:2": {},
"ghcr.io/devcontainers/features/node:1": {}
},
"customizations": {
"vscode": {
"extensions": [
"eamodio.gitlens",
"GitHub.copilot",
"ms-python.black-formatter",
"ms-python.python",
"ms-vscode.cpptools-extension-pack"
]
},
"settings": {
"editor.defaultFormatter": "ms-python.black-formatter"
}
}
}
33 changes: 33 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
name: "KMS CI"

on:
push:
branches: [main]
pull_request:
branches: [main]
workflow_dispatch:

jobs:
kms:
name: kms
runs-on: ubuntu-latest
steps:
- name: Checkout repository
uses: actions/checkout@v3
with:
fetch-depth: 0
persist-credentials: false

- name: Build DevContainer
uses: devcontainers/ci@v0.3
env:
TARGET: "ci"
with:
runCmd: |
make demo

- name: Run commands in Docker container
run: |
docker run --name kms-ci -d kms-ci
docker exec kms-ci make build
docker exec kms-ci make demo
9 changes: 9 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
dist
node_modules
package-lock.json
vol
.venv_ccf_sandbox
workspace
.env
hello/
ccf-app/
60 changes: 60 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
SHELL := /bin/bash
CCF_NAME := "acceu-bingads-500dev10"
PYTHON_VENV := .venv_ccf_sandbox
CCF_WORKSPACE ?= .
WORKSPACE ?= ${CCF_WORKSPACE}/workspace
KMS_URL ?= https://127.0.0.1:8000
KEYS_DIR ?= ${CCF_WORKSPACE}/workspace/sandbox_common

ifeq ($(INSTALL),local)
CCFSB=../../CCF/tests/sandbox
else
CCFSB=/opt/ccf_virtual/bin
endif

.PHONY: help
.DEFAULT_GOAL := help

help: ## 💬 This help message :)
@grep -E '[a-zA-Z_-]+:.*?## .*$$' $(firstword $(MAKEFILE_LIST)) | awk 'BEGIN {FS = ":.*?## "}; {printf "\033[36m%-22s\033[0m %s\n", $$1, $$2}'

build: ## 🔨 Build the Application
@echo -e "\e[34m$@\e[0m" || true;
./scripts/set_python_env.sh
npm run build

# Start hosting the application using `sandbox.sh` and enable custom JWT authentication
start-host: build ## 🏃 Start the CCF network using Sandbox.sh
@echo -e "\e[34m$@\e[0m" || true
$(CCFSB)/sandbox.sh --js-app-bundle ./dist/ --initial-member-count 3 --initial-user-count 1 --constitution ./governance/constitution/kms_actions.js -v

setup: ## Setup policies and generate a key
@echo -e "\e[34m$@\e[0m" || true
WORKSPACE=${CCF_WORKSPACE}/workspace; \
export WORKSPACE; \
./scripts/kms_create_key.sh --network-url "${KMS_URL}" --certificate_dir "${KEYS_DIR}"

demo: build ## 🎬 Demo the KMS Application in the Sandbox
@echo -e "\e[34m$@\e[0m" || true
@. ./scripts/test_sandbox.sh --nodeAddress 127.0.0.1:8000 --certificate_dir ${CCF_WORKSPACE}/workspace/sandbox_common --constitution ./governance/constitution/kms_actions.js --interactive

# Propose a new key release policy
propose-add-key-release-policy: ## 🚀 Deploy the add claim key release policy to the sandbox or mCCF
@echo -e "\e[34m$@\e[0m" || true
@. ./scripts/submit_proposal.sh --network-url "${KMS_URL}" --proposal-file ./governance/policies/key-release-policy-add.json --certificate_dir "${KEYS_DIR}" --member-count 2

propose-rm-key-release-policy: ## 🚀 Deploy the remove claim key release policy to the sandbox or mCCF
@echo -e "\e[34m$@\e[0m" || true
$(call check_defined, KMS_URL)
@./scripts/submit_proposal.sh --network-url "${KMS_URL}" --proposal-file ./governance/policies/key-release-policy-remove.json --certificate_dir "${KEYS_DIR}"

# The following are here in case you forget to change directory!
deploy: build ## 🚀 Deploy Managed CCF or local
@echo -e "\e[34m$@\e[0m" || true
@./scripts/deploy.sh --network-url "${KMS_URL}" --certificate_dir "${KEYS_DIR}"

# Keep this at the bottom.
clean: ## 🧹 Clean the working folders created during build/demo
@rm -rf ${CCF_WORKSPACE}/.venv_ccf_sandbox
@rm -rf ${CCF_WORKSPACE}/workspace
@rm -rf dist
Loading
Loading