Go RobotFramework Java Shell TypeScript JavaScript Other
Latest commit 3067cc8 Feb 24, 2017 @emlin emlin committed on GitHub [specific ci=Group11-Upgrade]Support data migration in vic-machine up…
…date (#4008)

* fix diagnostic issue

* refactor interface name

  set version to latest after migration, instead of plugin version

* migrate config in vic-machine upgrade

* clean up timeout in create and upgrade

  timeout will be used only for service waiting

* fix image finding

* minor

* fix version message

* mark creating VCH, to facilitate vic-machine delete

* clean up error message and update copyright

* clean service status during upgrade

* tuning upgrade cleanup

* fix snapshot delete issue

* fix npe

* typo

* integration tests

* comments

* workaround vsan delete snapshot issue

  vsan delete snapshot usually fail immediately after rollback,
  using retry to workaround

* comments
Permalink
Failed to load latest commit information.
.github New template that includes story template (#3663) Jan 19, 2017
cmd [specific ci=Group11-Upgrade]Support data migration in vic-machine up… Feb 25, 2017
demos/compose Update VIC to use CI image 1.19 Feb 23, 2017
doc Design and implementation of VAC integration Feb 24, 2017
infra Update VIC to use CI image 1.19 Feb 23, 2017
isos Adding new iptables rules for bridge isolation (#3875) Feb 14, 2017
lib [specific ci=Group11-Upgrade]Support data migration in vic-machine up… Feb 25, 2017
pkg [specific ci=Group11-Upgrade]Support data migration in vic-machine up… Feb 25, 2017
tests [specific ci=Group11-Upgrade]Support data migration in vic-machine up… Feb 25, 2017
ui Implement the Summary tab in VIC object workspace Feb 24, 2017
vendor Update vmw-guestinfo [specific ci=Group1-Docker-Commands] (#4031) Feb 24, 2017
.dockerignore Exclude the bin/ directory from docker build context Apr 27, 2016
.drone.local.yml Update VIC to use CI image 1.19 Feb 23, 2017
.drone.nightly.yml Update VIC to use CI image 1.19 Feb 23, 2017
.drone.sec Implement the Summary tab in VIC object workspace Feb 24, 2017
.drone.yml Update vmw-guestinfo [full ci] (#3587) Feb 24, 2017
.gitignore [skip ci] Updating to ignore Eclipse specific files (#3999) Feb 22, 2017
.pullapprove.yml Add Joshua Kenney as pullapprove member for UI Feb 24, 2017
CONTRIBUTING.md [skip ci] Add priorities and modify the done/verify column text (#3807) Feb 1, 2017
LICENSE [skip ci] Updating LICENSE and NOTICE to v0.9.0 (#3835) Feb 2, 2017
Makefile Add a target called distro for packaging build artifacts (#4000) Feb 23, 2017
README.md Revert "[skip ci] Add validator badge for swagger spec" (#3589) Jan 10, 2017
Vagrantfile Bump vcpu count to 2 (#3741) Jan 27, 2017

README.md

Build Status Coverage Status Download Go Report Card

vSphere Integrated Containers Engine

vSphere Integrated Containers Engine (VIC Engine) is a container runtime for vSphere, allowing developers familiar with Docker to develop in containers and deploy them alongside traditional VM-based workloads on vSphere clusters, and allowing for these workloads to be managed through the vSphere UI in a way familiar to existing vSphere admins.

See VIC Engine Architecture for a high level overview.

Project Status

VIC Engine now provides:

  • basic function for most of the core lifecycle operations: pull, create, start, attach, run, kill, stop, wait, rm, logs.
  • early vCenter support, leveraging DRS for initial placement.
  • volume support --volume-store - SIOC is not integrated but can be set as normal.
  • direct mapping of vSphere networks --container-network - NIOC is not integrated but can be set as normal.
  • dual-mode management - IP addresses are reported as normal via vSphere UI, guest shutdown via the UI will trigger delivery of container STOPSIGNAL, restart will relaunch container process.
  • logs command - follow is available however timestamps and corresponding filtering are not
  • client authentication - basic authentication via client certificates known as tlsverify

We are working hard to add functionality while building out our foundation so continue to watch the repo for new features. Initial focus is on the production end of the CI pipeline, building backwards towards developer laptop scenarios.

This limited set of current capabilities may come as a surprise to people who are familiar with Project Bonneville that was reasonably fully featured when demonstrated at VMworld in 2015. Project Bonneville was research aimed at determining best approaches to enabling container workflows in a vSphere environment and therefore enabled a broad set of features, but not in a manner that made it a viable product for large scale consumption. Building on top of research code is a great shortcut for fast time-to-market, but does not provide a good foundation for an enterprise quality product. vSphere Integrated Containers Engine is a full re-architecture and re-write, building off the knowledge gained during Project Bonneville while keeping almost zero code.

Installing

Once built, pick up the correct binary based on your OS, and then the result can be installed with the following command.

bin/vic-machine-linux create --target <target-host>[/datacenter] --image-store <datastore name> --name <vch-name> --user <username> --password <password> --thumbprint <certificate thumbprint> --compute-resource <cluster/a/resource/pool/path> --tls-cname <FQDN, *.wildcard.domain, or static IP>

See vic-machine-XXX create --help for usage information.

A more indepth example can be found here

Container output is found in a log file on the datastore ([datastore]/containerid/containerid.log).

Deleting

The installed Virtual Container Host can be deleted through vic-machine-XXX delete.

See vic-machine-XXX delete --help for usage information.

A more indepth example can be found here

Contributing

See CONTRIBUTING for details on submitting changes and the contribution workflow.

Building

Building the project is done with a combination of make and containers, with golang:1.7 being the common container base. This is done so that it's possible to build directly, without a functional docker, if using a Debian based system with the Go 1.7 toolchain and Drone.io installed.

To build as closely as possible to the formal build:

drone exec -trusted -cache -e VIC_ESX_TEST_URL=""

To build without modifying the local system:

docker run -v $(pwd):/go/src/github.com/vmware/vic -w /go/src/github.com/vmware/vic golang:1.7 make all

To build directly:

make all

There are three primary components generated by a full build, found in $BIN (the ./bin directory by default). The make targets used are the following:

  1. vic-machine - make vic-machine
  2. appliance.iso - make appliance
  3. bootstrap.iso - make bootstrap

Building binaries for development

Some of the project binaries can only be built on Linux. If you are developing on a Mac or Windows OS, then the easiest way to facilitate a build is by utilizing the project's Vagrantfile. The Vagrantfile will share the directory where the file is executed and set the GOPATH based on that share.

To build the component binaries, ensure GOPATH is set, then issue the following command in the root directory:

$ make components

This will install required tools and build the component binaries tether-windows, tether-linux, rpctool and server binaries docker-engine-server, port-layer-server. The binaries will be created in the $BIN directory, ./bin by default.

To run tests after a successful build, issue the following:

$ make test

Managing vendor/ directory

To build the VIC Engine dependencies, ensure GOPATH is set, then issue the following. $ make gvt vendor

This will install the gvt utility and retrieve the build dependencies via gvt restore

Building the ISOs

The component binaries above are packaged into ISO files, appliance.iso and bootstrap.iso, that are used by the installer. The generation of the ISOs is split into the following targets: iso-base, appliance-staging, bootstrap-staging, appliance, and bootstrap. Generation of the ISOs involves authoring a new root filesystem, meaning running a package manager (currently yum) and packing/unpacking archives. To install packages and preserve file permissions while unpacking these steps should be run as root, whether directly or in a container. To generate the ISOs:

$ make isos

The appliance and bootstrap ISOs are bootable CD images used to start the VMs that make up VIC Engine. To build the image using docker, ensure GOPATH is set and docker is installed, then issue the following.

docker run -v $(pwd):/go/src/github.com/vmware/vic -w /go/src/github.com/vmware/vic golang:1.7 make isos

Alternatively, the iso image can be built locally. Again, ensure GOPATH is set, but also ensure the following packages are installed. This will attempt to install the following packages if not present using apt-get:

    curl \
    cpio \
    tar \
    xorriso \
    rpm \
    ca-certificates \
    yum

Package names may vary depending on the distribution being used. Once installed, issue the following (the targets listed here are those executed when using the iso target.

make iso-base appliance-staging appliance bootstrap-staging bootstrap

The iso image will be created in $BIN

Building with CI

PRs to this repository will trigger builds on our Drone CI.

To build locally with Drone:

Ensure that you have Docker 1.6 or higher installed. Install the Drone command line tools. From the root directory of the vic repository run drone exec -trusted -cache -e VIC_ESX_TEST_URL=""

Common Build Problems

  1. Builds may fail when building either the appliance.iso or bootstrap.iso with the error: cap_set_file failed - Operation not supported

    Cause: Some Ubuntu and Debian based systems ship with a defective aufs driver, which Docker uses as its default backing store. This driver does not support extended file capabilities such as cap_set_file

    Solution: Edit the /etc/default/docker file, add the option --storage-driver=overlay to the DOCKER_OPTS settings, and restart Docker.

  2. go vet fails when doing a make all

    Cause: Apparently some caching takes place in $GOPATH/pkg/linux_amd64/github.com/vmware/vic and can cause go vet to fail when evaluating outdated files in this cache.

    Solution: Delete everything under $GOPATH/pkg/linux_amd64/github.com/vmware/vic and re-run make all.

Integration Tests

VIC Engine Integration Test Suite includes instructions to run locally.

License

VIC Engine is available under the Apache 2 license.