docker.md

Docker

• 도커 무작정 따라하기
• 도커(Docker) 튜토리얼 : 깐 김에 배포까지
• 가장 빨리 만나는 도커
• Docker란 무엇인가? : Docker 기본 사용법
• hello
• 생활코딩 docker
• 초보를 위한 도커 안내서 - 도커란 무엇인가?
• 초보를 위한 도커 안내서 - 설치하고 컨테이너 실행하기
• [HQ] 케빈 TV 시즌2 - 2회 Docker 1회 맛보기
• [HQ] 케빈 TV 시즌2 - 3회 Docker 2회
• [HQ] 케빈 TV 시즌2 - 4회 Docker 3회
• [HQ] 케빈 TV S02E05 - Docker 4회 (2016-09-11)
• [HQ] 케빈 TV S02E06 - Docker 5회 (2016-09-18)
• [HQ] 케빈 TV S02E07 - Docker 6회 + Zeppelin 설치 (반만 성공) + FP 얘기 조금 (2016-09-25)
• docs.docker.com
• https://github.com/docker-library/docs
• https://hub.docker.com/
  • bi_deeplearning TensorFlow + Theano + Torch + Scikit-learn + Keras + Caffe + ...
  • centos
  • elasticsearch
  • httpd
  • jenkins
    • Combining Jenkins and Docker for Continuously Running Instances
  • mysql-server
    • A tutorial on how to use MySQL with Docker
    • MySQL Docker Containers: Understanding the basics
    • Setting up a MySQL Docker container
  • R
    • hub.docker.com/r/mrchypark/tfr-rstudio/tags
  • sonarqube
    • docker-sonarqube
    • Super quick Sonar/Postgres setup with docker
    • downloads.sonarsource.com/sonarqube
    • github.com/SonarSource/sonar-examples
    • Python Plugin
    • JavaScript Static Analysis Report System with SonarQube
  • Dockerfile for Pydata Eco Systems with Tensorflow
  • ubuntu

    • Encoding Problems when running an app in docker (Python, Java, Ruby, …) with Ubuntu Containers (ascii, utf-8)

      FROM ubuntu:latest
      
      RUN apt-get update -y && apt-get install -y ... locales
      ...
      ENV PYTHONIOENCODING="utf-8"
      RUN locale-gen ko_KR.UTF-8
      ENV LANG=ko_KR.UTF-8
      ENV LANGUAGE=ko_KR.UTF-8
      ENV LC_ALL=ko_KR.UTF-8
      

  • ubuntu + python3.6
    • ENTRYPOINT로 python3.6 사용
  • DIT4C image for Apache Zeppelin
• Docker로 파이썬 배포 운영하기
• 파이썬 Docker 이미지 관리하기
• 도커를 이용한 파이썬 모듈 배포하기 - 서준석
• docker로 만들어보는 가상 원격 데스크탑 - 이형규
• CoreOS : 설치부터 컨테이너 배포까지 - 김충섭
• 초보의 도커 간증 - 박성재님
• 도커로 고스트 블로그 플랫폼 5분만에 설치하기 - 김한기
• 도커 학습과 Boot2Docker - 이재홍(@pyrasis)
• Docker Histroy & Ecosystem - 김대권(@nacyot)
• Docker로 레일스 배포하기 - 정창훈(@seapy)
• 도커(Docker)로 루비 온 레일스(Ruby on Rails) 어플리케이션 배포하기 1/2
• 도커(Docker)로 루비 온 레일스(Ruby on Rails) 어플리케이션 배포하기 2/2 이미지 배포 / 공유하기
• Docker Korea 두번째 모임 : Docker와 로그 & 메트릭스 수집
• docker swarm - 신명수
• Docker Tutorial for Beginners
• Docker Tutorial — Getting Started with Python, Redis, and Nginx
• Docker Machine Guide (VirtualBox on Mac OS X)
• docker the cloud
• A quick introduction to Docker http://odewahn.github.io/docker-jumpstart
• What is Docker?
• dockercon cfp summary
• Show HN: CLI for executing code in many different languages with Docker
• Comparing Five Monitoring Options for Docker
• Docker building dockers - keeping them small
• Docker Without Docker
• 7 Things You Must Be Doing With Docker
• Privilege Escalation via Docker
• Creating honeypots using Docker
• ImageLayers.io - Docker Image Visualization and Badges
• Container Factory - Turn your Github repo into a published container image
• A Quick Introduction to LXD
• Adding Compose to the Swarm + Powerstrip + Flocker + Weave demo
• The case against Docker
• Convert Any Server to a Docker Container
• Tales of a Part-time Sysadmin: Dogfooding Docker to test Docker
• Building Better Docker Images
• Docker, Mesos, Marathon, and the End of Pets
• Docker , the future of Virtualization for your Django web development
• Docker, CoreOS, Google, Microsoft, Amazon And Others Come Together To Develop Common Container Standard
• OPEN CONTAINER PROJECT
• docker con
  • DOCKERCON 2015 KEYNOTE VIDEOS
    • DockerCon 2015 키노트 요약
  • A Summary about Hykes' Keynote on Dockercon 2015
  • Enabling Microservices @Orbitz - DockerCon 2015
  • Dockercon 2015 - Faster Cheaper Safer
  • Interconnecting containers at scale #Dockercon
  • DOCKERCON GENERAL SESSION DAY 1 AND DAY 2 VIDEOS
• 10 Open Source Docker Tools You Should Be Using
• Docker and Microsoft announce more innovation to cross platforms and win hearts
• Container OS comparison
• A Go, Docker workflow
• Why Docker is Not Yet Succeeding Widely in Production
• Docker Misconceptions
• My Slow Internet vs Docker
• Spin up a Docker dev/test Environment in 60 Minutes or Less
• Running containers from Mac OS X
• ANNOUNCING DOCKER 1.8: CONTENT TRUST, TOOLBOX, AND UPDATES TO REGISTRY AND ORCHESTRATION
  • ANNOUNCING DOCKER TOOLBOX
• Migrating stateful containers using native Docker 1.8 Flocker plugin and Compose
• Full-stack Docker performance monitoring: From containers to applications
• END-TO-END AUTOMATION FOR DOCKER-BASED APPLICATIONS ON DIGITALOCEAN
• How We Deploy Containers at Grammarly
• Tutorial: Deploying Apache Storm on Docker Swarm
• EXTENDING DOCKER WITH PLUGINS
• large scale backend service develpment
• Swarm v. Fleet v. Kubernetes v. Mesos
• Docker CRIU Demo
• Docker Clustering Tools Compared: Kubernetes vs Docker Swarm
• Scale Testing Docker Swarm to 30,000 Containers
• Docker Networking: Reborn
• AWS Korea container day
• Docker Sotrage 의 거의 모든 것
• 10 Tips & Tricks with Docker
• 10 Docker Tips and Tricks That Will Make You Sing A Whale Song of Joy
• Using Docker to Run Python
• 도커를 이용한 웹서비스 무중단 배포하기
• Docker, AWS-ECR, Jenkins를 이용해서 웹서비스 무중단 배포하기
• Continuous Integration with Docker - 송주영 선임 :: AWS Container Day
• Docker and Btrfs in practice
• Jérôme Petazzoni - Introduction to Docker and containers - PyCon 2016
• Docker 로 Node.js 배포하기
• 웹호스팅계의 혁신, Docker
• 2014 Red Hat Forum - Docker, 그 기발한 활용법 (부제 : dumpdocker – 자동덤프분석툴)
• Discovering Docker Datacenter
• 개발자 장난감 시리즈, 시놀로지 NAS로 EC2 만들기
• Docker를 기반으로 다양한 데이터베이스 환경 통합하기
• Introducing Docker 1.13
• DevOps with Docker
• 도커 컨테이너 활용 사례 Codigm - 남 유석 개발팀장 :: AWS Container Day
• Docker and OOM(Out Of Memory) Killer
• codeschool.com/courses/try-docker
• PART 5 OF DATA LAKE 3.0: YARN AND CONTAINERIZATION: SUPPORTING DOCKER AND BEYOND
  • LinuxContainerExecutor를 통해 Docker 컨테이터를 실행하는 YARN에 대한 이야기
• Docker
• Build and Deploy a Python Web App on Docker
• bash/shell script
  • bash
  • Docker with shell script or Makefile
  • docker run a shell script in the background without exiting the container
• troubleshooting
  • Docker for Mac에서 No space left on device 오류
  • Docker cache and apt-get update
    • docker build ...가 returned a non-zero code: 100로 끝날 때의 해결책
    • Redhat 7.2, docker 1.10.3에서는 해결되지 않음
• 내가 Docker를 시작했던 방법
• 특정 포트의 실행 대기하기
• 컨테이너에 HTTP 프록시 적용하기
• Docker를 기반으로 다양한 데이터베이스 환경 통합하기
• install

  • practice - installation script

  • uninstall

    $ cat /etc/redhat-release
    CentOS Linux release 7.3.1611 (Core)
    $ sudo service docker stop
    $ sudo yum remove docker-io
    $ sudo yum remove docker docker-common docker-selinux docker-engine
    

  • How To Install Docker on CentOS 6

• Docker를 이용한 크로스 컴파일 툴체인 이용하기

BoxFuse

• Why Immutable Infrastructure?
• Immutable Infrastructure: No SSH
• Petabyte-Scale Data Pipelines with Docker, Luigi and Elastic Spot Instances
• Checkpoint and restore Docker container with CRIU
• Don't expose the Docker socket (not even to a container)
• WRITING AND RUNNING GO API'S IN DOCKER
• END-TO-END AUTOMATION FOR DOCKER-BASED PYTHON WITH REDIS ON AWS
• Docker image with Tor, Privoxy and a process manager under 15 MB
• Developing with Docker at IFTTT

Commands

• 개발 환경에서 유용한 Docker 명령어 소개

• build

  • docker build -t [name]:[tag] .
  • --build-arg e.g. sudo docker build --build-arg http_proxy=http://x.y.z.w:port --build-arg https_proxy=http://x.y.z.w:port -t [name]:[tag] .
  • Docker v17.06.0-ce에 도입된 multi-stage 빌드 사용하기
  • .dockerignore
    • 무조건 설정하자. 그렇지 않으면 해당 directory의 모든 파일을 일단 다 검색하고, 추가하려고 시도한 다음 필요없으면 버리기 때문에
    • 시간/공간 절약을 위해서는 무조건 사용하는 게 이득
    • 해당 directory에 큰 용량의 log나 data file이 있는 경우 build도 실패할 뿐더러, disk usage가 100%를 찍을 수도 있음

• cp sudo docker cp [host path] [container id]:[container path] Copying files from host to docker container

• exec

  sudo docker exec -it [container id] /bin/bash # to get bash into a running container
  sudo docker exec [container id] ls /some/path/
  

• images sudo docker images

• inspect sudo docker inspect [container id] | grep IPAddress...

• kill sudo docker kill [container id]

• logs docker logs -f [container id]

• ps sudo docker ps [-a]

• registry

  $ sudo docker logout [url]
  
  $ sudo vi /etc/systemd/system/docker.service.d/http-proxy.conf
  [Service]
  Environment="HTTP_PROXY=http://some.proxy.url:port" "HTTPS_PROXY=http://some.proxy.url:port" "NO_PROXY=localhost,127.0.0.1,.some.exclusion,..."
  
  $ sudo service docker restart
  $ sudo systemctl daemon-reload
  $ systemctl show --property=Environment docker
  $ sudo docker info | grep -i proxy
  
  $ sudo docker login [url]
  

  • docker 로그인/로그아웃할 때의 사설 저장소 연동하기
  • Running Docker behind a proxy

• rm sudo docker rm [container id]

  • sudo docker ps -a | grep Exit | awk '{print $1}' | sudo xargs docker rm docker rmi cannot remove images, with: no such id
  • docker rm $(docker ps -q -f 'status=exited')
  • docker volume rm $(docker volume ls -qf dangling=true)

• rmi sudo docker rmi [-f] [image id]

  • docker rmi $(docker images -q -f "dangling=true")

• run sudo docker run [--rm|-d] -p hostPort:containerPort [name]

  • practice of --env-file=... --rm -v <local dir>:<container dir> -p <host port>:<container port>
  • ... -v /etc/localtime:/etc/localtime:ro ... How to make sure docker's time syncs with that of the host?
  • A Brief Primer on Docker Networking Rules: EXPOSE, -p, -P, --link
  • Start containers automatically
  • --net=host to run as host mode for network(default bridge)
    • Use the same port for host & container
      • ... -p 12345:80 ...(X) (e.g. On Dockerfile EXPOST 80 for apache server)
      • ... -p 12345:12345 ...(O) (e.g. On Dockerfile EXPOST 12345 even for apache server)

• stop sudo docker stop [container id]

Convox

• Launch a Private Cloud in Minutes The simplicity of Heroku. The power of AWS

Dockerfile

• Gotchas in Writing Dockerfile
• How to Optimize Your Dockerfile
• practice
  • some project with apache
  • ubuntu + python3, 한글
    • docker - ko_KR.UTF-8 지원 우분투 14.04 이미지 만들기
    • Werkzeug raises BrokenFilesystemWarning
      • 언제 발생하는지 아직 정확히는 모르겠는데, 한글 설정이 안 되면 이런 오류가 발생할 때가 있음
• crontab
  • 여러가지 방법을 시도해봤으나 모두 실패해 현재는 host에서 sudo docker exec -it [container id] /path/to/script_name.sh로 실행 중
  • practice
    • cron만 돌리는 test였던 ubuntu_cron_only, centos68_cron_only 이외에는 전부 실패
    • 이외에도 내부에서 일단 crontab을 등록해 돌아가는 지 확인해보려고 했지만, crontab -l로 등록 되는 거 까지만 확인하고 실행은 모두 실패

Kubernetes

• Container Cluster Manager from Google
• Large-scale cluster management at Google with Borg
• Google systems guru explains why containers are the future of computing
• KUBERNETES - THE FUTURE OF DEPLOYMENT
• Omega, and what it means for Kubernetes: a Q&A about cluster scheduling
• Kubernetes: Open Source Container Cluster Orchestration
• Omega, and what it means for Kubernetes: a Q&A about cluster scheduling
• Try Kubernetes with Vagrant
• CoreOS and Kubernetes 1.0
• Kubernetes from the ground up: the API server
• Official Kubernetes on CoreOS Guides and Tools
• Helm - The package manager for Kubernetes
• Kubernetes from the ground up: the scheduler
• Scalable Microservices with Kubernetes
• Getting Started with Kubernetes
• kakao의 오픈소스 Ep6 - Cite - cite , kubernetes , github , docker , container , microservice
• Scalable Spark Deployment using Kubernetes
  • Docker Image and Kubernetes Configurations for Spark 2.x
  • Part 1 : Introduction to Kubernetes
  • Part 2 : Installing Kubernetes Locally using Minikube
  • Part 3 : Kubernetes Abstractions
  • Part 4 : Service Abstractions
  • Part 5 : Building Spark 2.0 Docker Image
  • Part 6 : Building Spark 2.0 Two Node Cluster
  • Part 7 : Dynamic Scaling and Namespaces
• Scaling Python Microservices with Kubernetes
• [NDC17] Kubernetes로 개발서버 간단히 찍어내기
  • terraform-aws-coreos-kubernetes
• GitHub 계정으로 Kubernetes 인증하기
• Kubernetes on bare-metal in 10 minutes
• 처음 만난 Kubespray

Library

• Bocker - Docker implemented in 100 lines of bash https://www.p8952.info/projects.html
• Boot2Docker
• Capsule Shield: A Docker Alternative Tailor-Made for the JVM
• codetainer allows you to create code 'sandboxes' you can embed in your web applications
• dcw is Docker Compose Wrapper to simplify everyday dev work with containers
• DevLab is a utility that allows you to easily containerize your development workflow using Docker
• Dinghy - Using Docker Machine on OS X with Dinghy
• Docker Bench - The Docker Bench for Security is a script that checks for all the automatable tests included in the CIS Docker 1.6 Benchmark. https://dockerbench.com
• Docker monitoring
• domeide - Docker meets the IDE!
• Droot - a super-easy application container engine with chroot without docker
• Empire - Introducing Empire: A self-hosted PaaS built on Docker & Amazon ECS
• Flocker 1.0: Container Data Management for Docker
• Galley is a command-line tool for orchestrating Docker containers in development and test environments
• gockerize - Package golang service into minimal docker containers
  • Introducing gockerize
• hyper_ - Hypervisor-agnostic Docker Engine_
  • CLI and Daemon for Hyper
• instadocker - Run any Docker container on the cloudin just 3 seconds
• kompose - a tool to help users familiar with docker-compose move to Kubernete
• [Kontena - a docker platform in Ruby](Application Containers for Masses)
• lorispack - Network Microsegmentation for Docker container deployments
• Lorry - a docker-compose.yml validator and composer
• netmanager 1.0 - Network management for docker containers
• Network Containers
• nginx-proxy
  • tcp request를 domain name base로 구분하여 각각의 docker container로 연결해주는 nginx 기반의 proxy
  • nginx-proxy container가 docker.sock를 연결하여 구동
    • docker run -d -p 80:80 -v /var/run/docker.sock:/tmp/docker.sock:ro jwilder/nginx-proxy
  • 다른 docker container 구동시 VIRTUAL_HOST env로 정의하면, docker-gen에 의해 nginx-proxy의 config가 변경되어 재구동
    • docker run -e VIRTUAL_HOST=foo.bar.com ...
• Notary project comprises a server and a client for running and interacting with trusted collections
• Omnibus – Dependency Isolation Without Docker
• registry.hub.docker.com
• rocker-compose - Docker composition tool with idempotency features for deploying apps composed of multiple containers
• seagull - Friendly Web UI to manage and monitor docker

Nomad

• Nomad, a cluster manager and scheduler designed for microservices and batch workloads
• 오픈소스 간단 리뷰 - nomad : 가벼운 스케쥴러, 강력한 성능

OpenStack

• 공개된 카카오 오픈 스택 관련 공개 및 강의 자료
• 처음 본 Kolla
• 처음 본 오픈 스택의 Cinder
• 처음 본 오픈스택 Swift
• 처음 본 오픈 스택의 Nova
• 처음 본 오픈 스택 Glance

RunC

• [Announcing a lightweight universal runtime container, by the OPEN CONTAINER PROJECT](http://runc.io/

Triton

• Triton Elastic Container Service
• Comparing Triton containers to VMs and bare metal servers

Troubleshooting

• Bind address already in use
  • container를 stop 했는데도, 해당 container가 사용하던 port를 반환받지 못함. 어느 정도 시간이 지난 후 다시 run 하면 되긴 하는데, 그 시간이 일정하지 않음. 짧은 경우도 있고 제법 긴 경우(몇 분?)도 있음
  • github.com/moby/moby/issues/8714
• docker: Error response from daemon: Container command '...' could not be invoked
  • Does the entrypoint exist?
  • Is it executable?
• kernel:unregister_netdevice: waiting for lo to become free. Usage count = 1
  • kernel bug로 cent os 7.x에서 docker를 사용하는 경우 계속 발생(ubuntu 쓰면 안 나타난다고 함)
  • service 영향은 상황마다 달라서 일률적으로 알 수 없다고 함
  • www.reddit.com/r/docker/comments/6j2s2s/kernelunregister_netdevice_waiting_for_lo_to/
  • Docker on CentOS 7.2: kernel:unregister_netdevice: waiting for lo to become free. Usage count = 1
• Docker for mac eating disk space 그냥 해당 directory 삭제 후 재시작
  • Docker.qcow2 never shrinks - disk space usage leak in docker for mac 2017.03.17 현재, 곧 1년이 되며 여전히 해결 못함
• iTerm3.0 설치 후 docker quickstart terminal이 정상 동작하지 않을 때; Replace /Applications/Docker/Docker Quickstart Terminal.app/Contents/Resources/Scripts/iterm.scpt with this

Vagrant

• [Infographic] Docker vs. Vagrant
• Speed up your Vagrant NFS shares with cachefilesd
• Otto — the successor to Vagrant. Otto is the single solution to develop and deploy any application
• 15분만에 윈도우에서 Ansible 테스트 환경 구축하기 (서버 1대 + 노드 5대)

Windows

• Windows Docker Toolbox에서 Host PC와 폴더 공유하기
• Using Docker Tools on Windows 10 with Hyper-V