feat: add Dockerfile for server & studio (0.10) #845

imbajin · 2020-02-01T16:14:16Z

Fix #1284 / Fix #840 / Fix #989 :

Use rocksdb as the default storage engine
Add hosts to speed up image build (comment by default)
Modify some configs to enable the server to run better in container
Because Dockerfile doesn't allow multiple startup commands, currently only the server will be automatically started after the container is started. If you want to start studio, enter the container to start it.

Here are some simple using commands:

# 0. download image
docker pull imbajin/hugegraph

# 1. start container
docker run -itd imbajin/hugegraph  # quick start

# (Optional configs)
docker run -itd --name=graph -p 18080:8080 -p 18088:8088 imbajin/hugegraph

# 2. (Optional) enter the container & start hugegraph-studio
docker exec -it graph /bin/bash
xxxx (start hugegraph studio by command)

TODOs:

Build from the latest code instead of tar package.
Support hubble studio
Add & split studio/loader into separate images, use docker-compose to manage them.
Maybe have better way to modify the configs to satisfied the container (like add a option for running in the foreground)

After the above completed, it can provides a one-click pure test environment for graph

1. Add hosts to speed up image download 2. Modify some configs to enable the server to run better in container 3. Because Dockerfile doesn't allow multiple startup commands, currently only the server will be automatically started after the container is started. If you want to start studio, you can enter the container to start it. Here is a simple container start command: ```bash docker run -it --name=graph -p 18080:8080 -p 18088:8088 hugegraph:0.10 /bin/bash ```

javeme

good job

javeme · 2020-02-02T04:51:52Z

Dockerfile

+RUN set -e \
+    && echo "192.30.253.112 github.com\n151.101.44.249 github.global.ssl.fastly.net" >> /etc/hosts \
+    && mkdir -p /root/server \
+    && curl -L -S ${PKG_URL}/hugegraph/releases/download/v0.10.4/hugegraph-0.10.4.tar.gz -o /root/server.tar.gz \


prefer to add an env var for version

javeme · 2020-02-02T04:59:45Z

Dockerfile

+    && tar xzf /root/server.tar.gz --strip-components 1 -C /root/server \
+    && rm /root/server.tar.gz \
+    && cd /root/server/ \
+    && sed -i "s/^restserver.url.*$/restserver.url=http:\/\/0.0.0.0:8080/g" ./conf/rest-server.properties \


can it be a real ip instead of 0.0.0.0

javeme · 2020-02-02T05:00:57Z

Dockerfile

+
+# 2. Init HugeGraph Sever (speed up)
+RUN set -e \
+    && echo "192.30.253.112 github.com\n151.101.44.249 github.global.ssl.fastly.net" >> /etc/hosts \


is the ip stable?

javeme · 2020-02-02T12:31:13Z

Dockerfile

@@ -0,0 +1,46 @@
+FROM ubuntu:xenial


should we also support centos?

We can only write a basically similar Dockerfile for CentOS. (Generally use Debian/Ubuntu)
Usually , I haven't seen the official image provide two types of Dockerfile,
Maybe we can see the opinions of other community users.

And here are some refers:

Cassandra_Dockerfile

Nginx_Dockerfile

Other Official Dockerfile

javeme · 2020-02-02T13:24:50Z

Dockerfile

+EXPOSE 8088
+WORKDIR /root
+
+ENTRYPOINT ["./server/bin/start-hugegraph.sh"]


replace server with hugegraph-server

javeme · 2020-02-02T16:36:53Z

Dockerfile

+    && sed -i "s/^restserver.url.*$/restserver.url=http:\/\/0.0.0.0:8080/g" ./conf/rest-server.properties \
+    && sed -n '63p' ./bin/start-hugegraph.sh | grep "&" > /dev/null && sed -i 63{s/\&$/#/g} ./bin/start-hugegraph.sh \
+    && sed -n '74p' ./bin/start-hugegraph.sh | grep "exit" > /dev/null && sed -i 74{s/^/#/g} ./bin/start-hugegraph.sh \
+    && ./bin/init-store.sh


add a shell install-server.sh to improve readability?
some references found https://github.com/search?l=Dockerfile&p=99&q=RUN++install.sh&type=Code

Need test it:
if there is a file named start.sh

echo "old msg"

RUN start.sh

RUN echo "old msg" && echo "new msg"

If we use a shell file to change the code, would dockerfile think this is a repeated step and skip the rebuild?

javeme · 2020-02-02T16:40:10Z

Dockerfile

+RUN set -e \
+    && echo "192.30.253.112 github.com\n151.101.44.249 github.global.ssl.fastly.net" >> /etc/hosts \
+    && mkdir -p /root/studio \
+    && curl -L -S ${PKG_URL}/hugegraph-studio/releases/download/v0.10.0/hugegraph-studio-0.10.0.tar.gz -o /root/studio.tar.gz \


seems no studio tar when building server

we may need to also trigger docker image building when studio release to resolve it.
and what is the behavior if studio tar don't exist: hugegraph-studio / releases / download / v0.10.0 / hugegraph-studio-0.10.0.tar.gz?

javeme · 2020-02-04T07:35:04Z

Dockerfile

+    lsof \
+    g++ \
+    gcc \
+    openjdk-8-jdk \ 


merge the 11-15 lines, and align with apt-get

javeme · 2020-02-04T07:40:58Z

Dockerfile

+# 3. Prepare for HugeGraph Studio
+ENV STUDIO_VERSION 0.10.0
+RUN set -e \
+    && echo "192.30.253.112 github.com\n151.101.44.249 github.global.ssl.fastly.net" >> /etc/hosts \


remove it since added when building server

Each layer of docker image use a separate network layer.
So when leave current layer(step), other step cannot reuse it

And other ways are troublesome to solve it, like this

javeme

@Linary @zhoney please take a look

1. Github-IP is not fixed, comment it now 2. For the convenience of users, the apt-source is not cleared by default.

update auth default config in rest-server.properties

remove line

imbajin · 2020-05-19T14:09:43Z

Also update default values for auth for #706

javeme · 2020-05-20T03:53:17Z

Also update default values for auth for #706

There are indeed some errors, please update default value to ConfigAuthenticator:
auth.authenticator=com.baidu.hugegraph.auth.ConfigAuthenticator

javeme · 2020-05-20T04:03:58Z

@imbajin Can you split the commits not related to docker?

revert

imbajin · 2020-05-20T08:23:35Z

@imbajin Can you split the commits not related to docker?

OK, maybe it's better to update all the configuration files & shells separately later

javeme · 2020-11-19T09:49:58Z

hugegraph-dist/src/assembly/static/conf/hugegraph.properties

@@ -42,7 +42,7 @@ cassandra.password=
 # hbase backend config
 #hbase.hosts=localhost
 #hbase.port=2181
-#hbase.znode_parent=/hbsae
+#hbase.znode_parent=/hbase


also move it to independent commit

1. Add hosts to speed up image download 2. Modify some configs to enable the server to run better in container 3. Because Dockerfile doesn't allow multiple startup commands, currently only the server will be automatically started after the container is started. If you want to start studio, you can enter the container to start it. Here is a simple container start command: ```bash docker run -it --name=graph -p 18080:8080 -p 18088:8088 hugegraph:0.10 /bin/bash ``` 1. Github-IP is not fixed, comment it now 2. For the convenience of users, the apt-source is not cleared by default.

This comment was marked as outdated.

Sign in to view

imbajin force-pushed the support-docker branch from 139ecbd to e9be45c Compare February 1, 2020 16:21

javeme reviewed Feb 2, 2020

View reviewed changes

rename dir & merge port

4da4b87

imbajin force-pushed the support-docker branch from d511abe to 4da4b87 Compare February 3, 2020 07:30

javeme reviewed Feb 4, 2020

View reviewed changes

imbajin added 2 commits February 4, 2020 16:31

set default volume path

9a42014

align command

b8fe879

javeme reviewed Feb 11, 2020

View reviewed changes

Comment ip-mapping & apt-repo clean

43b611b

1. Github-IP is not fixed, comment it now 2. For the convenience of users, the apt-source is not cleared by default.

javeme previously approved these changes May 6, 2020

View reviewed changes

zhoney previously approved these changes May 6, 2020

View reviewed changes

imbajin mentioned this pull request May 10, 2020

盼docker运行的 dockerfile #989

Closed

Update rest-server.properties

ea58576

update auth default config in rest-server.properties

imbajin dismissed stale reviews from zhoney and javeme via ea58576 May 19, 2020 13:57

imbajin and others added 2 commits May 19, 2020 22:02

Merge branch 'master' into support-docker

8c15a15

Update rest-server.properties

0fbaff7

remove line

revert changes for auth

3b24a5a

revert

javeme reviewed Nov 19, 2020

View reviewed changes

Merge remote-tracking branch 'upstream/master' into support-docker

438bfe5

javeme approved these changes Nov 20, 2020

View reviewed changes

Linary approved these changes Nov 20, 2020

View reviewed changes

zhoney approved these changes Nov 20, 2020

View reviewed changes

zhoney merged commit 67cfb6f into apache:master Nov 20, 2020

imbajin mentioned this pull request Jan 25, 2021

建议像neo4j那样, 提供一个方便可用的docker镜像, 降低安装部署成本 #1346

Closed

s348268281 mentioned this pull request Jul 5, 2021

[Question] 关于docker运行hugegraph-studio #1536

Closed

1 task

imbajin changed the title ~~Add Dockerfile for server & studio~~ feat: add Dockerfile for server & studio (0.10) Feb 22, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: add Dockerfile for server & studio (0.10) #845

feat: add Dockerfile for server & studio (0.10) #845

imbajin commented Feb 1, 2020 •

edited

This comment was marked as outdated.

javeme left a comment

javeme Feb 2, 2020

javeme Feb 2, 2020

javeme Feb 2, 2020

javeme Feb 2, 2020

imbajin Feb 3, 2020 •

edited

javeme Feb 3, 2020

javeme Feb 2, 2020

javeme Feb 2, 2020 •

edited

imbajin Feb 3, 2020 •

edited

javeme Feb 2, 2020

javeme Feb 11, 2020 •

edited

javeme Feb 4, 2020

javeme Feb 4, 2020

imbajin Feb 4, 2020

javeme Feb 11, 2020

javeme left a comment

imbajin commented May 19, 2020 •

edited

javeme commented May 20, 2020

javeme commented May 20, 2020

imbajin commented May 20, 2020

javeme Nov 19, 2020

feat: add Dockerfile for server & studio (0.10) #845

feat: add Dockerfile for server & studio (0.10) #845

Conversation

imbajin commented Feb 1, 2020 • edited

This comment was marked as outdated.

javeme left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

imbajin Feb 3, 2020 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

javeme Feb 2, 2020 • edited

Choose a reason for hiding this comment

imbajin Feb 3, 2020 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

javeme Feb 11, 2020 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

javeme left a comment

Choose a reason for hiding this comment

imbajin commented May 19, 2020 • edited

javeme commented May 20, 2020

javeme commented May 20, 2020

imbajin commented May 20, 2020

Choose a reason for hiding this comment

imbajin commented Feb 1, 2020 •

edited

imbajin Feb 3, 2020 •

edited

javeme Feb 2, 2020 •

edited

imbajin Feb 3, 2020 •

edited

javeme Feb 11, 2020 •

edited

imbajin commented May 19, 2020 •

edited