docker ... generate results in permission denied #6303

ma-fl · 2019-10-30T21:50:08Z

Description

Cannot generate initial configuration by running

docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no matrixdotorg/synapse:latest generate

Container running as UserID 0:0, ENV (or defaults) requests 991:991
Creating log config /data/myserver.invalid.log.config
Generating config file /data/homeserver.yaml
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 659, in <module>
    main()
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 654, in main
    hs = setup(sys.argv[1:])
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 333, in setup
    "Synapse Homeserver", config_options
  File "/usr/local/lib/python3.7/site-packages/synapse/config/_base.py", line 576, in load_or_generate_config
    with open(config_path, "w") as config_file:
PermissionError: [Errno 13] Permission denied: '/data/homeserver.yaml'

Steps to reproduce

docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no matrixdotorg/synapse:latest generate

Expectation was a config file is generated.

I believe the following patch might fix this (untested):
ma-fl@70ed663#diff-d3b843a551028930ec04a76a93e6efcb

As a quick workaround I just adjusted the ownership of /data in the volume and retried.

The text was updated successfully, but these errors were encountered:

richvdh · 2019-10-30T23:18:59Z

well, it works ok here. Are you starting with a non-empty volume?

ma-fl · 2019-10-31T09:37:54Z

I am starting with an empty volume and pulling the latest image from dockerhub:

root@t490s ~ # docker image ls
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
root@t490s ~ # docker volume ls
DRIVER              VOLUME NAME
root@t490s ~ # docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no matrixdotorg/synapse:latest generate
Unable to find image 'matrixdotorg/synapse:latest' locally
latest: Pulling from matrixdotorg/synapse
89d9c30c1d48: Pull complete 
910c49c00810: Pull complete 
e573a2f39893: Pull complete 
a147d60101b9: Pull complete 
04550de40735: Pull complete 
0c11f24dcd85: Pull complete 
c6d1926fc15c: Pull complete 
d989f8d32303: Pull complete 
784f32c3eda1: Pull complete 
Digest: sha256:eabdabefe72487785427939ac3f55d37a20dad53c005496dbbac3f6ef248a3b0
Status: Downloaded newer image for matrixdotorg/synapse:latest
Container running as UserID 0:0, ENV (or defaults) requests 991:991
Creating log config /data/myserver.invalid.log.config
Generating config file /data/homeserver.yaml
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 659, in <module>
    main()
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 654, in main
    hs = setup(sys.argv[1:])
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 333, in setup
    "Synapse Homeserver", config_options
  File "/usr/local/lib/python3.7/site-packages/synapse/config/_base.py", line 576, in load_or_generate_config
    with open(config_path, "w") as config_file:
PermissionError: [Errno 13] Permission denied: '/data/homeserver.yaml'

Now the volume exists but still is owned by root. Manually fixing ownership:

root@t490s ~ # docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no --entrypoint /bin/sh matrixdotorg/synapse:latest        
/ # chown -R 991:991 /data
/ #

And then rerunning works:

root@t490s ~ # docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no matrixdotorg/synapse:latest generate
Container running as UserID 0:0, ENV (or defaults) requests 991:991
Generating config file /data/homeserver.yaml
Generating signing key file /data/myserver.invalid.signing.key
A config file has been generated in '/data/homeserver.yaml' for server name 'myserver.invalid'. Please review this file and customise it to your needs.

Docker version, in case that is relevant:

root@t490s ~ # docker --version
Docker version 19.03.4-ce, build 9013bf583a

I think the issue is in /start.py in the container in the function run_generate_config:

# cat start.py | tail -n 89 | head -n 6
    if ownership is not None:
        args = ["su-exec", ownership] + args
        os.execv("/sbin/su-exec", args)

        # make sure that synapse has perms to write to the data dir.
        subprocess.check_output(["chown", ownership, data_dir])

It's first execve'ing synapse under user id 991 to write the config to /data. The chown is expected to be executed afterwards as can be seen above, however this is never reached, so /data is never going to be owned by 991.

dan0v · 2019-10-31T09:58:48Z

I ran into this same issue yesterday and was finally able to resolve it and get synapse up and running by using the migrate_config option instead of generate to get the initial config files. After editing the created config files, everything else went smoothly. (I used docker-compose from /contrib/docker)

gaycookie · 2019-11-12T14:34:41Z

I seem to have the same issues when trying to generate on CentOS 7

Container running as UserID 0:0, ENV (or defaults) requests 991:991
Generating config file /data/homeserver.yaml
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 659, in <module>
    main()
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 654, in main
    hs = setup(sys.argv[1:])
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 333, in setup
    "Synapse Homeserver", config_options
  File "/usr/local/lib/python3.7/site-packages/synapse/config/_base.py", line 576, in load_or_generate_config
    with open(config_path, "w") as config_file:
PermissionError: [Errno 13] Permission denied: '/data/homeserver.yaml'

richvdh · 2019-11-18T17:46:33Z

my apologies, it seems I was testing with an old copy of the image; this was introduced in synapse 1.4.0 (presumably by #5970)

anoadragon453 · 2019-11-20T12:00:30Z

So it does indeed strike me as odd that one part of the PR would execute those actions in one order:

https://github.com/matrix-org/synapse/pull/5970/files#diff-d3b843a551028930ec04a76a93e6efcbR122-R123

And the next (which breaks) is executed in the reverse order:

https://github.com/matrix-org/synapse/pull/5970/files#diff-d3b843a551028930ec04a76a93e6efcbR172-R176

Before the PR things indeed ran in 1. check data dir perms 2. execute on them order:

https://github.com/matrix-org/synapse/pull/5970/files#diff-d3b843a551028930ec04a76a93e6efcbL152-L173

I've tested the patch locally and it works for me.

I've created a PR for this here: #6389

anoadragon453 · 2019-11-20T13:33:10Z

The patch has been merged in #6389, thank you for providing it. Let us know if you experience any further problems by creating a new issue.

makakken · 2021-10-25T10:15:10Z

seems this issue is still not fixed? I've pulled latest image today, but i can't get "generate" - command running... permission denied for homeserver.yaml

squahtx · 2021-10-25T10:57:10Z

@makakken Could you post the full command you are running, plus all the output it produces?

makakken · 2021-10-25T11:02:04Z

i've tryed via docker-compose

version: "3.3"

services:
  synapse:
    image: "matrixdotorg/synapse:latest"
    restart: always
    ports:
      - 8008:8008

   command: "generate"

    volumes:
      - synapsedata:/data

    environment: 
      SYNAPSE_SERVER_NAME: "mytest.org"
      SYNAPSE_REPORT_STATS: "no"
      SYNAPSE_CONFIG_PATH: "/opt/homeserver.yaml"

output:


  File "/usr/local/lib/python3.8/site-packages/synapse/app/homeserver.py", line 455, in main,
    main(),
Traceback (most recent call last):,
PermissionError: [Errno 13] Permission denied: '/opt/homeserver.yaml',
Generating config file /opt/homeserver.yaml,
  File "/usr/local/lib/python3.8/runpy.py", line 194, in _run_module_as_main,
    return _run_code(code, main_globals, None,,
  File "/usr/local/lib/python3.8/runpy.py", line 87, in _run_code,
    exec(code, run_globals),
  File "/usr/local/lib/python3.8/site-packages/synapse/app/homeserver.py", line 465, in <module>,
  File "/usr/local/lib/python3.8/site-packages/synapse/app/homeserver.py", line 331, in setup,
    hs = setup(sys.argv[1:]),
    config = HomeServerConfig.load_or_generate_config(,
  File "/usr/local/lib/python3.8/site-packages/synapse/config/_base.py", line 645, in load_or_generate_config,
    with open(config_path, "w") as config_file:

squahtx · 2021-10-25T11:49:07Z

@makakken Could you file a new issue with the above information? Thanks.

kavemang · 2023-02-23T05:57:22Z

I am starting with an empty volume and pulling the latest image from dockerhub:

root@t490s ~ # docker image ls
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
root@t490s ~ # docker volume ls
DRIVER              VOLUME NAME
root@t490s ~ # docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no matrixdotorg/synapse:latest generate
Unable to find image 'matrixdotorg/synapse:latest' locally
latest: Pulling from matrixdotorg/synapse
89d9c30c1d48: Pull complete 
910c49c00810: Pull complete 
e573a2f39893: Pull complete 
a147d60101b9: Pull complete 
04550de40735: Pull complete 
0c11f24dcd85: Pull complete 
c6d1926fc15c: Pull complete 
d989f8d32303: Pull complete 
784f32c3eda1: Pull complete 
Digest: sha256:eabdabefe72487785427939ac3f55d37a20dad53c005496dbbac3f6ef248a3b0
Status: Downloaded newer image for matrixdotorg/synapse:latest
Container running as UserID 0:0, ENV (or defaults) requests 991:991
Creating log config /data/myserver.invalid.log.config
Generating config file /data/homeserver.yaml
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 659, in <module>
    main()
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 654, in main
    hs = setup(sys.argv[1:])
  File "/usr/local/lib/python3.7/site-packages/synapse/app/homeserver.py", line 333, in setup
    "Synapse Homeserver", config_options
  File "/usr/local/lib/python3.7/site-packages/synapse/config/_base.py", line 576, in load_or_generate_config
    with open(config_path, "w") as config_file:
PermissionError: [Errno 13] Permission denied: '/data/homeserver.yaml'

Now the volume exists but still is owned by root. Manually fixing ownership:

root@t490s ~ # docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no --entrypoint /bin/sh matrixdotorg/synapse:latest        
/ # chown -R 991:991 /data
/ #

And then rerunning works:

root@t490s ~ # docker run -it --rm --mount type=volume,src=synapse-data,dst=/data -e SYNAPSE_SERVER_NAME=myserver.invalid -e SYNAPSE_REPORT_STATS=no matrixdotorg/synapse:latest generate
Container running as UserID 0:0, ENV (or defaults) requests 991:991
Generating config file /data/homeserver.yaml
Generating signing key file /data/myserver.invalid.signing.key
A config file has been generated in '/data/homeserver.yaml' for server name 'myserver.invalid'. Please review this file and customise it to your needs.

Docker version, in case that is relevant:

root@t490s ~ # docker --version
Docker version 19.03.4-ce, build 9013bf583a

I think the issue is in /start.py in the container in the function run_generate_config:

# cat start.py | tail -n 89 | head -n 6
    if ownership is not None:
        args = ["su-exec", ownership] + args
        os.execv("/sbin/su-exec", args)

        # make sure that synapse has perms to write to the data dir.
        subprocess.check_output(["chown", ownership, data_dir])

It's first execve'ing synapse under user id 991 to write the config to /data. The chown is expected to be executed afterwards as can be seen above, however this is never reached, so /data is never going to be owned by 991.

im sorry if this is off topic but this saved my butt after an emergency migration of my main synapse process to a new local machine

particularly the use of chown from inside the synapse container

Myzel394 · 2023-11-07T18:09:46Z

Is there a solution to this? I'm facing the same issue

kevinveenbirkenbach · 2023-12-13T11:39:38Z

Is there a solution to this? I'm facing the same issue

I implemented the following ansible task to setup matrix: https://github.com/kevinveenbirkenbach/cymais/blob/master/roles/docker-matrix/tasks/main.yml

This is the context of the role:
https://github.com/kevinveenbirkenbach/cymais/tree/master/roles/docker-matrix

neilisfragile added A-Docker Docker images, or making it easier to run Synapse in a container. z-p3 (Deprecated Label) labels Nov 6, 2019

richvdh removed the z-p3 (Deprecated Label) label Nov 18, 2019

richvdh mentioned this issue Nov 18, 2019

Docker image, using "generate" doesn't work... #6365

Closed

richvdh added the release blocker label Nov 18, 2019

anoadragon453 self-assigned this Nov 20, 2019

anoadragon453 mentioned this issue Nov 20, 2019

Docker: Change permissions for data dir before attempting to write to it #6389

Merged

anoadragon453 closed this as completed Nov 20, 2019

hankster112 mentioned this issue Mar 3, 2023

Cannot start Synapse through docker-compose: Permission denied: '/data/homeserver.yaml' #15202

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

docker ... generate results in permission denied #6303

docker ... generate results in permission denied #6303

ma-fl commented Oct 30, 2019

richvdh commented Oct 30, 2019

ma-fl commented Oct 31, 2019

dan0v commented Oct 31, 2019

gaycookie commented Nov 12, 2019 •

edited

richvdh commented Nov 18, 2019 •

edited

anoadragon453 commented Nov 20, 2019 •

edited

anoadragon453 commented Nov 20, 2019

makakken commented Oct 25, 2021

squahtx commented Oct 25, 2021

makakken commented Oct 25, 2021 •

edited

squahtx commented Oct 25, 2021

kavemang commented Feb 23, 2023

Myzel394 commented Nov 7, 2023

kevinveenbirkenbach commented Dec 13, 2023

docker ... generate results in permission denied #6303

docker ... generate results in permission denied #6303

Comments

ma-fl commented Oct 30, 2019

Description

Steps to reproduce

richvdh commented Oct 30, 2019

ma-fl commented Oct 31, 2019

dan0v commented Oct 31, 2019

gaycookie commented Nov 12, 2019 • edited

richvdh commented Nov 18, 2019 • edited

anoadragon453 commented Nov 20, 2019 • edited

anoadragon453 commented Nov 20, 2019

makakken commented Oct 25, 2021

squahtx commented Oct 25, 2021

makakken commented Oct 25, 2021 • edited

squahtx commented Oct 25, 2021

kavemang commented Feb 23, 2023

Myzel394 commented Nov 7, 2023

kevinveenbirkenbach commented Dec 13, 2023

gaycookie commented Nov 12, 2019 •

edited

richvdh commented Nov 18, 2019 •

edited

anoadragon453 commented Nov 20, 2019 •

edited

makakken commented Oct 25, 2021 •

edited