arm64

[zhongyong]

4.0 ok
5.0 run logs
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size

[tianon]

I'm not able to reproduce:

$ docker pull redis:5.0
5.0: Pulling from library/redis
Digest: sha256:fe80393a67c7058590ca6b6903f64e35b50fa411b0496f604a85c526fb5bd2d2
Status: Image is up to date for redis:5.0

$ docker run -it --rm redis:5.0
1:C 23 Oct 2019 21:39:21.358 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 23 Oct 2019 21:39:21.358 # Redis version=5.0.6, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 23 Oct 2019 21:39:21.359 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
                _._                                                  
           _.-``__ ''-._                                             
      _.-``    `.  `_.  ''-._           Redis 5.0.6 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._                                   
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 1
  `-._    `-._  `-./  _.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |           http://redis.io        
  `-._    `-._`-.__.-'_.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |                                  
  `-._    `-._`-.__.-'_.-'    _.-'                                   
      `-._    `-.__.-'    _.-'                                       
          `-._        _.-'                                           
              `-.__.-'                                               

1:M 23 Oct 2019 21:39:21.361 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
1:M 23 Oct 2019 21:39:21.361 # Server initialized
1:M 23 Oct 2019 21:39:21.361 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
1:M 23 Oct 2019 21:39:21.361 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
1:M 23 Oct 2019 21:39:21.362 * Ready to accept connections

[zhongyong]

arm64 centos7.7

[yosifkit]

This sounds very silimar to docker-library/cassandra#192.

[shyupc]

edit redis Dockerfile,
add

sed -i 's/--enable-cc-silence/& --with-lg-page=16 /' /usr/src/redis/deps/Makefile;

to Dockerfile and rebuild it

[dragonhaimax]

4.0 ok
5.0 run logs
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size
: Unsupported system page size

Have u solve the problem？

[zhongyong]

down src and self make

[yuzp1996]

Is there any way to solve this problem?

[tianon]

As I noted above, we aren't able to reproduce the problem, and it's not something we're very comfortable patching upstream's code for -- if this is an issue with Redis upstream compiled from source in a non-Docker environment as well, I'd suggest coming up with a detailed reproducer (ideally with the appropriate fix, and details of why it is the correct fix more than just "this makes it work") and reporting it to the Redis project.

[yuzp1996]

[root@ecs-16b1-0002 ~]# uname -r
4.18.0-80.7.2.el7.aarch64
[root@ecs-16b1-0002 ~]# uname -a
Linux ecs-16b1-0002 4.18.0-80.7.2.el7.aarch64 #1 SMP Thu Sep 12 16:13:20 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
[root@ecs-16b1-0002 ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (AltArch)
[root@ecs-16b1-0002 ~]# docker run redis:5.0.0
: Unsupported system page size
: Unsupported system page size
[root@ecs-16b1-0002 ~]# getconf PAGE_SIZE
65536

That is what I meet on my machine，I find some blog said it is because of the jemalloc when redis compile is different from my machine, It seems that I should compile on my machine to make sure the image can work on my machine

[yuzp1996]

[root@ecs-16b1-0002 ~]# uname -r
4.18.0-80.7.2.el7.aarch64
[root@ecs-16b1-0002 ~]# uname -a
Linux ecs-16b1-0002 4.18.0-80.7.2.el7.aarch64 #1 SMP Thu Sep 12 16:13:20 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
[root@ecs-16b1-0002 ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (AltArch)
[root@ecs-16b1-0002 ~]# docker run redis:5.0.0
: Unsupported system page size
: Unsupported system page size
[root@ecs-16b1-0002 ~]# getconf PAGE_SIZE
65536

That is what I meet on my machine，I find some blog said it is because of the jemalloc when redis compile is different from my machine, It seems that I should compile on my machine to make sure the image can work on my machine

It work when I use the image build on my own machine with dockerfile which in 5.0/dockerfile

[TravisLazar]

This seems related to this: jemalloc/jemalloc#467

I can replicate this consistently when the host Kernel is running on aarch64 hardware with 64k page sizes - which is the default page size for most major Linux distributions on Arm. It seems to indicate that the redis image was built on a machine running with a 4k page size.

Still doing further debug to completely verify that this is the exact issue.

[TravisLazar]

I have confirmed that rebuilding the redis image from source using this tree on a system with 64k pages enabled fixes this issue.

I have also confirmed that the pre-built images from DockerHub run out-of-the-box on a system with a 4k page size, but throw the aforementioned error with 64k page size.

Is the build server for this running Ubuntu 18.04? That would explain this issue.

[tianon]

As a matter of fact, yes, the build server is on Ubuntu. 😅

Is there some way to configure this at build-time so we don't have this issue? Does having it built for 64k page sizes break the ability to use the image on systems with a 4k page size?

(How do distribution builds handle this issue?)

[tianon]

It looks like we probably need something like the following:

https://salsa.debian.org/debian/jemalloc/-/blob/c0a88c37a551be7d12e4863435365c9a6a51525f/debian/rules#L8-23

# jemalloc supports a runtime page size that's smaller or equal to the build
# time one, but aborts on a larger one. If not defined, it falls back to the
# the build system's _SC_PAGESIZE, which in many architectures can vary. Set
# this to 4K on x86 for performance, and set it to 64K (2^16) on every other
# architecture, which should be a reasonable maximum. See Debian #843926, as
# well as upstream #467 for more context.
ifneq (,$(findstring $(DEB_HOST_ARCH),i386 amd64 kfreebsd-i386 kfreebsd-amd64 x32))
  DEB_CONFIGOPTS += --with-lg-page=12
else
  DEB_CONFIGOPTS += --with-lg-page=16
endif

# 2MB (2^21) is the default, but (as of 5.1.0) is overriden by whatever is
# found in /proc/meminfo. Avoid relying on the build system's configuration and
# just set it statically here.
DEB_CONFIGOPTS += --with-lg-hugepage=21

[tianon]

Heh, it also looks like perhaps https://github.com/redis/redis/blob/6f3b91fe26990f4c849d3f20269d69f3e3dc96f5/src/Makefile#L47-L55 should be updated to account for aarch64? (or perhaps that's intentionally missing there, and expected to work reasonably; redis/redis@4e9cf4c)