The example is the advance example from horovod github for keras. For more details please refer to their github.
Warning: Please be aware that calculation on multiple node is not straight forward and require some readings and optimizations both on the GPUs and CPUs side. As a first step in multi-node calculation, please refer to 1, 2 and 3.