Turns out the latest working version for Spring Data JDBC is ojdbc8 19.15.0.0.1. ojdbc11 or later versions of ojdbc8 contain a bug that breaks batching.
Since Spring Data R2DBC only uses the driver for testing for it the latest working version is ojdbc11 21.6.0.0.1.