Because adjoints have special scalar dot product, this was a Q&D hack that needs to be fixed. The "right way" is to support infinite `ReshapedArray`.