DragControls movement doesn't map to mouse when used within RenderTexture

[chuckdries]

• three version: 0.173.0
• @react-three/fiber version: 8.17.14
• @react-three/drei version: 9.121.4
• node version: N/A (sandbox)
• npm (or yarn) version: N/A (sandbox)

Problem description:

My naive expectation would be that using a DragControls within a RenderTexture, the dragged object would track the mouse's raycasted position across the surface the texture is rendered on (such as the threejs raycast texture example). Instead, it seems to map to the mouse's position across the Canvas.

dragcontrols.within.rendertexture.2.mp4

Relevant code:

https://codesandbox.io/p/sandbox/kws3cx

<Box>
  <meshStandardMaterial>
    <RenderTexture attach="map" anisotropy={16}>
      <PerspectiveCamera
        makeDefault
        manual
        aspect={1 / 1}
        position={[0, 0, 5]}
      />
      <color attach="background" args={["orange"]} />
      <DragControls axisLock="z">
        <Circle>
          <meshBasicMaterial color="red" />
        </Circle>
      </DragControls>
    </RenderTexture>
  </meshStandardMaterial>
</Box>

Suggested solution:

It's clear to me that we need to be doing a raycast, but I'm still pretty new to threejs and 3d programming in general, so I don't really know where to start with implementing it.

[DennisSmolek]

This is probably never going to work within drei.. You would need to matrix transform the raycasts in order and I dont think the portal setup allows that, youd have to translate cursor direction on the view to the abase scene and then through the portal..

I need to see how nested portals handle this becuase we do cast new rays through portals

[DennisSmolek]

Ok I spoke too soon. I got this to work by using the core r3f events over the useGesture ones. Hopefully it doesnt break somewhere unexpectedly.

Fixed in v11