Differents in pose accuracy when changing fix frame in rviz

[Aussie25]

when viewing the apriltag tag in rviz, the noise and accuracy changes as I change the fix frame between apriltag and camera frame. Setting the fix frame to camera and viewing pose of tag bundle give a very rigid pose with very little noise. While keeping everything the same, just changing the fix frame to apriltag and viewing the pose of camera, gives a very noisy pose.

Am I doing something wrong by changing the fix frame in rviz that causes the change in pose accuracy. Would eventually need to use apriltag as my parent frame and camera as child frame.