Fixing X and Y Coordinate Offsets in AprilTag Detection with Intel RealSense about librealsense

[MartyG-RealSense]

Hi @iamstrang3 If you have access to the RealSense Viewer tool then you could first try resetting the camera to its factory-new default calibration settings using the instructions at #10182 (comment) in order to eliminate the possibility of a mis-calibration in your camera's sensors.

Mis-calibration can occur if the camera receives a physical shock such as a hard knock, a drop on the ground or severe vibration.

[iamstrang3]

Thank you for the response. I did the steps exactly as mentioned. But I still don't get the right coordinates.

[MartyG-RealSense]

If the camera's projector is enabled then its IR emitter (which projects a pattern of dots onto the scene) may make fiducial image markers like apriltags harder for the camera to read by overlaying dots on the tag image. So please try making sure that the emitter is disabled by using the Python code at #10065 (comment) in order to eliminate the dot pattern as a potential cause of inaccuracy.

[MartyG-RealSense]

Hi @iamstrang3 Do you require further assistance with this case, please? Thanks!

[iamstrang3]

Hi, sorry for the late reply. I tried to add those lines in my code but it did not help. I am getting the right coordinates at a certain distance then the error keeps increasing with distance.

[MartyG-RealSense]

At what distance does the increase in error start becoming noticeable? It is normal for error to be near zero at the camera and increase linearly as the distance of an observed object / surface from the camera increases. This phenomenon is called RMS Error and becomes noticeable on the D435i model beyond 3 meters distance from the camera.

[iamstrang3]

I have the D435 model and the error is seen within a meter distance from the camera. Also the distance is almost accurate but the problem is with the conversion from pixel to 3d coordinates.

[MartyG-RealSense]

Is it possible to make the AprilTags larger to test whether moving the camera further away makes the tags more difficult for the camera to read?

[iamstrang3]

The camera read the april tag just fine at larger distances.

[MartyG-RealSense]

I note that you are using 640x480 resolution. As resolution is reduced, depth accuracy also reduces. For the D435 camera model, 848x480 is the optimal resolution for depth accuracy.

Does accuracy improve at distance if you use 848x480 and 30 FPS for both depth and color streams if possible? This configuration will only be supported on a USB 3.2 connection, whilst a USB 2.1 connection is only able to use 640x480 at 30 FPS.