Hologram Drift Issue When Tracking Object with Retroreflective Markers using Depth Camera (Raw data)

I am using the depth camera (raw). Is that the CV camera you are referring to? From what you are saying the depth frame and the depth sensor pose are not sinchronized, is that correct?