For the RGB camera you can use the previous ML Camera API with Perception snapshot enabled in the Settings of the Magic Leap Support OpenXR Feature in Unity. You will also need to set your tracking origin to unbounded.
To get the pose of a pixel sensor at a specific time, you may need to look at this post: