Hello good ppl of the board
I'm trying to track a set of points across frames. So, let's say I have a set of screen-projected coordinate points at time [italic]t[/italic] and another one at time [italic]t+1[/italic] of the same 3d points (3d coords are also known since I'm rendering them in OpenGL).
So, let's say I've got the homography of the two sets of 2d points (using OpenCV) and somehow managed to get the 3x3 rotation matrix and a translation vector.
My question is, how do I update my camera rotation & orientation from this information in OpenGL? I've tried just sticking it into the modelview matrix, but it does nothing.
I also have tried multiplying each of the points in second set by the homography (x'~Hx) and then using gluUnProject to obtain the new 3d coords for the X' points, but that just made them disappear from the view. Though, I suspect, I may need to do something else to the homography matrix before multiplying it with points.
Your kind help is greatly appreciated.