Heyho :) Thank you for this good example video. I didnt know if this is a german channel, so I try in english. Currently I want to project some user interface elements onto a human hand via a leap motion sensor and a projector. The leap motion takes the hand position information via hand-tracking and updates the 3d model in the scene in real time. My problem is, how do I calibrate the projector (hanging above the monitor), to fit the UI elements to the hands of the human body? I guess since I have a 3d model already which updates in real time, I just have to tell the projector somehow to calibrate the UI elements correctly, means: angle, size, rotation, position. Do you know any help? :) Thank you
Hi Herr. Sounds like a fun project! You are correct, if your leap motion sensor is sending the position information to whatever 3D software you happen to be using and is translating and rotating the object everything should fall into place. What you want to do to calibrate the projector is to make sure that the virtual camera is in the same place in the 3d world as the real world. You also need to make sure the FOV of the camera matches the lens on your projector. I personally use a cube to do calibration and move the camera around in the scene till the output of the cube projection matches the real cube.
So the bit I am trying to understand is rendering out from your 3D package, taking that file to QLAB and then lining up the projector so that it all matches.. Can you please expand on this step as I would want to do this in a theatre
The tricky part is that QLab does not natively support full 3D projection mapping(with UV mapping). You would would be better off if you went with software that supports it if you have complex geometry. (Watchout). If you have a simple object to projection map you could get away with using the Bezier option in the edit surface screen. Additionally, if you don't need full 3D mapping you could always create a mask of the outline of the object and use that.
