Actuating the arm to try and reach the target position (the location of the controller) is an inverse kinematics problem. I used code from here to do it. A great explanation too zalo.github.io/blog/inverse-kinematics/
@@clkruse my question is more of translating the target to fit within the local frame of the robot to fit the local frame of your body moving your hand around. So if I have my human size body moving my hand from my left to right side, how do I scale that movement up in 3D space so the robot will move from its left to right side.
Aww man!! Beautiful concept, I totally agree! It’s crazy how long ago you made this, because where we are in AR Tech, this is likely to become possibility soon.