The app is now also out on iPhone! Exact same process, so if you have an iPhone, feel free to follow along :D This might just be the easiest FBT Setup we have tried to date. It has it's issues, but it might be enough for some. Let me know what you think! Have a great day everyone ❤
@@paxu_on_u821 I have Pinoquest video on my channel. Seems a little bit better. It works turning around, runs faster at 30fps but still only good for basic poses. And it runs at low FPS because limited phone hardware to run the AI. I have a version for PC with Cuda and puts 40% load on 2080ti just to run tracking from 2 cameras at 50fps.
i’ve been using this for the past few days now and honestly it’s great, it does have some bugs but for it being so cheap and new the tracking is Great so far and the experience is awesome!
@@StarLeader44 Just a warning: Slime VR trackers have terrible battery life. You can get an hour MAX on them, most likely going to be around 45 minutes, if I remember correctly.
the problem with the 14 fps is because the app is using an ai model to track your movement. basically is taking each frame of the video and passing it to the model, then the model gives you each track point in x/y values, after that it starts the real integration made by driver4vr passing that data in a format that vrchat can understand via osc. computer vision is hard and even harder on mobile devices, in a pc using movenet usually you could get around 30 and 40 fps. 15fps for a pose model working in real time is a crazy thing when you remember 3/4 years ago this was only possible using nvidia gpus on a pc.
@@FutureKLX300SMowner you can use your phone as a camera with a 3rd party software and use driver4vr, be in mind most pc usually can run the model at 30/40fps depending of pc specs, camera and light conditions
That’s super interesting. I feel like FB could release a standalone fbt camera meant to just set up on a table and provide tracking the quest users this way and it wouldn’t be a huge barrier to entry. No mounting required, just plug it in beside your quest and set it up on a table.
I bought this on iPhone earlier today, and my only real issue is how it seems to think my feet are farther forward than they are. I think it's most likely due to a lack of contrast in my backdrop, though, so if you upgrade to the full version, play with the angle and position of your camera in your playspace to get a full view of yourself with a high contrast backdrop. I'm sure if you have a green screen, that would work quite well.
This dude has helped me with so much problems I run into with the quest, and for a person who can't even afford to go to the laundry mat I find this very helpful. I'll be using this untill my slimevr trackers come in. Thank you for the help with everything
Apparently there is an app that does this on iPhone. If I manage to get my hands on one I'll make sure to cover it. Unfortunately, I don't have one right now.
Wow! Thanks I'm going to give it a shot with an old android I got laying around. I'm with you that I am excited that this will only get better and I really hope people invest the time money and energy in this type of app to make it better where we don't have to actually buy any other equipment for full body that is amazing!
Have you tried running the APK from the Windows 11 Subsystem for Android? I was wondering if it’s possible to run it from Windows 11 using my more powerful CPU and Camera.
This seems like a great idea for people like me that can't even afford conventional full body tracking. However, I do wonder if this method can be combined with other full body tracking alternatives to improve accuracy, like owoVR, which I found to be quite easy as well. Only issue with that one is looking around for enough phones to make anyone suspicious
Mmm no tiene sentido que funcione con la Ip sin ninguna configuración extra y ai muncha gente diciendo que es una estafa boi a hacerle caso a mi sentido común y no lo haré
This is wonderful! Going to have to wait on this as my favourite VR game is Blade & Scorcery so it would need to track fast movements, but I'm so happy to see this and definitely going to keep an eye on this!
I don't know if I will get a reply to this , but my phones camera is great , its smooth. But the moment I open the app , my camera drops to 4-7 fps . What do I do to get more fps so the tracking isn't heavily delayed?
15 euro is an insane price for FBT, even if it's a tiny bit janky. Seeing a work around saving yourself 100+ dollars from buying the Vive mounts or the PSVR color disc things is crazy.
An A.I wrote this comment with the key word being “RU-vid comment” I love this RU-vid video I just got done pla ying with my friends and I got a new notification on my phone so I checked my phone and checked my phone and checked my phone and checked my phone and checked my phone and checked my phone and checked my phone and checked my phone and checked my phone and checked my phone and I liked the video
I have a problem, every time I try and connect it says connection refused. All my info is right and it just started doing this when I bought the full body experience. Need help!
There's a weekly meetup in VRC that I go to, this is going to be a game changer, since we mostly just hang out and talk (drinking may or may not be involved, LOL). SO for me this is perfect, as I use my Quest 2 with my PC, now I can have full body tracking without spending hundreds for body trackers. Thanks Mysticle, as always your content is awesome and I am glad you do what you do. Edit... Just installed the app, took all of a few minutes to setup and test, to see it work in VRC. SO I paid the $15, even if I only use the Driver 4VR app once a week or less, it's well worth it. PLUS for the money I am also supporting a company that created this app. SO I see that as a win win for everyone.
the reason it's only 14 fps well if you're a programmer and work with computer vision you'll understand that it's very intensive for a device and it needs to do bunch of calculations and then doing weird wireless connecting networking stuff that I don't actually understand very well
Oh wow this is so cool. I don't know if this is even an option because I don't know how this app works when tracking but could you disable the tracking of the arms. The controllers kinda already have those covered and I don't really care which way my elbows are facing. I wonder if disabling those will improve fps. 🤔 What you guys think?
My theory about why the fps is so low is that your phone is handling a lot of data stuff constantly at all times. From what I can tell, the app is; receiving the video feed, running identification software to locate what body is where, running that calculation and sending it to the receiving software via the internet, and doing all of that 14 times in a second. If there were a way to run it through a pc it would likely have less latency up to the limit of how fast your internet is.
Very cool thanks. I think the obvious application is for creating 3D animation. After viewing this I am little surprised and disappointed to see Meta Quest 2 hasn't already solved these motion tracking issues. I used to do fully body motion capture with a few X box 360 cameras 7 years ago. I thought Oculus went wireless cause they had somehow perfected their technology. Definitely would like see some improvements, even it means wearing a few bluetooth trackers.
Could using a mirror, angled so that your body is always visible to the cam and your body as well, improve functionality one day? It would detect you first then detect the mirrored surface for basically 360° tracking, in theory
Yes and no bc its a ai and its very hard same if u turn 100 times whith ur eyes closed and then look directly forwords whith out going left to right very hard
Not sure tbh. The AI might see the reflection as a seperate body and try to track that and yours at the same time, making some odd deformation in the model.
@The Mysticle so do I go through the same process except open vrchat on pcvr instead? Because I recently attempted to do this and everytime I try to connect the app says "connection refused"
likely the app could only process the movement at 14 fps, this may or may not be true depending on how high spec your phone is and how well optimized your phone is.
Just tried it out for 15 bucks its pretty decent. hips move more realistic. Feet not tracking super great but at least when your standing its a more natural pose. Being able to sit and it not look weird like it normally does for stand alone also a big plus I think it's worth 15 bucks to support this company. The android version looks new so hopfuly it will continue to get better.
does anyone know if this works with air link? It keeps saying to open vrchat while its clearly open Edit: I found the solution, thank you for this tutorial, stay safe!
I downloaded it on my android and opened the application. I was quick to upgrade due to excitement, but I quickly ran into a crippling issue. The AI tracking does not pop up at all and I get 1 frame. Does anyone know how I can fix this, or did I just throw away $16?
So I have the Quest 2,Rift S and Valve Index. Seeing how it works on the Quest 2 by inputting the IP address but wonder will it work for the valve index? And if so how would you find that IP address and not the PC's IP 😂
You would use your PCs IP as the index is connected to the PC and all the programs work on your PC but if you have a PC you might be better off running a computer version of driver4vr with a webcam.
It works! very very buggy though as he said, but it still functions :) it wont track my legs correctly, the functions swap and its strange but its something!!
Does anyone know the other games that you can play with it? Because I don’t only want to play VR chat is it able to play thrill of the fight or like any football game?
I pretty sure someone probably told you already but the only reason driver vr is running at 14fps is that it requires a ton of cpu power. It uses deep learning to track.
Computer Vision research in early 2000's "wow we got a tracker running at 15fps using a high end PC!". Computer Vision consumer products in the early 2020's "WTF? why you no run faster than 15fps on my telephone?" XD
Honestly wish meta would just include a couple small pucks with the Quest 3. some wrist, ankle, and a waist strap doesn't seem like it should be that big of a deal to me. But I'm also no expert. Full body tracking in VR definitely needs to be the future to get more people engaged, the fact meta hasn't been trying to dominate that more is beyond me... Who doesn't want to put more of themselves in VR? Surely you want to be able to interact with your whole body.
Hey the misticle great video btw but I have a question, every time I calibrated with the t pose. It wouldn’t calibrate correctly. So I was wondering if you could help?
I tried it from this review, and while it works well on my phone it seems to have some issues when passing it through to the game. Flickering of my avatar and problems tracking my legs.
It doesn't have the feature to put my IP address into Driver4VR, but it's all connected to my headset, but the thing in VRChat doesn't seem to be working. I tried enabling it and closing VRChat and reopening it, even tried waiting a day, even tried restarting my Oculus. Nothing works. Starting to think I wasted my money on this.
Amazing but im hearing- If I already bought driver4vr on steam and I get the app I have to buy it again? Or is there some way for me to get my steam account connected to the app?
so I did try it out with just the waist tho. and it's a pretty simple setup. you just do exactly what he tells you to in the video. the waist does move but it only moves back and forth. not side to side. idk if you need the feet also to be able to do that. I will soon get the premium and try it all out together and see
please do a video on OpenXR eye tracking for Dynamic Foveated Rendering. It really needs to be pressed how much of an impact DFR could have if made standard. It's essentially *free* performance if implemented correctly and that needs to be made standard.
Curious. May not be anywhere near perfect, but an interesting approach to FBT. I think I'll try the limited free version just for the heck of it. But for true FBT, I'll keep saving my pennies for a real FBT.
I’m actually getting annoying o paid £17 and for some reason the trackings fine on my phone but when I calibrate I cannot physically get my feet tracking right it’s so annoying
