Тёмный

Quest 3 Mixed Reality Flight Simulation 

Russ Barlow
Подписаться 27 тыс.
Просмотров 108 тыс.
50% 1

A proof of concept attempt at true Mixed Reality Flight Simulation utilizing the color passthrough video to combine a real life cockpit with the VR flight sim world.

Опубликовано:

 

29 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 247   
@VRFlightSimGuy
@VRFlightSimGuy 10 месяцев назад
Super interesting video here Russ, thank you for sharing. I had a feeling it wouldn't be long before someone developed a solution given the pass through on the Quest 3 is as you say, getting there. I may give this a go once I get the Somnium VR1 and XR-4 in my hands. Exciting stuff. Best wishes.
@rbarlow
@rbarlow 10 месяцев назад
Thanks for your comments . Yes it’s not a great solution yet but Varjo has a rather elegant implementation of MR. A home cockpit will never compete with the beauty of a VR cockpit so I’d love to see an effective hand tracking solution but for hands on training MR seems to be the best current option. Keep up your great work for the community!
@VRFlightSimGuy
@VRFlightSimGuy 10 месяцев назад
​@@rbarlowCheers Russ 😊
@olliefick8881
@olliefick8881 7 месяцев назад
Russ, I applaud your efforts to make flight simulation more realistic. There has been a lot of discussion about how x-plane generates weather and how the aircraft responds to the weather. Much has been said about wind shear, microbursts etc, but I have not found anything about how the pilot's upper body responds within the aircraft relative to the instruments. It is this response that affects the pilot's ability to twist dials and read displays in turbulance. This is a very important aspect of flying in a real aircraft. From the seat up, a pilot's body is flexible and responds to external forces differently than the aircraft. Modeling this correctly would greatly improve realism. This is especially important in MR. Your thoughts?
@brettsflyndad9945
@brettsflyndad9945 9 месяцев назад
@Russ Barlow. Hi Russ. I'm certain you may not remember, but we have had this debate before and I stand by my previous argument. It was some time ago, but we debated which "system" would be best for VR flight sim cockpit interactivity. I do not agree that mixed reality is the future of VR flight sim. There are several negatives which I will mention below. My belief is the use of VR hands, in combination with real world yoke, throttles, rudders, and whatever knobs, switches, flap levers, trim wheels, and equally important, KNOBS, where the real world peripherals are SYNCED with your VR cockpit will be the dominant means of interaction. There are several advantages to this type system over a mixed reality system. 1. The break of immersion with mixed reality is awful, and even though this is expected to improve, you will still be forced to use, often very expensive peripherals. 2. In mixed reality, the user will still need to purchase the real world screens, gauges, and displays, of all the various cockpit equipment and avionics. AND, you would be "locked in" to those devices. In a VR hands, used with synced real world peripherals, 100% of the tactile feel is achieved, WITHOUT the need for real world screens, gauges, or displays. 3. In mixed reality, your peripherals are, for the most part, fixed, and aren't conducive to use with a variety of aircraft. With the system I am referring to, while still not totally adjustable to every kind of cockpit, it is considerably more flexible and can be fairly easy to move around to accommodate various cockpits. This system IS currently being developed and has the potential to totally change how we interact with our Sims. Simple kits will be produced for various aircraft and many of those parts will be usable for other aircraft. For example: A consumer would purchase a General Aviation "panel". Then purchase a Piper Warrior package. This package would include (assuming they already had basic GA yoke, throttle, and rudder pedals) 6 single knobs for the 6-pack, a flaps handle, a tank selector unit, 4 dual rotary knobs, a trim wheel,..... you get the idea. A user could purchase as much, or as little, as they choose. Personally, I feel I would only "need" the rotary knobs, the trim wheel, and the flaps handle as the tactile input on those items is significantly more important than needing to "feel" the landing light switch. I would just "push" the virtual switch with my virtual hand. Just hearing the click it would make would be satisfying enough. Now exactly HOW does this system work??? The user sits in their VR cockpit. Through 3rd party software they import the individual 3d model of the real world knob. While holding the real world knob, they see their virtual hand holding the virtual knob. They then place the knob on their GA panel exactly where the VR panel knob is and "lock" it there. .... They then proceed to do this with all of the peripherals they purchased. And whallaa... When the user reaches out with their virtual hand to turn the knob to adjust their altimeter they are actually grabbing and turning a real world knob because their real world knob and virtual cockpit knob are in the exact same location. The system is still in its infancy, but as you stated, the advancements are coming very fast . There are a few RU-vid videos of the first of these systems being used and it will only continue to get better and more accurate. I'd love to hear your thoughts on this system after getting a good look at it. As always, I love your videos and keep up the excellent content! Thanks.
@chuckle5253
@chuckle5253 10 месяцев назад
This type of innovation is what makes me excited for the future of VR/MR, thanks for your contribution to the space!!
@karmabasedj8184
@karmabasedj8184 10 месяцев назад
Another viable option is to use InfuseVR where you can see 3d representations of your hardware in VR
@garinhess
@garinhess 10 месяцев назад
Great POC Russ. I've been trying to set it up with my Quest 3 and when I add the boxes all I see is white noise graininess. I go to camera configs and the cameras won't initialize and the option that you have that said "Quest, Pico, of Vive XR Use Solid Color..." just doesn't exist on my camera config screen. Any tips? I'm super interested to try this out.
@garinhess9069
@garinhess9069 10 месяцев назад
Figured it out...I was on the latest full release and needed to be on previous Beta of the Reality Mixer.
@Jasperjvr2010
@Jasperjvr2010 10 месяцев назад
@@garinhess9069 Thanks for this but I see you need a code to access this beta. Can you perhaps advise?
@itin513
@itin513 10 месяцев назад
Same here. I can't get the Quest3 Cameras to be available. Looks like I need the Beta version you mentioned. Is there an access code for the beta as Jasper mentioned?
@jonmabec
@jonmabec 10 месяцев назад
That is pretty cool! This is getting really close to what I am hoping for! Really hope that external cameras will be supported soon and proper chroma keying for physical greenscreens. How did you find the resolution of the cameras hold up with actually being able to read the instruments, looking at physical checklists and charts, taking notes etc. ?
@jango71
@jango71 10 месяцев назад
You do not need chroma backgrounds for this to work. It may help but it is not the same technology.
@jonmabec
@jonmabec 10 месяцев назад
@@jango71 Yes I know. But there are some many use cases for using chroma keying on a physical greenscreen. Masking out your physical panel and peripherals. What is shown in this video is simply a workaround to enable passthrough from the Quest 2 cameras.
@stevefiser6000
@stevefiser6000 9 месяцев назад
How soon would you venture to guess will there be a hand glove/passthrough of hands so you can manipulate the different instructions/controls without headset grips directly in Sim? Or is there? First time viewer and enjoyed tutorial. Thank you
@jimbossimrigs7961
@jimbossimrigs7961 10 месяцев назад
Was the footage from the first 20 seconds of this video from the Quest3 or another professional solution?
@AdamM-fd7hs
@AdamM-fd7hs 8 месяцев назад
Can you use Steam Reality Mixer to overlay on non-Steam games? I have DCS standard install, so I need to be able to run the Steam Reality Mixer over the non-Steam DCS. It would be prohibitively expensive to buy all my DCS aircraft and assets over just to get them in Steam
@robettinger827
@robettinger827 5 месяцев назад
Can mixed reality b done without Virtual Desktop? I use my Quest 3 using the link cable directly ...
@rbarlow
@rbarlow 5 месяцев назад
VD is required but it works with the cable now
@jankristensen7884
@jankristensen7884 8 месяцев назад
Hi, is the main computers graphic card still important in the VR enviroment?
@rbarlow
@rbarlow 8 месяцев назад
If you mean the computer running the game(MSFS) and SteamVR yes. The processor in the headset does handle the passthrough video and runs Virtual Desktop but your computer needs to have the horsepower as it does with a regular VR headset. The Quest3 resolution is a better less than the HP Reverb G2 so in that respect you don’t need the computer power as for an Aero or Crystal.
@jankristensen7884
@jankristensen7884 8 месяцев назад
i thought about a set up with ex. 3 screens/3 projectors , vs one VR headset?
@twodogzz9291
@twodogzz9291 10 месяцев назад
Your "quest" is the same as mine,😁 so I've been following the VR pass-thru development and waiting for this moment.👀 I just checked the Meta shop page for the Meta Quest 3 and see they offer two storage capacities 126 & 512 GB. I guess bigger is better, 💪but 128 GB is AU$799.99 and 512 GB is AU$1,049.99 so a AU$250 difference... just might not get past the "finance manager"! 💰👰‍♀🚫 What do recommend for the storage?
@marcusdamberger
@marcusdamberger 9 месяцев назад
It's weird, they don't have a 256GB that probably everyone would opt for.. The Quest 2 has a 256GB version oddly.
@zsavage1820
@zsavage1820 9 месяцев назад
I wouldn't shit on the best part of Oculus... THEY SUCK!!!
@Wh1terider
@Wh1terider 10 месяцев назад
This topic interest me as someone that has a lot of money in peripherals and needs to be able to see them. It's hard to correlate their relationship and what's happening in VR in a smooth manner, rather than having to constantly rely on muscle memory.
@SimHangerFS
@SimHangerFS 10 месяцев назад
A glimpse in to the future of VR. Thanks Russ!
@QBziZ
@QBziZ 10 месяцев назад
This is a way forward. Optimal hand tracking and virtual cockpit interaction, with haptic feedback, would be another piece of the puzzle.
@brettsflyndad9945
@brettsflyndad9945 9 месяцев назад
They actually already have this and it is being further developed. No "mixed reality" needed. Real world knobs, etc., that have virtual 3d models of its real world counterpart, that you can then place in your virtual cockpit and sync them together. Reach out to grab that virtual flaps lever, and actually grab a real world flaps lever whose location is perfectly synced with your virtual flaps lever! It is VERY cool and I believe this type system will dominate over a mixed reality system.
@peterfinkill8098
@peterfinkill8098 10 месяцев назад
Another great video Russ. You are a great innovator with regard to Flight Simming. This looks like the start of something great. It will surely be developed further.
@rbarlow
@rbarlow 9 месяцев назад
Thanks. I think it looks exciting for the future.
@LouisianaRAPTER
@LouisianaRAPTER 9 месяцев назад
Is it possible to run it via link cable without having to deal with virtual desktop?
@casaamaril
@casaamaril 10 месяцев назад
Inspiring video and ideas, I really think that mixed reality will be the future of flightsimming and increased immersion, if we can use and see our own hands within the simulation that will be a huge change.
@rotate5568
@rotate5568 9 месяцев назад
Good afternoon Please tell me what could be the problem, when I launch Reality mixer on my Meta Quest 3 glasses, it’s like my cameras don’t work. The area in which the room should be visible is simply gray. What could be the problem?
@kiotee_nouw
@kiotee_nouw 10 месяцев назад
Interesting, but clearly lacking a lot! If you are into "immersion" of the flight simulator, I believe this Mixed Reality destroys that reality. Maybe in a year or two Mixed reality will get better. Are you in the PDX area?
@Prometheus1979
@Prometheus1979 7 месяцев назад
Been a vr user since the original oculus rift. I just purchased the quest 3 from a quest 2. Night and day diffrence adding color pass through. Mixed reality is where it’s at.
@EmesiS
@EmesiS 10 месяцев назад
Thanks Russ for bringing this to our attention. I've seen so many videos of the Varjo XR-3 MR and wondered when the technology would make its way down to the consumer level. I'm in the process of setting this up now to try it out. I have the Quest 3 and RealSimGear Cirrus SR22 cockpit. I'm so used to using muscle memory for all my flight planning it's going to be weird seeing my actual cockpit in MR. Cheers!
@rbarlow
@rbarlow 9 месяцев назад
Just a matter if time....but I'm impatient😀
@550stanley
@550stanley 10 месяцев назад
Thank you for this video. I was not even aware of this possibility, but that is because I've switched to MSFS2020 from Xplane11. This is great and exactly what I was wishing for. Even just the possibility of taking hand notes in RL or looking at the charts and maps, rather than having a separate window in the VR cockpit I think is a lot more user friendly. I've been struggling with that a lot. Shame that this is not available in MSFS but this alone may persuade me to switch back to Xplane.
@ArjenJongeling
@ArjenJongeling 22 часа назад
Do you think it could run on a laptop so I could use a very simple version on location? I’m thinking of only a yoke, throttle and rudders as real instruments and the rest VR - just for entertainment.
@jmizzonini
@jmizzonini 10 месяцев назад
Great work! This is where VR needs to go! I don't enjoy flying with my headset often simply because if I'm trying to be a "serious simmer" (for lack of better word) I have so much hardware that I can't use in VR, which makes me less efficient flying. Let alone the touchscreen interfaces making operating aircraft faster than any VR or mouse setup can possibly offer currently. This is the future for sure
@Thezuule1
@Thezuule1 9 месяцев назад
As someone that doesn't have the hardware the headset is nice because I can pretend it's there. I already have too many expensive hobbies to justify building a fake airplane in my house lol.
@MegaControltv
@MegaControltv 13 дней назад
wow esta genial eso! como se mezclan los mandos y controles reales dentro de la realidad virtual !
@MrLolof1
@MrLolof1 8 месяцев назад
Amazing vidéo ,I have a Pimax Crystal but the Best solution ,it’s not HandsTracking In DCS World /Mfs 2020/ or Xplane 12 ? Better caméra or HandsTracking ! I buy the HandsTracking module by Pimax this week and I going test this quickly 🇫🇷🇫🇷🇫🇷 Thank you so much for this excellent vidéo .👍🏻👍🏻 Me too ,my dream it’a a better work by all studio developper with News tool In Quest 3 or Pimax Crystal (HandsTracking + caméra ) A day perhaps ?? Aplushhss 😇👍🏻👍🏻
@saidabdulhamid5153
@saidabdulhamid5153 7 месяцев назад
Hi Russ, thanks for all those videos! thats's great and amazing! I am using A320(FBW) with MSFS and have HW(Airbus Joystick and saitek panels + tablet connected to emulate the FMGS). As you refeering to Xplane, would the Quest 3 mixed reality works? thank you
@mcotherman5957
@mcotherman5957 7 месяцев назад
Russ, I'm getting ready to buy a VR headset. I tore my old sim (HUGE THING) apart and I'm building the frame for my VR simulator tomorrow. 2-24" Touchscreens for Air Manager (love my knobster), Honey Comb yoke and throttle quadrant. I'm building this to use for instrument flying practice (Private pilot with instrument rating). You said the resolution could be better. Is it good enough to see what you need to see to practice instrument flight. I practice on steam gauges with a pair of G5s and the Garmin 540, mostly. You know if the Air Manager guys have any intention to model the Avidyne IFDs for Air Manager? That's my real world flying IFD.
@pentachronic
@pentachronic 2 месяца назад
What setup do you have there ? Could you list your components you use in this video please ? I’m considering a quest3 and desperately need to update my old plastic pedals and yoke. I have MSFS so do you think the Mixed Reality pass ugh software would work the same (I assume so since it’s just a hole on the desktop ?). Would also like to know how immersive it is and how much it models reality. Thanks.
@R83TV
@R83TV 8 месяцев назад
Would the Quest 2 be able to do this? I know it's passthrough is Black and white. But I wouldn't mind if this would work
@pdebaty
@pdebaty 8 месяцев назад
Amazing! It gave me the idea to use OpenKneeboard to create a solid color PDF that gives me a passthrough window to my physical kneeboard for taking notes. That works in openXr as opposed to reality mixer, which is is steamVr only.
@rbarlow
@rbarlow 8 месяцев назад
Yes and if Laminar Research or Asobo would create a tool to make editable color boxes render inside the VR cockpit they could create passthrough areas in their sims eben in OpenXR. Nieither seem interested.
@joxerra
@joxerra 5 месяцев назад
I use "Spitice Color Panel"... I find it much easier and convenient... I just need a window to read my kneeboard...
@juniorwizzard
@juniorwizzard 8 месяцев назад
Excellent explanation! Reality mixer has the option to "add or remove" games to a profile. Were you able to do it? If affirmative, how? Thanks big time!
@wwindsunrain
@wwindsunrain 9 месяцев назад
This looks alright, but not great yet. Better would be if software do a z cutoff so only real world objects up to a certain distance will be shown and anything beyond it will come from the sim. It would be like seeing the physical cockpit and your hands etc overlaying the virtual world. Technically it should be possible to do this with the two cameras in the headset and photogrammetry. Hopefully we won't have to wait long before things like that become available!
@frankfrati4
@frankfrati4 9 месяцев назад
When I run reality mixer dcs starts getting super choppy and loses frames like crazy. Even if I have the passthrough window closed (I have it on a toggle). Are there any settings in steam that can help this?
@zsavage1820
@zsavage1820 9 месяцев назад
LMAO Oculus graphics look like an Atari 2600.... very fuzzy and color off
@freedom-qy2zs
@freedom-qy2zs 10 месяцев назад
Love this. Can reality mixer let you draw a specific shape to match your cockpit? And can you have multiple boxes at the same time? My thought is to draw a non-box shaped box for the panel and the yoke, then another for the throttle, and another for the radios and gps. And letting the sim draw itself in the spaces between them.
@rbarlow
@rbarlow 10 месяцев назад
That would work currently. I will do a follow up video when I have time. Using gaze activation you can have boxed activate when your headset points within a certain angle off the box. Stays open until you look away.
@Theobald-z2r
@Theobald-z2r 9 месяцев назад
A song can make or ruin a person’s day if they let it get to them.
@SuperFlyCH
@SuperFlyCH 10 месяцев назад
Certainly a good option and as you said, this will only get better. But, for me, the ideal setup would be for the system to track my hands and fingers so that I can interact with the virtual cockpit. And yes, I have a diy cockpit but I would gladly ditch the hardware if it meant that I could seamlessly interact with the virtual one.
@Thezuule1
@Thezuule1 9 месяцев назад
You have to use the controllers but it does that. I don't have any physical controls so I just use my hands on the virtual knobs and switches and such.
@jimmydesouza4375
@jimmydesouza4375 9 месяцев назад
There are a lot of systems that allow this, such as captoglove. The issue is that without fully haptic force feedback it's essentially impossible to naturally interact with a cockpit in this way as you aren't actually moving a switch you're just putting your finger in a rough area near the switch and hoping it fires off. Unfortunately no company trying to make full force feedback haptic gloves has A) brought any to market or B) made any that actually have the granular precision to simulate interacting with cockpit switches. As such the best option right now is this pass through and a sim-pit.
@adrianturcu7838
@adrianturcu7838 10 месяцев назад
Thank you, Sir! For all your brilliant work of putting your own personal knowledge gathered the hard way into very straight forward and easy to follow informational videos, Thank You!
@johnnyflores3426
@johnnyflores3426 10 месяцев назад
Trailblazers for next gen pilots!16 year old me would be extremely happy to see the progress. Now at the airlines. This really make me happy to see what available for the next generation of pilots.
@BradleyCulbertson
@BradleyCulbertson 9 месяцев назад
Steam has a streaming app in quest store now as of posting this video. Can bypass virtual desktop.
@Buddy308
@Buddy308 10 месяцев назад
I guess Virtual Desktop has already been upgraded to work via OpenXR. Now it'll just require getting Reality Mixer to work with OpenXR. I won't take a stab at trying to set this MR up until that happens because OpenXR improves MFS performance greatly over that achieved with SteamVR. I just don't want to fool around with learning SteamVR while waiting on the upgrade of Reality Mixer.
@rbarlow
@rbarlow 10 месяцев назад
Your approach makes sense but I just couldn’t help myself. It really is a cool sensation just being able to see your hands and controls in VR
@cguerino524
@cguerino524 9 месяцев назад
Russ loved your mixed reality demo. I’ve spent about 20 hours trying to get it to work. I have nice pink box I can move it around and resize it but no video passthrough. I think it’s one small thing I’m missing the program isn’t very intuitive. Not giving up😊
@Soap.h
@Soap.h 6 месяцев назад
Im having the same issue… did you figure it out?
@cguerino524
@cguerino524 6 месяцев назад
@@Soap.h yes I’m 76 years old I’m trying to remember. If I remember I had to close the desktop program and restart it, I wasn’t able to change a setting until I restarted it. I’m in Florida so my setup is in Pittsburgh other wise I’d be able to start it up and give you a much better explanation
@HEATER_
@HEATER_ Месяц назад
Excellent! Thanks for sharing.
@robcul471
@robcul471 10 месяцев назад
Russ please advise What system pc do i need to run MS2020 VR currently running amd ryzen 7 3700 8core cpu and amd 5700xt which is out dated updating to amd ryzen 9 5950xt stil 3 years old am I missing the boat as this is still outdated by 3years however 570MB and cannot get MS windows 11 install due a software glitch old system adding this new chip will start me in a newer direction. or with all the new chips coming out this week processing power is over the top. what software you using today to run VR3 on a budget head sets are expensive so 55inch monitor for now 2 side monitors 32 inch monitors for now just have joy stick fine with me..x-plane 11 at moment your advise greatly appreciated
@flightsimdeskuk
@flightsimdeskuk 10 месяцев назад
If you are on a budget the 5800X3D is a better upgrade than the 5950X if gaming is your focus. I have both, and get 15-20% better performance on the 5800X3D.
@thewarthogproject
@thewarthogproject 9 месяцев назад
Guess what I'm trying this week! Definitely a step in the right direction!
@geniusiknowit
@geniusiknowit 6 месяцев назад
Based on your videos, I bought the Quest 3 and everything needed to do this, and I'm disappointed with the results. The passthrough video quality is worse than it looks in your video. Hard to read what's on the monitor without getting very close to it. It's a hassle to have to keep managing the passthrough boxes. I've got some issue where MSFS gets jerky or twitch when Reality Mixer is being used (others are reporting the same issue). And wearing and using the headset is just an uncomfortable and inconvenient experience all around. I really wanted it to work, but I think I sending it back. The added immersion is real but hardly with it to me.
@mcotherman5957
@mcotherman5957 6 месяцев назад
The passthrough video quality is a Meta issue. The passthrough quality should be an end user choice. The way you record video from the Quest 3 does not show the quality degradation (also proves that it is being degraded on purpose). The immersion for me is still worth it. I use my sim for instrument practice and it's 100% effective and transfers to a real plane! I hardly ever do VFR flying.
@drewrepp9589
@drewrepp9589 10 месяцев назад
That really looks promising. After 700+ hours between x-plane and MSFS. I am starting to build a better cockpit. Torn on how to do so. I believe the touch panels and 3 Tv's. But now with this Vr possibility...I might have to rethink it. ON a side note. Something I've notices in your videos. I cant help but laugh. When you take off, you tend to aim for the control tower right away. Each time it makes me wide eyed thinking. No you cant do that!
@rbarlow
@rbarlow 10 месяцев назад
My ex wife was a tower controller….just kidding. Still married to my ex-wife. As an old Captain told me as a young First Officer…It’s cheaper to keep her.
@mostlyindica
@mostlyindica 10 месяцев назад
Thanks Russ, decided the quest 3 aint up to it for my use,
@cosmicbrewery
@cosmicbrewery 10 месяцев назад
This is the only reason I haven't used VR with my flight sim! But... Does it only work with steam apps? I bought MSFS through microsoft.
@rbarlow
@rbarlow 10 месяцев назад
Yes SteamVR for now but hopefully some smart guy will see my video and make the software we need to use OpenXR.
@Freedom1776usa
@Freedom1776usa 7 месяцев назад
That is so cool. Thx for demo. What is that flicker to what looks like a glass cockpit (20:39) in video that pops up once in awhile? Still trying to figure out what all that clutter is in background (middle right in screen) of your cockpit? Let us know about Microsoft Flight Simulator and if it works with that someday.
@rbarlow
@rbarlow 7 месяцев назад
it is possible to toggle the passthrough with a joystick button. I justr turned off the passthrough showing the physical panel for a second or two and it showed the MSFS panel in the the sim. Did you see my follow on video ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-7_X1wReZHgc.htmlsi=2Wghmr15z_AUMt_Z
@marcosa995
@marcosa995 4 месяца назад
Ross thank you for the video. I did quite not understand , looks like it does not work with msfs 2020 , even if you have bought it from steam ? Am I right ? what is the name of the program you mentioned ? Thanks
@rbarlow
@rbarlow 4 месяца назад
I was uncertain when I made that video several months ago, but it does work with MSFS 2020. Check out my more recent video on color panel, which is easier to use and accomplishes much of the same thing. It only requires virtual desktop and works with open XR, which gives better performance in VR. Easiest MSFS Mixed Reality: Color Panel for VR ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-o2vHWNf7pW4.html
@NITE_PINE
@NITE_PINE 9 месяцев назад
Does Reality Mixer work with a green screen? I have been thinking about hanging a green screen behind my HOTAS and around my cockpit so that I can do what you're doing without the window boundaries
@rbarlow
@rbarlow 9 месяцев назад
I think that feature is under development in Reality Mixer. Actually Virtual Desktop is what does the chroma Key magic. It now replaces a chosen color( within a set allowable variance ) in the VR world with the pass through camera feed. There needs to be a toggle so that a chosen color in the pass through feed is replaced by the VR world. That mask area could be as physical green screen or one generated by Reality Mixer. Check my latest video on passthrough hand tracking and you will see the faint color boundary lint between passthrough and VR…. It may be an artifact of Virtual Desktop and still appear in your scheme too, if it becomes possible to reverse he setup and replace camera feed areas with the VR feed.
@Chris.Davies
@Chris.Davies 9 месяцев назад
This is the technology I have been waiting for, before taking up VR/MR. I want it for my space sim games, so that I can see my keyboard and controllers at all times. For me though, I think I'm gonna hold off for a little while, until the process is simpler. Currently, I'm using triple screens @ 5760x1080, and TrackIR 5, in a dark room, with a stack of power amps and a massive 7.1 Hifi audio system. In effect my gaming rig is a devastatingly powerful 7.1 Hifi setup with a computer attached to it. :P Please don't ever let anyone tell you headphones are the way to go: they are garbage compared to 20K worth of all-analog 7.1 system. :)
@bembrin
@bembrin 9 месяцев назад
It isn't clear to me what you mean by "left menu button" at 11:31. Could you please clarify?
@rbarlow
@rbarlow 9 месяцев назад
Menu button on the left controller( flush with 3 horizontal lines)
@GregiiFlieger
@GregiiFlieger 6 месяцев назад
Encouraging! My next step is VR!
@BoroFan
@BoroFan 7 месяцев назад
Does this work with the gamepass version of msfs?
@vijaypatel-si6ig
@vijaypatel-si6ig 9 месяцев назад
VR just looks horrible man sorry
@robskey
@robskey 10 месяцев назад
Qest 3 sucks worst headset l own 😮😮😮😮
@fubar1075
@fubar1075 8 месяцев назад
Is this possible with Htc vive pro 2?
@FlamingTomatoAviation
@FlamingTomatoAviation 10 месяцев назад
This could be a total game changer for DCS sim pilots. What you mention at the 7:30 mark about home built "simpits" and not wanting to change over to VR hits the nail right on the head. That's the exact boat that I'm in currently.
@yokoh691
@yokoh691 10 месяцев назад
Been using this mixed reality with warthunder and DCS, it’s so good to see your instruments aha
@yokoh691
@yokoh691 10 месяцев назад
Did a test short on my page aha
@AdamM-fd7hs
@AdamM-fd7hs 8 месяцев назад
@@yokoh691 Are you using the Steam version of DCS, or the standard install? I have the standard install, but reality mixer runs through steam... can it be run over the standard DCS install running VR?
@liamnolan1663
@liamnolan1663 6 месяцев назад
@@AdamM-fd7hs Dcs standalone uses steam vr, so it works.
@AdamM-fd7hs
@AdamM-fd7hs 6 месяцев назад
@@liamnolan1663No it doesn't. It uses OpenXR. Only the steam edition forces Steam VR.
@zsavage1820
@zsavage1820 9 месяцев назад
HP Reverb G2 for the win....
@kodywillnauer9422
@kodywillnauer9422 10 месяцев назад
Does the quest 3 use more gpu or cpu resources? Since it has its own computer on the headset I’m hoping it might be a good middle ground for computers with the 20xx series gpu
@rbarlow
@rbarlow 10 месяцев назад
Unfortunately, the simulator is being run completely on the PC and the headset. It’s just displaying the output. The pass through video is being processed on the Headset but you still need a pretty beefy computer. I don’t think I’d be happy with much less than a 3080ti or 4070ti. If I have a chance I will try things with my 2080ti and see how it works. GPU prices are crazy now so I’d hate to be shopping now.
@kodywillnauer9422
@kodywillnauer9422 10 месяцев назад
@@rbarlow I’ve got a 2060super with a Ryzen 3700x running msfs okay-ish. When it tried the reverb g2 a few years ago I just didn’t get the fidelity I wanted to justify the price. But if I can swap out for a 2080ti it’s how I might squeak out a few more years of system use.
@olliefick8881
@olliefick8881 8 месяцев назад
It would be nice is to be able to select a knob on the XP12 aircraft panel and then use Knobster to manipulate the knob. I've attempted this using KnobXP but with no success. Selecting is easy but setting frequencies, altitudes, courses etc. using rotating actions is difficult with vr manipulators. KnobXP with its vr window is not realistic. Any thoughts on this, Russ?
@rbarlow
@rbarlow 8 месяцев назад
Totally agree. I've spoken with Austin Meyer about this and his answer was that I should create a plug-in to do it. Yes, KnobXP was an idea that came along much later that Knobster and wasn't intended to be a final solution. The VR development in XP is not well documented so even if it were possible to build a plugin it would take someone with inside knowledge of XP. I hate using a mouse in the VR cockpit but have found a kneeboard mounted wirelessTrackball with a scroll ring is the easiest solution. You know where it is, no desk required, and the ring moves like a dial. Stacked knobs are still difficult.
@olliefick8881
@olliefick8881 8 месяцев назад
I've been using a trackball for a few months. As you say, it is probably the best solution for now. However, my thumb is not as agile as my fingers, so the positioning is difficult in rough air. And, it is hard to keep the curly arrows in place while using the scroll wheel. I appreciate your leading efforts to bring about the changes we are looking for.
@briancavanagh8852
@briancavanagh8852 8 месяцев назад
Hi tks for the info . Was your Q3 connected via a cable or with air link .
@rbarlow
@rbarlow 8 месяцев назад
Link cable
@blastofo
@blastofo 9 месяцев назад
The Quest 6, will have 8k passthrough with perfect object separation, and MSFS2030 will have photorealistic scenery that surpasses current graphic mods.
@yokoh691
@yokoh691 10 месяцев назад
Just spent the last hour playing warthunder with my mosty DCS f16 styl sim and damnnn so cool! the immersion levels are high! I tried MSF2020 via VD but it was soo jittery, any tips?
@Joakim_Johansson
@Joakim_Johansson 8 месяцев назад
Is this possible with Quest 2?
@olliefick8881
@olliefick8881 8 месяцев назад
Great video as usual. Thanks Having to use Steam VR is a major problem based on my experience with Steam. Do you see a way to achieve acceptable MR without having to use Steam?
@b0bl00i
@b0bl00i 9 месяцев назад
Excellent Guide Russ. Thanks a lot. Really looking forward to FalconBMS getting support for OpenXR in Q12024. Finally I can find my buttons properly.
@tylerouellette7453
@tylerouellette7453 9 месяцев назад
Mixed or Augmented Reality is defiantly the future of flight simulation. I have always loved the idea of a simpit, a full 1:1 recreation of a real cockpit (or something comparable) that would feature all of the cool bells and whistles that would you see in the virtual cockpit. This naturally allows it to be interacted with without a mouse or pointer. However, this (used to) come with essentially one of two options. One, VR. This removes half the purpose of an actual simpit because you can't see your controls and makes it much more difficult to navigate the panels (it is possible, but takes a lot of practice.). Two, surrounding projector / monitor setup or even 2D head tracking (Track IR). This allows you to view and navigate the simpit while easily viewing the virtual world you are flying in. However, this results in losing the emersion that VR brings that myself and others have come to love, primarily the ability to use and experience Propper depth perception while flying. Mixed reality combines the best of both of these solutions. Once these consumer level mixed reality solutions become easily available to the general public, I know and hope that it will truly change the flight simulation world by allowing simpits and projects alike to become available to more people, increasing their immersion and experience that it provides.
@Maartenderidder
@Maartenderidder 9 месяцев назад
Good evening from the Netherlands, This video convinced me to finally order a new PC which is heavy enough to fly DCS and BMS in a Mixed reality Home made F16 cockpit. Thank you for helping me out with your cool progress. Regards Maarten
@MattyGamerMC
@MattyGamerMC 9 месяцев назад
Thx for this video! I've been trying to figure out if quest 3 had passthrough or not, but didn't know how to phrase my question. Definitely buying one now to use with DCS and my Virpil controls.
@nathanwildthorn6919
@nathanwildthorn6919 10 месяцев назад
Hey, Russ. I like your approach to this technology. I have a Rift, but the Quest 3 seems more forward to what I'd like. Iwas informed that because of my meds I can no longer fly via Commercial nor Private certification. Is the Quest 3 a viable surrogate?
@zetapal
@zetapal 9 месяцев назад
I’m curious if the occluded area decreases the load on the PC’s GPU thus giving a higher fps performance. If so, that’s a selling point. Turn up the settings !
@Aviator381
@Aviator381 9 месяцев назад
What’s it called
@danielseguin913
@danielseguin913 10 месяцев назад
This is a step in the right direction. Flight sim with VR is amazing because of the 3D effect, specially when flying over mountains!. But with no visibility to the real hardware buttons is really the problem. Only the yoke and throttle are easy to control. I really think the future is with AR, where you could control those nice 3D cockpits renders that comes with the planes you use, with your hands. Good eye tracking within the headset combined with AR like the direction that is taking the Vision Pro headset is really what will change the game. Air Manager is great. But being able to interact with the game cockpit while still in VR, without having to use a mouse, would be even better!
@mobius3515
@mobius3515 10 месяцев назад
When Reality Mixer is on, are those pixels no longer being rendered in MSFS? That would be awesome if having all IRL gauges would cut down on the rendering requirements of the sim and therefore result in not only a more interactive experience using XR, but also a higher framerate in the sim.
@WoWSondo
@WoWSondo 9 месяцев назад
205 bridge looks nicer than MSFS bridge! Was like PDX soon I see you fly lol.
@grimreaper9748
@grimreaper9748 10 месяцев назад
Good info, just bought the quest 3 a week ago and hope it gets support with mix reality for MSFS2020 and DCS soon.
@swflKVNC
@swflKVNC 10 месяцев назад
Thank you Russ, Great video. Can you tell me what you use for a touch screen monitor. I have been looking for a 14 - 15.6" and just not sure yet.
@Buddy308
@Buddy308 9 месяцев назад
Question for Russ: I think that neither the Pico 4 nor the Quest 3 have eye tracking. Do you think that the large sweet spot afforded by the pancake lenses obviates the need for eye tracking in MFS?
@baconbooger4256
@baconbooger4256 9 месяцев назад
I have a full a10 pit for DCS. I’m excited to get this going. Santa is bringing a quest 3 for Christmas and this is going to be one of the first things I do. I been waiting for a decent passthrough application before I got into vr.
@stricklandgarageaviation2864
@stricklandgarageaviation2864 10 месяцев назад
Looks great, but a little out of my ability to totally understand what most of your video demonstrates. Many things you talk about are probably things most computer guys take for granted but I have to really dig to figure out what certain things are or how they work. I was very happy to figure out how to set up 4 monitors, air manager, and the knobster. You have gone to a higher level.
@LarryTru
@LarryTru 10 месяцев назад
Great video, Russ, very interesting. Will the recently released “Steam Link” Quest app improve or streamline the set up/use of this kind of setup?
@MaciejSwic
@MaciejSwic 10 месяцев назад
Given this uses SteamVR, it would probably work with DCS World as well?
@TheGbelcher
@TheGbelcher 10 месяцев назад
1:09 The default Air Manager panel has the vertical speed stacked above the altimeter. You can easily change it but it bugs me whenever I see ppl using it without fixing that
@loediloedi
@loediloedi 10 месяцев назад
This augmented reality is getting better indeed. Would be great to be able to create the vr part along the windows of my cockpit shell. So only the outside view is vr. Well maybe soon…
@rigilchrist
@rigilchrist 10 месяцев назад
Thank you for this. Mixed reality really does change the game. There's an outfit in Switzerland which has created and approved a mixed-reality Sim for helicopter training, using a version of the Vario headset. I have only seen photos of it, but as I recall, the panel had instrument cutouts with some kind of pattern in them, which is recognised by the Sim, to insert an instrument.
@jxa4508
@jxa4508 9 месяцев назад
Brunner
@rigilchrist
@rigilchrist 9 месяцев назад
It was made and certified by VRM in Switzerland. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-uu0-WZ2qZPg.html
@rigilchrist
@rigilchrist 9 месяцев назад
@@jxa4508 Yes, they make a motion VR Sim, but I don't think it is Mixed Reality (MR). The reason I mentioned the Helicopter Sim is that it does use MR, employing physical masks to insert a simulated instruments into a physical cockpit.
@jxa4508
@jxa4508 9 месяцев назад
@@rigilchrist was it this one or a different one? ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-XGjPW_k5isA.htmlsi=mwzZVd065Ct4I_Z9 Helicopter would be neat too! Obviously tons of potential for MR
@seattime4075
@seattime4075 10 месяцев назад
Works in MSFS 2020. Might want to use the Steam VR beta.
@sascenturion
@sascenturion 10 месяцев назад
Interesting stuff ...amazing technology 😮 Thanks for the video Russ 😀👍
@monroegiger
@monroegiger 3 месяца назад
I'm just starting out in VR and find your RU-vid video very interesting. I have a home flight sim and have just purchased a Quest 3 and want to put the two together hope to see more videos to come.
@rbarlow
@rbarlow 3 месяца назад
Stay tuned
@Mike-jq9jo
@Mike-jq9jo 3 месяца назад
@@rbarlowHi Russ. I am a newly retired airline pilot also. I was wondering if you can answer a few questions regarding this subject matter. Is the Quest 3 headset the only headset capable of color pass through? I ask because I have I have the HP Reverb G2 headset. What are your thoughts on the comparison between my G2 and this headset? I know the specs on these headsets are comparable but would you consider the Quest 3 an upgrade over the G2?
@rbarlow
@rbarlow 3 месяца назад
@@Mike-jq9jo There are some others like the Varjo XR-4 ( ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Ynn1vZvKoAI.htmlsi=MxUTCu1egQ-UUite ) and the Somnium VR1 ( ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-N8CXRoIEOqI.htmlsi=mBKDUdAQzXDPtBZU ) but these are $3-4K . The Quest 3 is less resolution than these but still looks way better than the G2 as it has some of the best lenses I have seen. Very large sweet spot. The price is right at $500 . Definately an upgrade from the HP G2.
@gregdildine99
@gregdildine99 10 месяцев назад
This is IT!!!!! I hate the mouse! Hardware peripherals mixed is indeed the way to go!!! Thanks!!!
@HCarter111
@HCarter111 10 месяцев назад
Fantastic Video! I know what I'm getting (myself) for Christmas this year.
@brachisaurous
@brachisaurous 9 месяцев назад
...or have haptic gloves which give you sensation of resistance and feedback when interacting with knobs and switches IN GAME
@rbarlow
@rbarlow 9 месяцев назад
Yes but I think that option is 1- Technically more difficult 2-More expensive if you already have a cockpit setup 3- making you wear gloves possibly with a cable link 4- not allowing you to interact with physical objects like checklists and maps The advantage is no physical hardware required and not locked in to one physical cockpit layout Definitely a possibility if the gloves evolve
@brachisaurous
@brachisaurous 9 месяцев назад
@@rbarlow lots of dev going on in the haptic space. on the point of interaction with objects, haptic tech should in theory allow you to interact with any object in your vr environment. as you point out, the ergonomics of it is the key!
@rbarlow
@rbarlow 9 месяцев назад
@@brachisaurous Exciting Times for VR!
@pnksmigge5324
@pnksmigge5324 9 месяцев назад
this is what I looked for immediately after trying vr flight sim a single time, obviously needs to happen for all the nice gear to be visible and work
Далее
The Largest Unsolved Problem in VR.
25:43
Просмотров 855 тыс.
Mixed Reality Passthrough Hand Tracking
9:16
Просмотров 73 тыс.
MSFS Surround Vs. New Multiview: The Best Sim Solution
17:49
This is a New Level of Gaming Realism!
9:11
Просмотров 106 тыс.
I am a Quest-hole Now - Meta Quest 3 Review
14:35
Просмотров 2,4 млн
MSFS 2024 - GAMEPLAY FOOTAGE - Virtual Reality!
27:00
When Your Flight Sim Hobby Goes TOO FAR!
7:09
Просмотров 578 тыс.
Missing the BOAT on VR Sims?
17:21
Просмотров 62 тыс.