Powered by N64 Hardware | Mario 64 

Responding to the open question at the end of the video: I'd love to give it a try.... Unfortunately, I haven't ported all my optimizations from my mod to the base game yet, so this'd be a huge amount of work to fully complete (and I don't have a VR headset either). Maybe one day in the future! I do plan on porting all these engine improvements back and making my repo open source anyway.

"when you enter Bob-Omb Battlefield, the performance takes a hit" Kaze Emanuar: "Hold my beer"

> I won't go into too much detail Goes into a ton of delicious details.

I love the little "thank you" sent by the CPU to the GPU.

Love the Kaze Emanuar reference!

James is the kind of guy you meet randomly in a bar. He tells you about his passion, but it's too much for your brain, so you think he's crazy (in a good way). Then you go home, and while sitting on the toilet, your brain processes everything he said. It makes total sense and is super fascinating. You go back to the bar the next day, hoping to see him again, but he never shows up. You start to question your sanity and reality, eventually becoming an alcoholic and dying. It's all dark. Suddenly, you hear someone pressing the power button. You wake up, realizing you are reborn as a character in Mario 64 VR.

For indie spotlight, I recommend you try out "Joe Wander and the Enigmatic Adventures." It's an old school N64/PS1 style platformer developed for current gen consoles and PC. P.S. Love your videos! I'm sorry about the Portal 64 :(

If Kaze and you made an original game together, it would be a masterpiece!

This is incredible work and amazing, but I spent the whole video staring at Mario's face on your shirt and giggling

You can cross your eyes and see the 3D effect. This actually looks pretty great.

For the head tracking, I'm surprised you don't just use the gyroscope by default and only use the accelerometer to reset down when the gyroscope is still. Might lead to less latency on the head tracking.

this is absolutely fantastic, great work you are not just the portal 64 guy. you are an incredibly competent developer, and I look forward to all your projects to come. ALSO WHY IS YOUR MARIO SHIRT WORN LIKE THAT. HIS MOUTH OMG

i definitely could have told you that the flying cap was gonna make you motion sick, but i also definitely couldn't have stopped you. such is the fate of vr development...

Shoutout to your brother for good editing and helping with the indie spotlight!

Imagine that released in 1998 as an ad on

Mario having no nose at 1:29 is just too funny to me!

This project is unsurprisingly amazing but oh man, you have my sympathies with the motion sickness. there's no motion sickness quite like DK1 motion sickness. That thing got me so bad that when it hit me, I would be sick for the rest of the day (and genuinely felt not-quite-right for the next day or so). and that was on a modern pc doing modern (at the time) VR development.

Demonstration Super Mario 64 in VR, is like a demo from E3. Fantastic to project, maybe try Doom 64, first person shooter VR

This is crazy, I was just playing Mario64 on DolphinVR the other day thinking about how it would be cool if there could be something VR that runs on original hardware, but I thought "nah, that would be impossible" And here we are! Awesome work, I want to try it now

Nintendo: yea we're gonna have to ask you to stop making our systems do extraordinary things, thaaaanks.

Thanks for including the stereoscopic views. When I got far enough back from my monitor I was able to get a feeling of the depth by crossing my eyes and it was super neat!

Absolutely amazing work you've been doing. Interested to see what you'll cook up next!

Love this, amazing to see what is possible on such old hardware, thank you for making these videos!

This is so cool! So excited to see what other crazy N64 stuff you do in the future :)

I have a toy "VR" thing I got ages ago in a box of Nesquik, the kind where you put the phone in front of the toy, like cardboard. I tried to put the video in it, just for fun. The "viewer" was made for smaller phones, so my current 6.7" android phone was kinda large for it, however I still had to zoom in the video. 1.5x zoom in that toy was just about perfect to watch the clips with stereoscopic vision, but the toy has very little field of view, so I was just watching two flat images, it doesn't feel immersive. But hey, it works :P (I work with VR, I could easily have used an actual headset, but I didn't know this video would release so I didn't bring any home for the weekend.)

Great work! Thanks for sharing the progress 😀

I've been wanting for years, rom hack of Ocarina of Time that is for VR, where all the levels are designed around the gimmick of using the hookshot for movement. So you'd hookshot from zone to zone, solve puzzles, do first person combat with bows/din's fire, then a new hookshottable surface would appear to unlock more exploration from hookshot pillar, to hookshot pillar. Eventually you unlock the long shot to make movement faster/easier, and eventually the ultra shot (4 time longer than long shot, saw it in another rom hack). If you spread out heart upgrades, items, it could be a full game. Maybe even do a Twinmolds fight with all bow shots. Not sure what other bosses can be done first person. Anyways, would be cool if someone made this, and your code could be used in some way so those with a VR headset and an emulator could play it. Or maybe one of the new decomp PC ports or something.

In scenes where its just the VR View, bring your head closer to the screen and "split" or "unfocus" your eyes, and then merge the new "duplicate Mario" into one, this causes the stereoscopic image to line up, and you can see the 3D Depth view!!!!! If done correctly you'll see three of the mario's

Maybe Kaze’s engine would be better suited for this? I’d get in contact, I’m sure they’d be interested! Edit: whoops! Already mentioned in the video. Still a cool project nonetheless

Give this guy a couple of years and he's gonna have a full Matrix sim running on an N64.

My indie spotlight suggestion is "You are Peter Shorts", that game's sorely overlooked.

Bro is a real life wizard

I've just used the *squint eyes* method. It looks great, nice work!

the only Brilliant ad I've ever actually watched

Everything is better in 3D!! love this project

Since the width of the side-by-side game play videos are small enough, I can look at your video like those magic eye pictures by crossing my eyes until the two screens overlap on top of each other and be able to watch the game play and see it in 3D just using my own eyes. (Although for the magic eye pictures, you usually un-cross your eyes, not cross them.)

This is beyond impressive. Huge props.

The 3D looked really good. Just had to avoid look at the sky. Good work!

Awesome work dude!

Awesome to see this working! I never thought I'd see the day. Maybe the next step is to make it first person from Marios perspective?

I'm not the biggest Mario fan in the world, but I have a love for early attempts at VR from the 90s. What you're doing gives off the feeling those early attempts give off. I like it!

I love this stuff, you just went and lot, made this?? Amazing

Love the indie spotlight bit!

Thank you so much for the indie spotlight section. It reminds me a bit of rockleesmiles indie impressions. I really loved that series and got to know so many lovely games because of it. It really is a shame he discontinued it

Super exciting project

For anyone that doesn't have access to VR equipment, you can just cross your eyes. It takes a little bit of practice, especially to get the focus right, but then you can see the 3D perspective.

Here you go again doin stuff 🎉 thanks

Is there a way to link two N64s and render one eye on each one ? Like you can link 3 PS2s and play Gran turismo 3 on 3 tvs in ultravide.

James you're awesome. I don't even understand half of the technical mumbo-jumbos you say in your videos. But I just love seeing your passion in this line of work. Or maybe it's because I'm a huge sucker for anything N64. Either way, keep doing what you always do man.

that is one ancient ass oculus headset

"You may be able to imitate the view with other vr headsets" NO need. I watched this video on the 3ds!

I owned a DK1 shortly after they came out and the motion sickness was so bad that even just looking at the DK1 sitting on my desk would give me a migraine. I hope your experience is less awful :D

You did an incredible job, it's surreal to think that the Nintendo 64 can handle this at all. This makes me wonder if a VR device for the Wii would be possible, especially since it has motion sensors with the Wii Remote.

You're so good! Love your videos of this. Wish could have you helping with VR on linux.

n64 a powerhouse

Stereoscopic free-viewers rise up. 😎 (you can train your eyes to combine side by side stereoscopic images to appear 3D without the assistance of external hardware, "free-viewing", meaning you can just watch the stereoscopic parts of this video on your phone or monitor in 3D)

love me some N64 content

using the oculus dk1, wow!

Dude this is awesome

Dude, you are a champ!

I remember this one vid of a guy who basically went through the entire N64 code to optimize it as nuch as he could. Basically reaching more than double the fps than the original game. Would love to see VR run on that version.

Powering through motion sickness is how you build immunity from vr. Take it off when you cant stand it any longer but don't forget to keep using the headset. You will build a tolerance. I can play games like borderlands 3 and left 4 dead 2 no problem now.

I don't own a DK1 or a Google Cardboard but I was able to approximate the VR by simply putting my hand perpendicular to the middle of the two screens on my phone and put it close to my face. Saved me from having to do the Magic Eye trick.

0:14 right here you can do that one trick where you cross your eyes and merge the images to make a 3d one

if i could play perfect dark in VR at the age of ten i think I would have actually died of excitement.

A game that might be worth checking out is Varney Lake, a short love letter to pulp novels!

If you don't have a DK1 you can also just stand back and cross your eyes until the two screens overlap.

The mario shirt fold is silly.

6:22 me, not owning a VR headset, but a professional in autostereograms: 8)

Im impressed the framerate is that good. Not bad for an old machine.

VR isn't really something im particularly interested in, but your technical wizardry is always fascinating to see nonetheless, im hoping your next proper game project won't be VR focused but either way ill be here for it

you can also get a very blurry feel for what this looks like irl by pressing your phone directly up to your face lol

Can confirm BZZZZT is a fire game.

I dont get motion sickness / headaches from any other game system but the n64. Id never dare trying a n64 based vr.

The motion sickness thing is kind of a pretty big hurdle. I do remember you showing me this tech back in the day with the demo games that came with the VR headset, and me feeling the sick. It's cool how far it has come but is still an issue for many people.

great video! but i would recommend (this is gonna sound nerdy) turning down the high end frequencies a bit on your talking

Not sure what type of filters you ended up using, but variable strength filters sound like they would work great for something like that. Essentially the strength of the filter is proportional to the error (output- input) so that small fluctuations are heavily filtered but large changes have a reduced time constant. This can be based off of a simple exponential filter which makes it fairly inexpensive to implement.

"Or...maybe I'm a giant." Can confirm, Lames Jambet is a giant.

Now you’re playing with motion sickness 💪

It would be really interesting to see if some of the optimizations you learned during the Portal64 project could be put to work here

This is so awesome! I love VR. Is there a way to make this compatible with N64 emulators? Would be so cool to play not only Mario 64 in VR, but games like Goldeneye and Perfect Dark. Would probably require a hell of a lot of work to get working though.

It looks like you only updated the camera position for the right eye when you probably should shift both so Mario is visible in both eyes rather than being offscreen when he's on the right side of the screen.

Recompiling the ROM using o2/o3 seems to have huge improvements to frame rate, so if you haven't done it, it is an easy win

Man made a whole IMU

Showed 3 years ago 15 minutes ago. When you're this early. Hi from Romania!

Hahaha, was just thinking you should team up with Kaze for this and then no sooner than I'd started typing had you mentioned his name.

FWI. Putting a finger between the displays and moving your head near the screen gives a bit of the vr effect.

This is super cool! Now I'm curious if it's possible to do something like this with the Virtual Boy's hardware, that way it will finally be possible to actually play Virtual Reality games with the Virtual Boy :)

Love the Mario shirt

You don't need a DK1 to see the 3D effect in the video :) just relax your eyes and use your stereo vision!

you can make the VR head tracking a lot better with some more competent filters than LP and some clever control theory magic,

would love to see a collab with kaze that would be sick

6:35 or, you can watch the video cross-eyed like a madman, which is what I'm doing

156 stars? damn bonus stars too

I'm sure Kaze did this a few years ago for Nathaniel Bandy's "24 hours inside Super Mario 64". Might've not been console compatible.

Would it be possible to upload a stereo video recording of this so we can see how it looks without rom patching?

apologies as I just started the vid, but interesting choice to use og rift, i suppose you dont really need spatial positioning so kudos for the clever usage of old tech. keep it up!

if you don't have a vr headset and kinda wanna see how this looks, just cross your eyes to bring the two screens together

Sign me up for the mass produced USB! I'll be following this progress for sure. I'd love to see this ported to use the DK2 API to try it out myself. Even without using the camera for 6DOF I think it's very similar to the DK1. Some brave souls could possibly get CV1, Vive or Indexes to work. Even Nintendo added VR to Smash Ultimate so I think it's about time Smash 64 or Remix got the same treatment on original hardware!

I'd love to see what this can do in Kaze's engine