VR? No Buy! Get Me Mixed Reality!

MR_RD.jpg
"No VR, no buy" has become a staple of new sim racing release reviews. Even F1 22 now offers the, to some, elusive technology. But I'm really not about that. I'm in for the (hopefully) next hardware development. Mixed Reality.

Almost a year ago, Yannik Haustein asked the question: "What Do You Think Is The Next Big Hardware Development?"

And my answer is: "I don't know, but I wish it were Mixed Reality!"

So let's explore this mythical world.

Why We Need Mixed Reality​

Some of you might be asking: "But why?"

Well, there's 1 simple problem with VR for me: I cannot actually see what my hands are doing. I wanna see where my fingers are; which button I'm pressing on the wheel or button box (aka 2nd keyboard).

I want to see.

I want more immersion.

And I know it's possible. See it as a free business Idea. I just don't know if it's a good business idea.

How it Could Work​

Mixed Reality as a theoretical concept in sim racing has been around for a while now. I mean, just look at this video from 2016!


Now while some of you might know this channel already, if you don't, here's a quick run-down.

The channel owner, a German man by the name of Marcel Pfister, edits recordings of himself doing VR racing. All the while he sits surrounded by a green screen and later edits the VR surroundings into the video.

Now here's the deal: I want that. But REALLY working.

The theory is simple: Have a VR headset with cameras in front. The cameras just project the images they capture, excluding the green screen. That would be live projected with the interior of the car.

Sounds simple, right?

Why It's Not That Simple​

But it isn't. Every new development needs time and money. And the question would be, how big is the market for this?

And the, quite frankly, deflating truth of my thought process is:

Not very big, at least in the home-usage sector.

Commercially it could be used for driver training lessons or the like. So the potential users would be every vehicle driver.

But in the home sector, can you think of more examples of usage than, say, sim racing and Farming Simulator?

I can't. (But if you can, let us know in the comments, please.)

And a lack of possible monetary reimbursement automatically means a lack of investment. Sad, but what can you do?

What YOU Can Do​

Now let me be a bit selfish for a second. I know this is my wish and all, but if I have sparked your interest in mixed reality, just spread the word. If enough people wish for it, sooner or later, someone will invest R&D into this field.

And that could fulfil the wish (hopefully) not only I have. The (possibly) most immersive sim rig ever:
  • Motion Rig
  • Green Screen
  • Mixed Reality
But until then, would you be interested in a mixed reality environment like this? Let us know in the comments down below (and if you are, please share the word)!
About author
Julian Strasser
Motorsports and Maker-stuff enthusiast. Part time jack-of-all-trades. Owner of tracc.eu, a sim racing-related service provider and its racing community.

Comments

Premium
Yes if you want to race with VR you certainly have to do stuff to make it work well. Depending on what you race a reasonable amount of buttons on a rim and suitable button box in a position thats easy to access.

Between the buttons on the rim, a button box and a thrustmaster HOTAS throttle I use for racing (purely because its made to be used without looking while giving you access to ~25 buttons)

So I have certainly optimised my rig based on VR to make it all work and make it so I dont have to look. If I wasnt racing in VR I doubt I would have optimised it like this but on reflection its probably good to do either way, less time eyes off road.
 
Assetto Corsa's CSP mod has actually recently added the ability to track hands and fingers, so you actually can see your own digits now with a predicted arm. We aren't at the stage where we see ourselves in the car with no gloves and sat there in jeans but its getting closer. But that is still Virtual Reality.
How do you get the finger and hand tracking? Can't find it anywhere in csp.
 
This.

Speaking racing, I'm rooting towards the "it's still VR, unless you actually drive a car while being in VR" (sounds a bit hazardous to me, though :confused: :D).
Other types of VR sims walking around in your predefined guardian boundary play area the word 'mixed' is more relevant IMO.

However, the world is getting closer speaking the immersion factor.

Last weekend I played around with the Quest 2's finger mapping.
And suddenly found myself in AC identifying my hands and fingers in VR, just with sim racing gloves attached. And driving out the Alfa Romeo 4C with the nice mirrors, I almost got chocked suddenly identifying "myself" with helmet in the mirrors, mapping my head movement in the mirrors! Didn't even play with that in CM, apart from activation the 'VR camera shake' option, I think (but don't think that should make any difference?), so really caught me off guard. A nice surprise :)

Also last weekend, my girls being away a couple of hours, I finally took the initiative using AC's free cam option to it's full in combo with the Quest 2 open Play Area Boundary option.
In order to max out VR boundaries I rearranged our 4x10m living room, moved every furnature and other obstacles. Then placed my simring in the center of the living room. Loading AC, just turning out a couple of meters from my garage.
THEN leaving my sim seat, walking around the pit area.

In some track mods it's a really delightful experience with so many details, just to walk around in VR and discover. So got some spy jobs in other team garages :D:inlove:

I don't nessecarily need mapping of my simrig.
Even though using 4-6 different seat positions for my NLR F-GT Lite flexible seat, my seat position being dependant on sim car. I know the excact positions of my T8HA H-shifter/Seq.-shifter, wheels and my T300RS-GT wheel buttons very well.

Just as when you drive in the traffic or at track days, I know my 'buttons' without any look, having my focus 100% on the drive ways.

But one thing I must admit. I need VR mapping of keyboard.
UNLESS I'm following my long term rig plan to install physical a button solution, suiting my flexible seat. I don't need VR mapping of rig buttons, they'll just spoil my VR vintage classic car experience.

VR hands mirroring is fine for me, but mostly in pit area and open world free cruising in huge track mods, parking at places taking a view of the landscapes, once in a while.

Entering the VR world myself mid April 2022 (effectively used ~40 days until now), acquiring the Quest/Meta 2 I've been more discovering than racing, trying to get the most of 3D VR out of my ~15-20 most commonly used new - and older sims, using varying tools.

And really surprised how long I've been able to go so far with even minimum required hardware*.

All in all I'm extremely happy of how far you are able to go with low end old and cheap PC hardware and a starter level €299 VR headset and even able to get old and ancient sims working quite flawless, just by scrutineering and seaching the Internet for tools** and coding.

*OK upgraded my RX 580 to an RX 6700 XT yesterday (got teased from my prime desired vendor with much below MSRP prize tag sale), making my system really VR friendly. I.e. now running Ryzen 5 5600 X/RX 6700 XT/32GB DDR4 3200MHz (which is mid-to-high end of today's common VR standards, I think?).

** Have to mention the Steam Virtual Desktop tool as an option when you are on low spec PC hardware. I even got my newly acquired laptop of Ryzen 5 4600H/GTX 1650Ti Mobile/8GB DDR4 3200Mhz work effortless at medium settings in most sims and even high settings deactivating any kind of MSAA. And vorpX, either as stand alone or together with VD or together with Opentrack as well as the various ChrewChief VR plug-ins should also be mentioned, when trying to get older and ancient sims fully 3D functional in VR.

Edit: using VD, fav. combo GTR2 PnG + Alfa Romeo 1300 GTA Junior WB racing mixed PnG grid @ Montagna di Pietra is a massive BLAST even keyboard driving from above mentioned laptop - and again using open world boundaries you are able to do a walk around the town, being a 'live' spectator, enjoying the fabulous engine sounds nearing you before they enter your eyes around the corner - just wow (everybody writing about 'which sim has the best sound modeling', but the mods are missed in action here, this is the best you can get - also alot of 60ies and 70ies AC mods are top notch, adding alot to the total immersion factor, especially being in VR!).

Ofcourse all this mingling is not necessary for modern VR dedicated sims and the use of UE4 engine (AMS2 and PC2) tops ACC and especially rF2 and R3E were directly dissapointing (had to make use of VD to improve graphics and raise in-VR resolution).

Upgrading my GFX to more up-to-date standards saves me alot of time fine tuning and scrutineering, leving room for my limited time of optimizing the immersion factor.

Hey, maybe my next investment will be simrig buttons and maybe a buttkicker :)
How did you manage to get the quest 2 finger tracking into ac? I can't find an answer anywhere
 
If they had finger tracking as standard in VR games, either through gloves or camera (although for a sim racer I think gloves would be better and the ability to add real world things like the wheel or button boxes into the virtual world I think it would be enough.

It would be great to be able to track the real world wheel so you can be sure of your position in the cockpit.

One other thing I want in VR is to be able to look at a camera feeds from the real world, either a camera attached to my PC so I can see what's going on out there or even the ability to see front door cameras.
Mixed reality and tracking via cameras seems like it would have a pretty big overhead.
 
Assetto Corsa's CSP mod has actually recently added the ability to track hands and fingers, so you actually can see your own digits now with a predicted arm. We aren't at the stage where we see ourselves in the car with no gloves and sat there in jeans but its getting closer. But that is still Virtual Reality.
where do you set that up?
 
Premium
Thanks for the article, Julian, pretty intriguing. Your concept of "Mixed Reality" here is pretty ambitious, as is the interpretation of Marcel Pfister. In general, I'd say "Mixed Reality" can be anything that blends the physical with the virtual world. Personally, I don't like VR too much for all the shortcomings it still has (cables, comfort, technical issues), and have rather focused on the driver's eye topic to do some mixed reality sim racing. I am not saying that I am at all meeting your criteria, yet it is fun, can be realized on a budget and still provides a special perspective and immersion.

Here is an example:

Happy racing!
 
Last edited:
I see Meta has stuck the price of the Oclulus Quest up £100. Oh well I'll stick with the Lenovo Explorer for the moment. Odd price move given the idea was the get everyone into the Metaverse.
 
I don't get the point why you have to see your hands and the steering wheel... try to focus more on the road and the opponents in front to avoid T1 accidents ;)
 
All this nonsense about vr and simrigs made me simply buy a faster cars in the end. Corona is gone, tracks are open again for trackdays. My time spend in sims, and the money spend on sim-stuff is going down drastically.
 
Premium
All this nonsense about vr and simrigs made me simply buy a faster cars in the end. Corona is gone, tracks are open again for trackdays. My time spend in sims, and the money spend on sim-stuff is going down drastically.
Enjoy!

Anything else that you need to get off your chest before you leave us poor sim racers and our nonsense?
 
Last edited:
Enjoy!

Anything else that you need to get off your chest before you leave us poor sim racers and our nonsense?
Yes, if you got 58.000€ to spend, don't buy one of the design sim rigs, buy a Porsche Cayman instead. Not a lot of time left for ICE cars that are easy to obtain and maintain.
 
Premium
I'm done wasting money on ICE cars and consider them a huge waste of money only eclipsed by boats. My last houseboat was a serious money pit. My next car will be electric.

My sim rig is for playing.

If I owned a sportscar, it would collect dust. I have zero use for one.

But have fun! Just remember that everyone has different priorities and different things fit their lives.
 
I'm done wasting money on ICE cars and consider them a huge waste of money only eclipsed by boats. My last houseboat was a serious money pit. My next car will be electric.

My sim rig is for playing.

If I owned a sportscar, it would collect dust. I have zero use for one.

But have fun! Just remember that everyone has different priorities and different things fit their lives.
I'm 50 and amidst the midlife crisis. I needed that Porsche badly to compensate... futhermore, it replaced a 20 year old Z3 that is not fit anymore for tracktime.
 
Last edited:
Yes, if you got 58.000€ to spend, don't buy one of the design sim rigs, buy a Porsche Cayman instead. Not a lot of time left for ICE cars that are easy to obtain and maintain.
Don't get me wrong I realy like the Cayman, but a racecar for 58k...? Can't stop laughin :D
The GT4 streetcar starts at over 100k, btw.

For proper VR simming you need something about 5-6k. With the advantage to race whenever and wherever you wan't. Not nonsense from my point of view.
 
I totally agree, all those nice wheels, button boxes etc that you don't see in VR. I only drive in VR but it would be nice to not having to remember all buttons.
 
Premium
I'm 50 and amidst the midlife crisis. I needed that Porsche badly to compensate... futhermore, it replaced a 20 year old Z3 that is not fit anymore for tracktime.
If track time has been an important part of your life, this purchase makes sense.

I've also seen guys building rigs as they are reaching retirement with the idea this is something they will enjoy spending their time on. So far I've not seen that work out.

Enjoy your toys!
 

Latest News

Article information

Author
Julian Strasser
Article read time
2 min read
Views
24,892
Comments
78
Last update

Are you buying car setups?

  • Yes

  • No


Results are only viewable after voting.
Back
Top