Guide for clouding gaming on Apple Vision Pro

Cloud Gaming on Apple Vision Pro.md

Cloud Gaming on Apple Vision Pro

Cloud Gaming is a great way to enjoy graphically demanding games on Apple Vision Pro.

Since Safari on visionOS does not support PWA mode, here is how you can access cloud gaming services on Apple Vision Pro.

What’s needed

• A compatible game controller
  • visionOS supports game controller from Xbox, PlayStation, and Nintendo Switch.
  • visionOS is really opinionated on where to send game controller events so if your controller is not working with the service you're using, try tap the center of the view and that should inform visionOS that this app should receive the game controller events.
• Nexus⁺ app
  • Disclosure - I made this because I wanted to access these services myself. Some other apps may also available.

Using GeForce Now

GeForce Now is the ideal cloud gaming service to use on Apple Vision Pro. With 4K resolution support (GeForce Now Ultimate membership required), the visual quality of the games is stunning.

After pairing the game controller with Apple Vision Pro, you can access GeForce Now from the bookmarks.

Before starting your first game session, make sure you go to GeForce Now settings and adjust the picture quality for higher resolution streaming, as the default option may not be optimal for a large canvas. (Due to the lack of H.265 support in Safari's WebRTC implementation, you may experience visual glitch streaming in 4K 120FPS configuration. In that case try switch back to 4K 60FPS instead.)

If you run into issue starting the game session, try turn off Turbo mode from the edit menu.

Using Xbox Cloud Gaming

Xbox Cloud Gaming is also available and offers a wide range of console games that might be interesting to explore. The service currently only supports streaming up to 1080p.

You can access Xbox Cloud Gaming from your bookmarks.

The app also includes an option to use Better xCloud with the website. Better xCloud enables Remote Play from your Xbox console and offers a wide range of options you can tweak. You can enable the script by long-tapping on the bookmark option to open the context menu, select Edit, and enable Better xCloud.

To update the Better xCloud script, long-tap on the row to show the context menu and select Update to download the latest script.

#AppleVisionPro #visionOS

Hi @KhaosT, since the last update the GeForce Statics do not show any values anymore. Could you please check it? Thanks

@noonanbobby The problem is more around Google's browser detection thing I believe. Can you try login to Google first (by making a new bookmark to Google.com) and then see if the login with Google works afterwards? If it still doesn't maybe try link a different login method to your Nvidia account.

@gschaiderd Yeah it looks like GFN updated their stuff so on "mobile" it no longer reports the stats. I'll see if I can restore that but if the code just doesn't run on GFN side, I'll probably have to take it out instead.

@gschaiderd okay the stats thing was fixed in the latest app update 👍

@gschaiderd okay the stats thing was fixed in the latest app update 👍

Great thanks a lot!💯

@KhaosT do you think the latest changes in visionOS 2.0 will allow having more capabilities in Nexus+?

@balansse visionOS 2.0 enabled WebRTC H265 support in WebKit so that can now be used for streaming from GFN.

@KhaosT is app update required to benefit from this?

Yeah I'll probably update it to make this work soon ^^

@KhaosT what would this mean in practice? Do you also see any new possibilities to make Controller Vibrations work? I am already on Vision OS 2.0 - when do you plan to provide Update via TestFlight? 👍🏻

More efficient encoding enables better image quality while using less bandwidth. Enabling H265 can be shipped in normal app update.

No idea about the controller stuff.

Sounds good! I am using GeforceNow on 75 Mbit/s (max). Would h265 improve quality even more? Does it also has an impact on how high framerates are handled/displayed on AVP?

Can you already estimate when you Update this?

You can search H265 vs H264 online and get a sense of how different codec performs. No promise on when the update will be available yet.

@gschaiderd Alright v1.0.9 now included this. If you are on visionOS 2 beta, GFN should select H265 automatically if available.

@KhaosT Thank you for the update! I guess I can finally re-enable 120 FPS now ^^

I noticed a weird bug, the app is not showing up in the Playing Now widget in Control Center so there is no way to control spatial audio settings for it. I wonder if this is a 2.0 beta 1 bug or if it's something in the app. It was definitely working before as I already changed these settings for Nexus once.

It’s probably visionOS 2 issue since we don’t control what shows up in control center from the app in this case.

Any way to play Amazon Luna games with a bookmark? There are a couple games on there I’d like to try but it keeps giving an error. (Don’t have my VP near right not for the exact error, happy to send if it’s not already known) something about the session being terminated.

@justinreeves00 Try set the user agent to Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.3 Safari/605.1.15, last time I think it worked for me.

It’s running smoothly for me on Vision OS 2 (beta 2) with H.265 enabled and 75Mbps/4K/120fps. Given that the Vision Pro is only capable of 90hz, does it make sense to enable vsync within the game? It doesn’t seem to be an issue, but was wondering if that would make things as smooth as possible. Really hoping for HDR one of these days if Nvidia will allow it! Thanks for all your hard work on this app. The experience is amazing and so immersive on such a large screen.

@KhaosT would it be possible to play with GeForce now in the movie mode in the environments like we can do now in visionOS 2.0 for every Safari video? As I assume Safari handles GeForce Now like a stream this should be feasible? Cheers, David

@gschaiderd not really. Video player environment integration is currently only available for HLS stream, which has a much higher latency than WebRTC so none of the cloud gaming platform is doing HLS for streaming.

@KhaosT thanks for the insights. Another question: Do you see any possibility to improve the sound in games? Today I played Fortnite since months and recognized that the 3D audio is much better.
Also: Any new possibilities with visionOS to bring vibrations to the AVP? 😊