Guide for clouding gaming on Apple Vision Pro

Cloud Gaming on Apple Vision Pro.md

Cloud Gaming on Apple Vision Pro

Cloud Gaming is a great way to enjoy graphically demanding games on Apple Vision Pro.

Since Safari on visionOS does not support PWA mode, here is how you can access cloud gaming services on Apple Vision Pro.

What’s needed

• A compatible game controller
  • visionOS supports game controller from Xbox, PlayStation, and Nintendo Switch.
  • visionOS is really opinionated on where to send game controller events so if your controller is not working with the service you're using, try tap the center of the view and that should inform visionOS that this app should receive the game controller events.
• Nexus⁺ app
  • Disclosure - I made this because I wanted to access these services myself. Some other apps may also available.

Using GeForce Now

GeForce Now is the ideal cloud gaming service to use on Apple Vision Pro. With 4K resolution support (GeForce Now Ultimate membership required), the visual quality of the games is stunning.

After pairing the game controller with Apple Vision Pro, you can access GeForce Now from the bookmarks.

Before starting your first game session, make sure you go to GeForce Now settings and adjust the picture quality for higher resolution streaming, as the default option may not be optimal for a large canvas. (Due to the lack of H.265 support in Safari's WebRTC implementation, you may experience visual glitch streaming in 4K 120FPS configuration. In that case try switch back to 4K 60FPS instead.)

If you run into issue starting the game session, try turn off Turbo mode from the edit menu.

Using Xbox Cloud Gaming

Xbox Cloud Gaming is also available and offers a wide range of console games that might be interesting to explore. The service currently only supports streaming up to 1080p.

You can access Xbox Cloud Gaming from your bookmarks.

The app also includes an option to use Better xCloud with the website. Better xCloud enables Remote Play from your Xbox console and offers a wide range of options you can tweak. You can enable the script by long-tapping on the bookmark option to open the context menu, select Edit, and enable Better xCloud.

To update the Better xCloud script, long-tap on the row to show the context menu and select Update to download the latest script.

#AppleVisionPro #visionOS

That’s a GFN decision, they decided on iOS variants, keyboard and mouse will not be supported 😔

That’s a GFN decision, they decided on iOS variants, keyboard and mouse will not be supported 😔

I think it's because both WebKit and Chromium don't support PointerLock API on mobile.

You can test it here: https://mdn.github.io/dom-examples/pointer-lock/

Bummer. Thanks for the response. And for Nexus +. Super useful.

Thanks for making this! I'm noticing serious stuttering on Geforce Now with my AVP OS 1.1 with Gigabit internet (realworld speeds around 500mbps) I've tried various settings in Geforce but no luck.

@mikecfisher Can you try the workaround to explicitly set your WiFi access point to operate on Channel 149 (US)?

Thanks @KhaosT I'm sure that fix would probably help but sadly I'm on a TPlink Deco mesh system that doesn't let me manually set the wifi channel 🤦🏼

Thanks for making this.

I was trying to play some blizzard games but I encountered an issue when I use the nexus keyboard pop up to fill in credentials for battle.net.

The keys have an infinite press no matter what I do... I tried to speak-to-type but still held on to previous infinite press.

Well I found a workaround using MacBook keyboard... in any event, thanks again this is a very cool added dimension.

@captsupermarket I assume you’re using GFN? You can try to use the built-in clipboard manager from the app, I found that’s a lot easier to input credentials instead of typing with keyboard manually every time. To use the clipboard manager, go into the bookmarks list screen and edit the GFN bookmark, there is a section to put texture you want. After that’s saved, you can quickly copy things from the menu and paste on GFN.

ps5 controller doesn't work ,
what todo

@masaldana2 visionOS is a little buggy if the controller is connected after the website is loaded. Try force close the app (long press both side button and digital crown), connect the controller, and reopen the app.

Hi @KhaosT,

Could you please change the Better xCloud's link from https://github.com/redphx/better-xcloud to https://better-xcloud.github.io (since it has more info)?

I also added a link to your app on the homepage.

Thanks.

@redphx Done ^^ Thanks 🙏

@KhaosT is there anything that you can do with the app so that it doesn’t intercept the audio channel? I am trying to play GeForce now while watching a movie via Safari or even a YouTube video via Juno and it doesn’t work. My understanding is that the OS doesn’t allow multiple audio streams via apps at one time. figured I’d ask.

@aaronvatenine yeah unfortunately visionOS like iOS doesn’t really let multiple apps to have active audio sessions in ways that doesn’t interfere with each other in this case 😅

Makes sense, thank you!

@KhaosT I absolutely love Nexus+. Together with GeforceNow it is one of my most favorite use cases of my Apple Vision Pro. 💯
But I am facing a major issue currently unfortunately:

• I tested out the ultra wide (32:9) screen ratio and set both the Nexus+ Ratio as well as the GeforceNow Settings Ratio to 32:9 (3840 x 1080).
• It works great with Fortnite
• But now I can’t set the GeforceNow Resolution back to 4k (16:9) like I did use it previously
• The max resolution I can get now is 2560 to 1440
• I reinstalled Nexus+ several times, logged out and tested everything I could think of but nothing solved the issue

Do you have any idea how I can get back 4k?

Also I would like to know the following: What is the max frames per seconds Nexus+ can deliver together with GeforceNow? Is it 60 fps or can it go to the max the Vision Pro can provide (100 fps)?
Is there any timeline regarding HDR support?

Thanks a lot upfront and congratulations to this great app! Cheers, David

@gschaiderd Looks like GFN changed how they decide which device is capable of 4K streaming and the original patch I did no longer works. I'll try to fix it this weekend but Apple is being super annoying in approving this app (my last app update is still stuck in review over a week now) so who knows when it will get approved on App Store with the fix ¯_(ツ)_/¯

What is the max frames per seconds Nexus+ can deliver together with GeforceNow? Is it 60 fps or can it go to the max the Vision Pro can provide (100 fps)?

I mean... you can set it to 120fps and it will run fine, it's just H.264 is not really good at decoding that so often you'll see visual glitches. It's up to Apple to enable H.265 decoding in WebRTC on visionOS... which hopefully they will do in the next visionOS update.

Is there any timeline regarding HDR support?

This is on Nvidia, the Web version just doesn't support that.

@KhaosT: Do you have any update for us?

@gschaiderd the update with the fix was submitted to app review on Friday evening and they rejected it on Saturday saying they have problem with the app including bookmarks to GFN and Xbox Cloud Gaming despite approving that explicitly in the past 🙃

They said they will schedule a call to chat about this in the next few days…

@KhaosT any update?

@gschaiderd we had the call and on the call they said the app review team still think the app is not allowed to display bookmarks involving GFN and Xbox Cloud Gaming.

If I don’t agree with their assessment I can appeal. So I did the appeal process. No idea how long it will take for them to review the appeal 🫠

Well, this is disappointing 🙃

@KhaosT that’s unfortunate. Why do they just limit the resolution and not block the application entirely with these arguments?
Solution proposal:

• Remove the bookmarks
• Show a short instruction at the landing page or when a user first open the page how a user can add bookmarks with recommendations of the services (GeforceNow, xBox Cloud Gaming, etc.)
• This should remove the issues from Apple, right?

When you want to use xBox Cloud Gaming on the iPad you also have to save it from Safari as a bookmark on the homescreen so this should be nothing new for most users.

We need this app in 4k! Cheers, David

@KhaosT any updates and answers to my questions/proposal? 🙏🏻

@gschaiderd yeah I submitted another update updating the bookmarks and it has been stuck in app review since Tuesday ¯_(ツ)_/¯

@KhaosT GeForce Now via Nexus+ has been the killer app for me and I’ve clocked up countless hours. How can I tip you for your awesome work?

@gschaiderd Good news, Apple finally approved it after a week 😅 v1.0.7 in App Store now should make the 4K options appear again.

@edowling haha glad you like it ^^ No need for tips, just sharing the existence of the app with friends who might be interesting would be cool. App Store's discovery is terrible for visionOS.

Great news! How long does it take typically to publish the update? To be honest I really would recommend you to make it cost e.g. 4.99 $ as it is a killer app for many. I would also like to tip you 10 $ if possible. 💯

No need for that ^^ Have fun gaming 🙌