Skip to content

Instantly share code, notes, and snippets.

@KhaosT
Last active May 10, 2024 04:10
Show Gist options
  • Star 39 You must be signed in to star a gist
  • Fork 2 You must be signed in to fork a gist
  • Save KhaosT/a4d90479e3cb0aae959ad55b08cd8358 to your computer and use it in GitHub Desktop.
Save KhaosT/a4d90479e3cb0aae959ad55b08cd8358 to your computer and use it in GitHub Desktop.
Guide for clouding gaming on Apple Vision Pro

Cloud Gaming on Apple Vision Pro

GeForce Now

Cloud Gaming is a great way to enjoy graphically demanding games on Apple Vision Pro.

Since Safari on visionOS does not support PWA mode, here is how you can access cloud gaming services on Apple Vision Pro.

What’s needed

  • A compatible game controller
    • visionOS supports game controller from Xbox, PlayStation, and Nintendo Switch.
    • visionOS is really opinionated on where to send game controller events so if your controller is not working with the service you're using, try tap the center of the view and that should inform visionOS that this app should receive the game controller events.
  • Nexus⁺ app
    • Disclosure - I made this because I wanted to access these services myself. Some other apps may also available.

Using GeForce Now

GFN

GeForce Now is the ideal cloud gaming service to use on Apple Vision Pro. With 4K resolution support (GeForce Now Ultimate membership required), the visual quality of the games is stunning.

GFN-Bookmark

After pairing the game controller with Apple Vision Pro, you can access GeForce Now from the bookmarks.

Before starting your first game session, make sure you go to GeForce Now settings and adjust the picture quality for higher resolution streaming, as the default option may not be optimal for a large canvas. (Due to the lack of H.265 support in Safari's WebRTC implementation, you may experience visual glitch streaming in 4K 120FPS configuration. In that case try switch back to 4K 60FPS instead.)

If you run into issue starting the game session, try turn off Turbo mode from the edit menu.

GFN-Edit

Using Xbox Cloud Gaming

Xbox

Xbox Cloud Gaming is also available and offers a wide range of console games that might be interesting to explore. The service currently only supports streaming up to 1080p.

Xbox-Bookmark

You can access Xbox Cloud Gaming from your bookmarks.

The app also includes an option to use Better xCloud with the website. Better xCloud enables Remote Play from your Xbox console and offers a wide range of options you can tweak. You can enable the script by long-tapping on the bookmark option to open the context menu, select Edit, and enable Better xCloud.

Xbox-Edit Xbox-Edit-Script

To update the Better xCloud script, long-tap on the row to show the context menu and select Update to download the latest script.

Xbox-Script-Update

#AppleVisionPro #visionOS

@KhaosT
Copy link
Author

KhaosT commented Apr 8, 2024

@gschaiderd the update with the fix was submitted to app review on Friday evening and they rejected it on Saturday saying they have problem with the app including bookmarks to GFN and Xbox Cloud Gaming despite approving that explicitly in the past 🙃

They said they will schedule a call to chat about this in the next few days…

@gschaiderd
Copy link

@KhaosT any update?

@KhaosT
Copy link
Author

KhaosT commented Apr 11, 2024

@gschaiderd we had the call and on the call they said the app review team still think the app is not allowed to display bookmarks involving GFN and Xbox Cloud Gaming.

If I don’t agree with their assessment I can appeal. So I did the appeal process. No idea how long it will take for them to review the appeal 🫠

@KhaosT
Copy link
Author

KhaosT commented Apr 16, 2024

Well, this is disappointing 🙃

Screenshot 2024-04-16 at 4 51 31 PM

@gschaiderd
Copy link

@KhaosT that’s unfortunate. Why do they just limit the resolution and not block the application entirely with these arguments?
Solution proposal:

  • Remove the bookmarks
  • Show a short instruction at the landing page or when a user first open the page how a user can add bookmarks with recommendations of the services (GeforceNow, xBox Cloud Gaming, etc.)
  • This should remove the issues from Apple, right?

When you want to use xBox Cloud Gaming on the iPad you also have to save it from Safari as a bookmark on the homescreen so this should be nothing new for most users.

We need this app in 4k! Cheers, David

@gschaiderd
Copy link

@KhaosT any updates and answers to my questions/proposal? 🙏🏻

@KhaosT
Copy link
Author

KhaosT commented Apr 21, 2024

@gschaiderd yeah I submitted another update updating the bookmarks and it has been stuck in app review since Tuesday ¯_(ツ)_/¯

@edowling
Copy link

@KhaosT GeForce Now via Nexus+ has been the killer app for me and I’ve clocked up countless hours. How can I tip you for your awesome work?

@KhaosT
Copy link
Author

KhaosT commented Apr 26, 2024

@gschaiderd Good news, Apple finally approved it after a week 😅 v1.0.7 in App Store now should make the 4K options appear again.

Screenshot 2024-04-25 at 8 13 54 PM

@KhaosT
Copy link
Author

KhaosT commented Apr 26, 2024

@edowling haha glad you like it ^^ No need for tips, just sharing the existence of the app with friends who might be interesting would be cool. App Store's discovery is terrible for visionOS.

@gschaiderd
Copy link

Great news! How long does it take typically to publish the update? To be honest I really would recommend you to make it cost e.g. 4.99 $ as it is a killer app for many. I would also like to tip you 10 $ if possible. 💯

@KhaosT
Copy link
Author

KhaosT commented Apr 26, 2024

No need for that ^^ Have fun gaming 🙌

@gschaiderd
Copy link

@KhaosT: Thank you works great again!
I have two questions:

  • What audio format do we get via Nexus+ on AVP? Is the full surround sound available like Dolby Atmos or is it compromised?
  • What FPS Settings do you recommend in GeforceNow as well as In-Game for the Apple Vision Pro?
  • Do you have any information if Nvidia is planning to support HDR via the browser in the near future?

@KhaosT
Copy link
Author

KhaosT commented May 4, 2024

@gschaiderd I’m not sure about the audio format. Personally 60 Hz gives me least issues, with 120 I occasionally see missing I-Frame. No idea about their plan for web HDR support.

@Qu3u3Cumb3r
Copy link

Hello, I am trying to use mouse and keyboard on games with Nexus+ after getting the mouse to work on the AVP using Assistive Touch. GeForce now allows me to use the mouse to select games and use their menu systems, but once I get to the Steam user interface, the mouse stops being able to select things and I’m stuck only being able to use the controller.

I would like to be able to use the mouse and keyboard rather than having the Steam interface switch me over to a controller. Is there a way to add in support for keyboard and mouse into the available steam settings and turn off controller use. Is there any kind of work around for this issue with Nexus+ and Steam? It looks like Steam automatically switches to Xbox mode and doesn’t give any other options.

Thank you

@KhaosT
Copy link
Author

KhaosT commented May 10, 2024

@Qu3u3Cumb3r I'm not sure it's possible. Ultimately GFN need to be the one implementing the browser pointer capture, there is not much the app itself can do here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment