A Guide to get VTube Studio and VSeeFace working on Linux. Tested on Arch Linux

VTube Studio [Arch Linux Guide].md

VTube Studio/OpenSeeFace/VSeeFace Guide (tested on Arch Linux)

Requirements:

• Latest Proton (GE-Proton, Proton-Experimental are both okay)
• git
• wine64
• lutris (winetricks)
• Install system packages for python (3.11.3 is okay): sudo pacman -S python python-pip python-virtualenv

Download and install OpenSeeFace environment:

• git clone https://github.com/emilianavt/OpenSeeFace && cd OpenSeeFace && virtualenv -p python3 venv && source venv/bin/activate && pip install onnxruntime opencv-python pillow numpy
• You need to always start OpenSeeFace in this folder with active env, so you need always: source venv/bin/active
• Start the tracker with:
• python facetracker.py -c 0 -W 1280 -H 720 --discard-after 0 --scan-every 0 --no-3d-adapt 1 --max-feature-updates 900 --ip 127.0.0.1 --port 11573
• This terminal window needs to be always open while using VTube Studio and it will use a lot of your cpu

VTube Studio

• Start VTube Studio from Steam and make sure that you have SteamPlay enabled and is using the latest Proton version.
• On the first start you will get some errors, just clicking them away should be fine.
• To connect VTube Studio with your running OpenSeeFace tracker, you will need to create a file in the following location:
  • ~/.local/share/Steam/steamapps/common/VTube Studio/VTube Studio_Data/StreamingAssets/ip.txt
  • it's content should be the following:

  # To listen for remote connections, change this to 0.0.0.0 or your actual IP on the desired interface.
  ip=0.0.0.0
  
  # This is the port the server will listen for tracking packets on.
  port=11573
  

• When both the tracker and VTube Studio are running, click on Settings in VTube Studio, select the camera and enable the "Autostart cam wih VTS", then click on "Camera on".
• with this your tracking should be working in VTube Studio
• While facetracking is working with this, many features of VTube Studio aren't working with OpenSeeFace

Install VSeeFace (VTube Studio "alternative" in lutris (gui)

• Download VSeeFace
• unzip the .zip you downloaded
• Open Lutris
  • click on the plus in the top left corner and "Add game"
  • In the Game info tab, you need to give it a name (e.g. VSeeFace) and select wine as the runner
  • In the Game options tab, browse for "VSeeFace.exe" as the Executable and it's directory as working directory
  • If you want, you can set the wine-prefix in the same directory or leave it empty for using the system-wine-prefix (~/.wine)
  • Select 64-bit in the Prefix architecture
  • click save
• make sure you have running the facetracker from above
• Start it once, but you will notice that a font (arial) is missing which we will install now using winetricks
  • Close the game and click on right arrow next to the bottle and select "winetricks"
  • select default prefix and then "install font"
  • search and select arial, when it is installed, select OK and then you can close winetricks
  • Start VSeeFace from Lutris, read or skip the tutorial
  • Set Camera on "Network Tracking" and the microphon input you are using (in my case PulseAudio)
• From here on, just take a look at https://www.vseeface.icu/ for more information :)

Sources:

https://www.reddit.com/r/VirtualYoutubers/comments/j8ebuu/how_to_run_vseeface_on_linux/

https://www.vseeface.icu/#running-on-linux-and-maybe-mac

https://github.com/emilianavt/OpenSeeFace

Thanks to everyone who contributed to this.

You mean "so you need always: source venv/bin/activate"

But yeah I can confirm this works great.