This is a list of the most commonly used and relevant vtubing software. The "best" will always be subjective and depend on your specific requirements. Overall, the information in this list is as accurate as I could figure it out, but there might be errors or some details might become out of date. If you find anything that needs to be corrected, please let me know. You can also note it in a comment.
Additional explanations:
- iPhone means that an iPhone is basically required
- iFacialMocap support means that tracking data can be received from the iFacialMocap iPhone app
- VMC protocol means that the application can send and/or receive tracking data from other VMC protocol capable applications, allowing the combination of multiple tracking methods (e.g. VSeeFace receiving VR tracking from Virtual Motion Capture and iPhone/ARKit face tracking from Waidayo)
- Tobii means that the Tobii eye tracker is supported
- VR means that VR tracking is used and no camera based tracking is supported
- Desktop means that mouse and keyboard input is captured and can be used to animate the avatar instead of or in addition to face tracking
- Leap Motion means that hand and finger tracking through Leap Motion is supported
The order of this list is arbitrary and quite possibly biased, since I develop VSeeFace. Please also note that this list only includes information about tracking, not about other features like transparent background support, model formats and so on.
You can find another overview by Runa Yukiko here.
- VSeeFace (VMC protocol, Leap Motion)
- Tracking World (VR, VMC protocol)
- Virtual Motion Capture (VR, Tobii, VMC protocol)
- VMagicMirror (VMC protocol, iFacialMocap support, Desktop)
- Luppet (iFacialMocap support, Leap Motion)
- VUP (Leap Motion)
- SUVA (VR, Tobii)
- Hitogata
- Wakaru
- 3tene (Leap Motion)
- VDRAW (Desktop)
- Waidayo (iPhone, VMC protocol)
- Inochi2D (a free and open source 2D VTuber platform)
- VPupPr (a free and open source 3D VTuber software with VRM support)
Application | Price | Face tracking | VR | Leap Motion | Tobii eye tracker | VMC Protocol | iFacialMocap | Desktop tracking | iPhone required | Platform | Gaze tracking | Eyebrow tracking | Models | Account required |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
VSeeFace | free | OpenSeeFace, 66pt | no | yes | no | send, receive (from two sources) | yes | no | no | Windows | yes | yes | VRM, VSFAvatar (Unity asset bundle) | no |
Tracking World | free | - | yes | no | no | send, receive | no | no | no | Windows | no | no | VRM | no |
Virtual Motion Capture | free/¥300 | no | yes | no | yes | send (paid only), receive | no | no | no | Windows | yes (Tobii) | no | VRM | no |
VMagicMirror | free | DlibFaceLandmarkDetector, 17pt | no | no | no | no | yes | yes | no | Windows | no | no | VRM | no |
Luppet | trial/¥6,000+ | ULSee Lite, 30pt | no | yes | no | no | yes | no | no | Windows | no, moves with head | no | VRM | full version requires login |
RiBLA Broadcast (β) | free | MediaPipe | no | no/MediaPipe | no | no | yes | no | no | Windows/Mac | ? | ? | VRM | no |
VPupPr/openseeface-gd | free | OpenSeeFace, 66pt | no | no | no | no | yes | mouse via plugin | no | Windows/Linux | yes | yes | VRM | no |
VUP | discontinued | Faceunity | no | yes | no | yes | no | no | no | Windows | yes | maps to expressions | VRM | yes |
SUVA | free | - | yes | no | yes | no | no | no | no | Windows | yes (Tobii) | no | Unity asset bundle | no |
Hitogata | free | Dlib, custom? | no | no | no | no | no | no | no | Windows | no? | yes | Character maker, FBX, VRM | no |
Wakaru | free | Dlib, 68pt | no | no | no | no | no | no | no | Windows | yes | yes | VRM | no |
3tene | free/¥2,000 | Dlib, 68pt | 3tenePRO only | yes | no | no | no | no | no | Windows, Mac | no | no | VRM | no |
VDRAW | ¥1,000 | Banuba Face AR | no | no | no | no | no | no | no | Windows | ? | ? | VRM | ? |
Waidayo | free | ARKit | no | no | no | send | no | no | yes | iPhone | yes | yes | VRM | no |
VKatsu | free | Dlib, 68pt | yes | no | no | no | no | no | no | Windows | no | yes | Character maker (restricted use), paid export to Virtual Cast only | no |
Kalidoface 3D | free | MediaPipe | no | no/MediaPipe | no | no | no | no | no | Web | ? | ? | VRM | no |
VTuber Maker/Live3D | free/free trial | BaiduFace | no | no | no | no | no | no | no | Windows | ? | ? | Character maker ($19.99) | yes |
WebcamMotionCapture | trial/$1.99 per month | MediaPipe | no | no/MediaPipe | no | yes | no | no | no | Windows/Mac | no? | no? | VRM | ? |
Animaze | free/various fees | VisageTechnolgies, 78pt (was Hyprface) | no | yes | yes | yes | no (custom app only) | yes | no | Windows | yes | yes | various via auto import (incl. VRM) | no |
Warudo | free | MediaPipe/OpenSeeFace | no | no | no | yes (multiple senders/receivers) | yes | keyboard only | no | Windows | yes | yes | VRM, WarudoMod | no |
Application | Price | Face tracking | iPhone required |
---|---|---|---|
VTube Studio (Steam) | free with watermark/12.49€ | OpenSeeFace 66pt, ARKit/ARCore | no |
PrprLive | free/$9.99 DLC | IntraFace/GameAnimoji | no |
FaceRig | $14.99+ plus $3.99 (Live2D DLC) | ULSee, 66pt | no |
Animaze | free/various fees | Hyprface | no |
3tene is pronounced "mitene" from Japanese みてね, not "threeteen".
[September 2023 update]: In light of recent events might be important: Animaze has always used its own in-house indie avatar render engine for 3D and 2D and is not affected by Unity changes.
Hello Emiliana,
This is a great article.
The presented Animaze feature set though, has been inaccurate. Happy to provide the up-to-date details:
The webcam tracking solution used in Animaze was Hyprface from 2019 to 2020 (iOS) and 2020 to 2022 (Windows and iOS), but since autumn 2022 it is VisageTechnolgies (78 pt)
(Facerig was indeed ULSee from May 15 2015 to 2022).
Further Animaze details:
Models - a lot more are supported:
Extra motion:
Other unique aspects:
All the best,
Dragos