meshula/character_anim.md

## character_anim.md

      
    Raw
  

              character_anim.md
            
          
    Character Animation


[https://github.com/ethz-adrl/control-toolbox] Control Toolbox - An Open-Source C++ Library for Robotics, Optimal and Model Predictive Control


[https://github.com/davepagurek/DynamicKelvinlets] Dynamic Kelvinets to add secondary animation


[http://domedb.perception.cs.cmu.edu/monototalcapture.html] Yassar's group's monocular mocap


[https://arxiv.org/abs/1812.11103v3] Learning to Walk via Deep Reinforcement Learning


[https://arxiv.org/abs/1810.02363v4] Recurrent Transition Networks for Character Locomotion


[http://www.andreasaristidou.com/publications/papers/CUEDF-INFENG,%20TR-632.pdf] FABRIK


[https://github.com/dgriff777/a3c_continuous] A3 Continuous Character Controller


[http://research.cs.wisc.edu/graphics/Gallery/FootskateSolver/footskate.html] Footskate lib.


[http://www.goatstream.com/research/papers/SA2013/SA2013.pdf] Muscle based bipeds


[https://github.com/TheComet/ik] FABRIK solver


[http://ogldev.atspace.co.uk/www/tutorial38/tutorial38.html] Assimp character data


[http://theorangeduck.com/page/deep-learning-framework-character-motion-synthesis-and-editing] Motion synthesis


[https://github.com/AliJalalifar/Character_Animation] Motion synthesis


[https://github.com/tcoppex/aer-engine] Animation engine with computer shaders


[https://github.com/sreyafrancis/PFNN] Demo (no code) of phase function NN


[http://web.cs.ucla.edu/~nakada/pdfs/siggraph18_nakada.pdf] Deep Learning of Biomimetic Sensorimotor Control
for Biomechanical Human Animation


[http://crl.ethz.ch/publications.html] Robot control


[https://arxiv.org/pdf/1805.09488.pdf] Viseme Net


[https://github.com/purdue-biorobotics/flappy] Winged Locomotion Controller


[https://github.com/nfrechette/acl] Animation Compression Library


[[https://github.com/pafuhana1213/KawaiiPhysics] Kawaii Physics as used in games such as FFXIV


Rigging


[https://medium.com/blue-sky-tech-blog/choprig-system-b11d4c1e252c] BlueSky's ChopRig system
[https://zhan-xu.github.io/rig-net/] SIGGRAPH 2020 paper "RigNet: Neural Rigging for Articulated Characters"
[https://github.com/zhan-xu/RigNet] RigNet code
[https://github.com/electronicarts/dem-bones] Dem Bones - deriving rig weights from sample poses

Parameteric Models and Priors


[https://github.com/ICT-VGL/ICT-FaceKit] A deformable, parametric base mesh for faces
[http://www.makehumancommunity.org] Make Human procedural character generator
[https://github.com/nghorbani/human_body_prior] Morphable Human Body Prior

Locomotion


[https://github.com/ProjectBorealis/PBCharacterMovement] HL2-style movement engine in c++
[https://github.com/dyanikoglu/ALSV4_CPP] Advance Locomotion System in C++

Simulation


[https://github.com/opensim-org/SCONE] Open Source Software for Predictive Simulation of Biological Motion.


[https://github.com/seiing/SoftCon] SoftCon: Simulation and Control of Soft-Bodied Animals with Biomimetic Actuators


[https://github.com/pafuhana1213/KawaiiPhysics/blob/master/README_en.md] Kawaii Physics, secondary animation lib
https://github.com/stack-of-tasks/pinocchio


humanoid solver pinocchio uses:
https://github.com/humanoid-path-planner/hpp-fcl
hpp-fcl is derived from
https://github.com/flexible-collision-library/fcl
fcl uses:
https://github.com/danfis/libccd
https://github.com/OctoMap/octomap
Miku Miku Dance


[https://starletgem.deviantart.com/favourites/73510452/MMD] A bunch of MMD resources
[https://sites.google.com/site/mikumikumovingeng/] Miku Miku Moving
[https://github.com/ray-cast/ray-mmd] Miku Miku PBR rendering
[https://github.com/powroupi/blender_mmd_tools] Blender MMD tools
[https://learnmmd.com/http:/learnmmd.com/convert-vroid-studio-to-mmd-with-one-click/] Convert VRoid studio to MMD
[https://www.deviantart.com/mmd-nay-pmd/art/New-MMD-Motion-Data-Index-A-L-526892180] data resource index
[https://www.deviantart.com/mmd-nay-pmd/art/New-MMD-Motion-Data-Index-M-Z-531358782] index continued

Deformation


[https://github.com/tneumann/skinning_decomposition_kavan] Kavan's Skinning Decomposition
[https://github.com/3d-morphable-models/curated-list-of-awesome-3D-Morphable-Model-software-and-data] Morphable Models
[https://github.com/electronicarts/dem-bones] dem bones - EA's LBS skinning computation

Hair


[https://github.com/mravella/hair] Hair rendering
[https://github.com/CaffeineViking/vkhr] Vulkan hair engine
[http://www.kunzhou.net/2019/dynamic-hair-capture-sa19.pdf] Single view hair capture to mesh
[https://prettydarke.cool/portfolio/open-source-afro-hair-library/] Open Source Afro Hair library

Authoring


[https://github.com/alexismorin/Salon] Hair Salon (Unity VR tool)
[http://www.makehumancommunity.org/] Make Human
[http://kunzhou.net/2019/neuroskin.pdf] Neuroskinning
[http://www.dgp.toronto.edu/~depaolic/projects/secondSkin/] Second Skin Modeling technique
[https://github.com/intel/riggingtools] Rigging Tools by Intel
[https://arxiv.org/pdf/1909.01064.pdf] Automated Parameterized Face Capture for Games

Pose Estimation


[https://github.com/Mirevi/MotionHub] Merge body tracking data from different systems into a single coordinate system


[https://github.com/jiang-du/BlazePose-tensorflow] A third-party Tensorflow Implementation for paper "BlazePose: On-device Real-time Body Pose tracking".


[https://github.com/CalciferZh/minimal-hand] Minimal real time video hand tracker


[http://files.is.tue.mpg.de/black/talks/GCPR2018webSmall.pdf] Fantastic History of Human Motion Tracking


[https://github.com/mks0601/3DMPPE_POSENET_RELEASE] "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image", ICCV 2019


[https://github.com/zhan-xu/AnimSkelVolNet] 3DV 2019 paper "Predicting Animation Skeletons for 3D Articulated Models via Volumetric Nets"


[https://github.com/jin-s13/COCO-WholeBody] COCO Wholebody landmarked data set


[https://github.com/hongsukchoi/Pose2Mesh_RELEASE] "Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose", ECCV 2020


[http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123460188.pdf] VoxelPose: Towards Multi-Camera 3D Human
Pose Estimation in Wild Environment


-[http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123520596.pdf] Neural Articulated Shape Approximation


[https://github.com/facebookresearch/VideoPose3D] FRL Video Pose Estimation and paper: https://dariopavllo.github.io/VideoPose3D/


[https://github.com/ArashHosseini/3d-pose-baseline] A realtime 3d pose estimation baseline


[https://github.com/mks0601/3DMPPE_POSENET_RELEASE] "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image", ICCV 2019


https://arxiv.org/pdf/1906.00161.pdf


[https://github.com/robertjoosten/video2mocap] Use OpenPose and ffmpeg to convert video to Maya animations


[https://github.com/Shimingyi/MotioNet] MotioNet code


[http://andreasaristidou.com/publications/papers/MotioNet.pdf] MotioNet paper ToG 2020


[https://dl.acm.org/doi/10.1145/3403736.3403938] Technicolor Facelab, as used in Cats. DigiPro 2020


[https://github.com/n1ckfg/OpenPoseRig] Using OpenPose in a 3D animation pipeline. Based on the work of @CMU-Perceptual-Computing-Lab, @una-dinosauria, @ArashHosseini, and @keel-210.


[https://github.com/CalciferZh/minimal-hand] A minimal solution to hand motion capture from a single color camera at over 100fps. Easy to use, plug to run.


https://github.com/foolwood/DAT Fast Segmentation Attention Filter


[https://montreal.ubisoft.com/fr/robust-solving-of-optical-motion-capture-data-by-denoising-2/] Mocap denoising


[https://kv2000.github.io/2020/03/25/deepFashion3DRevisited/] Single Image Clothes Mesh Estimation


[https://github.com/akanazawa/human_dynamics] Human Capture with neural rnder


Neural Control

-[https://research.fb.com/publications/a-scalable-approach-to-control-diverse-behaviors-for-physically-simulated-characters/] Scalable Diverse Control for Physically Simulated Characters
http://mrl.snu.ac.kr/research/ProjectScalable/Page.htm
https://motionretargeting2d.github.io/
https://www.cell.com/neuron/pdf/S0896-6273(19)30932-8.pdf Nested Neuronal Hierachies Orchestrate Control
https://montreal.ubisoft.com/en/drecon-data-driven-responsive-control-of-physics-based-characters/ DReCon
https://static-wordpress.akamaized.net/montreal.ubisoft.com/wp-content/uploads/2019/11/13214229/DReCon.pdf
https://www.gameanim.com/2020/03/24/ragdoll-motion-matching/


[https://github.com/UBCMOCCA/SymmetricRL] Learning Symmetrical Locomotion


[https://www.goatstream.com/research/papers/SA2013/SA2013.pdf] Flexible Muscle-Based Locomotion for Bipedal Creatures, Siggraph Asia, 2013


[https://www.goatstream.com/research/papers/SA2013/index.html] Project page


[https://arxiv.org/pdf/2003.09820.pdf] A neural rig space for neural rendering (Disney Research) http://studios.disneyresearch.com/2020/03/24/rig-space-neural-rendering/


https://arxiv.org/pdf/2007.13886.pdf Perpetual Motion: Generating Unbounded Human Motion
https://sites.google.com/view/hsnms Hierarchical Style-based Networks for Motion Synthesis
Musculoskeletal Control

https://arxiv.org/pdf/2007.15311.pdf Functionality-Driven Musculature Retargeting
Tangible Interfaces


[http://didi.com] Didi made the Monkey controller
[https://igl.ethz.ch/projects/character-articulation-input-device/] Siggraph 2014, 3d printed lego-like controllers
[https://www.youtube.com/watch?v=vBX47JamMN0] Demonstration of the printed controllers
[http://www.blep.com/files/2613/6986/1526/DID.pdf] Dinosaur Input Device

Anime Rendering


[https://www.cse.cuhk.edu.hk/~ttwong/publication-favorite.html] Deep learning on various rendering tasks

Misc


[http://www.michaeldempsey.me/animation/#Tomorrow'sTech]
[https://www.behance.net/edillinger Eric Dillinger's stop motion for ILM]
[https://github.com/facebookresearch/fairmotion] Tools for BVH processing and annotation

Tracking


[https://github.com/Mirevi/MotionHub] MotionHub


[https://arxiv.org/abs/2002.12625] 4D Association Graph for Realtime Multi-person Motion Capture Using Multiple Video Cameras, Yuxiang Zhang, Liang An, Tao Yu, Xiu Li, Kun Li, Yebin Liu


[https://anipose.readthedocs.io/en/latest/] Anipose


[https://geometry.stanford.edu/projects/human-dynamics-eccv-2020/] Contact and Human Dynamics from Monocular Video - this is the one with a physics based model


[https://montreal.ubisoft.com/en/robust-motion-in-betweening-2/] ROBUST MOTION IN-BETWEENING https://static-wordpress.akamaized.net/montreal.ubisoft.com/wp-content/uploads/2020/07/09155337/RobustMotionInbetweening.pdf


[https://static-wordpress.akamaized.net/montreal.ubisoft.com/wp-content/uploads/2020/07/09154101/Learned_Motion_Matching.pdf] Learned MOtion Matching


-[https://arxiv.org/pdf/2004.04572.pdf] ARCH for Sausalito FRL