Notes about gsplat / 3DGS: 3D Gaussian Splatting (~WIP)
I'm planning to turn this into an "awesome-gsplat" repository (https://github.com/sindresorhus/awesome) or a wiki on some repository.
Feel free to add comments to this gist for now.
I'm contiuining to update this, and will hopefully get to reformatting it with thumbnails and further information (especially on performance and capabilities of implementations).
- https://www.youtube.com/watch?v=0k3aMGHmako effects compositing with human
- https://twitter.com/AlexR4/status/1720378611289526471 shaped splats (paint style like in Dream)
- https://twitter.com/Arata_Fukoe/status/1714587603994079558 (34 GoPros multi-camera setup)
- Behind the scene: https://twitter.com/Arata_Fukoe/status/1714931950719508967
- https://twitter.com/gradeeterna/status/1714946774970896643 Connected scenes (ala Block-NeRF!)
- https://twitter.com/smallfly/status/1713300692796858544 deformation
- https://twitter.com/luiscarone/status/1712822450050814386 Splat editing
- https://twitter.com/hybridherbst/status/1711758481911361738 compositing
- https://twitter.com/hybridherbst/status/1710772596692677111 object masking
- https://twitter.com/Ruben_Fro/status/1709844135279272290 3DGS with burning transition effect in Unity
- https://twitter.com/alexcarliera/status/1708466094892085492 Watch
- https://www.youtube.com/watch?v=l3XVSQs9cUc Indiana University Metz Carillon (demolished 2018; Photos from 2017)
- https://twitter.com/Alientrap/status/1707861115294585245 AR
- https://twitter.com/aras_p/status/1708056774597636243 compression (less than 8MB scene)
- https://twitter.com/AlexandreDevaux/status/1707365670596284857 Face
- https://twitter.com/diveshnaidoo/status/1693665169786782123 AR (might not be 3DGS)
- https://www.youtube.com/@historyphotogrammetry2218/videos Sculptures
- https://www.youtube.com/watch?v=KriGDLvGDZI 3D models to GS (Note: using COLMAP and other non-ideal steps)
- https://twitter.com/Aster_NeRF/status/1702704845806047270
- https://twitter.com/DrewMedina20/status/1705357414000701801 Various
- https://twitter.com/bilawalsidhu/status/1705687796638159233 painted ladies SF
- https://twitter.com/s1ddok/status/1704931093466481125 VR person
- https://twitter.com/8Infinite8/status/1704488729509761065 Person lit/captured with HDR background
- https://twitter.com/DSkaale/status/1702944308087730263
- https://www.youtube.com/watch?v=aJFoPmjPH-M
- https://twitter.com/8Infinite8/status/1699463085604397522 animations
- https://twitter.com/8Infinite8/status/1694326628015317017
- https://twitter.com/8Infinite8/status/1699115951436829133
- https://twitter.com/CoffeeVectors/status/1699102928294851062
- https://www.youtube.com/watch?v=c0VNckM21B0
- https://www.youtube.com/@gradeeterna
- https://twitter.com/CoffeeVectors/status/1698392529677295864
- https://twitter.com/dgfigueiredo/status/1696327546005045488
- https://www.youtube.com/watch?v=kShNYOuDnlI
- https://www.youtube.com/watch?v=xgwvU7S0K-k
- https://www.youtube.com/watch?v=uET9y_qzyZg Dark scenes
- EWA Splatting
- https://huggingface.co/papers/2311.08581 Drivable 3D Gaussian Avatars (animation using cage transform)
- https://gsgen3d.github.io/ text-to-3D
- https://dreamgaussian.github.io/ text-to-3D and 3DGS to mesh
- https://dynamic3dgaussians.github.io/
- https://youtu.be/jV1g5OY0L5s?t=1484 style transfer
- https://aras-p.info/blog/2023/09/13/Making-Gaussian-Splats-smaller/ compression
- https://twitter.com/charshenton/status/1702856280598278454 (some unspecified speed optimization)
- https://www.youtube.com/watch?v=1CjRivlvZo8 (Scanning time)
- https://kaba.hilvi.org/homepage/cg/ewa/Enhanced_Ewa.pdf (Splatting quality [already implemented?])
- https://iquilezles.org/articles/volumesort/ (Point cloud sorting)
- https://www.ppsloan.org/publications/StupidSH36.pdf (some common SH tricks)
- https://arxiv.org/pdf/2202.01284.pdf (implement variation using drjit)
- https://replit.com/bounties/@aperture6/c-and-metal-port-of (Apple Metal port bounty)
- https://math.stackexchange.com/questions/2422620/bounding-plane-and-projective-occlusion-of-cone-and-ellipsoid-intersection (thoughts on ellipsoid rendering by paniq)
- https://www.shadertoy.com/view/Nl2Szm ("Ellipsoid Projection" implementation by oneshade)
- Molecule Media DREAMS
- https://twitter.com/the_ross_man/status/1704331583786778895 Discussion about splat rendering
- https://github.com/colmap/colmap
- https://github.com/openMVG/openMVG/wiki/OpenMVG-on-your-image-dataset (supports 360 images?)
- https://github.com/ReshotAI/gaussian-painters 2D and Steganography
- https://www.youtube.com/watch?v=Sxy7tcRZh-8
- https://www.youtube.com/watch?v=9pWKnyw74LY on splat editing / selective visualization
- https://www.youtube.com/watch?v=4MPb9JG9QW0
- https://www.youtube.com/watch?v=0STU2vWl8tM
- https://www.youtube.com/watch?v=T_kXY43VZnk
- https://www.youtube.com/watch?v=HVv_IQKlafQ
- https://www.reshot.ai/3d-gaussian-splatting
- https://aras-p.info/blog/2023/09/05/Gaussian-Splatting-is-pretty-cool/
- https://www.youtube.com/watch?v=w43KV79LsFw
- https://www.youtube.com/watch?v=7WuKq1WfIL0
- https://www.youtube.com/watch?v=TLK3TDDcJFU
- https://twitter.com/alexcarliera/status/1699096373814079548 about SH usage
- https://xi.zulipchat.com/#narrow/stream/197075-gpu/topic/Gaussian.20splatting by Raph Levien
- https://www.youtube.com/watch?v=jV1g5OY0L5s
- Requires CUDA
- Debug renderers can be ran on macOS with unreleased code changes (@JayFoxRox)
- Partial splatting support with chipstar with unreleased code changes (@JayFoxRox)
https://github.com/graphdeco-inria/gaussian-splatting
- Fork for easier usage on Windows: https://github.com/jonstephens85/gaussian-splatting-Windows
https://github.com/aras-p/UnityGaussianSplatting
- Requires Unity (closed-source)
https://github.com/ReshotAI/gaussian-splatting-blender-addon
https://twitter.com/alexcarliera/status/1698769174950985787
Tutorial by third party: https://www.youtube.com/watch?v=yKz7OfomyCo&t=0s
- Requires Blender (open-source)
https://github.com/antimatter15/splat
https://github.com/kishimisu/Gaussian-Splatting-WebGL
https://github.com/cvlab-epfl/gaussian-splatting-web
- Demo: https://tellusim.com/demos/gaussians/main.html
- Code: https://github.com/Tellusim/Manual/tree/main/07_hello_splatting
- Article: https://tellusim.com/07_hello_splatting/
https://github.com/WangFeng18/3d-gaussian-splatting
https://github.com/heheyas/gaussian_splatting_3d
https://github.com/MrNeRF/gaussian-splatting-cuda
https://github.com/wanmeihuali/taichi_3d_gaussian_splatting
- Requires CUDA (Windows, Linux?)
- Alternatively Vulkan + CPU (macOS)
https://twitter.com/LumaLabsAI/status/1709312751938699488
https://gsplat.tech/ https://www.youtube.com/watch?v=oeJbalGBVzw&pp=ygUYcGFwZXIgcmV2aWV3IDNkIGdhdXNzaWFu
- Does some form of compression
https://github.com/laanlabs/metal-splats https://twitter.com/laanlabs/status/1704939447521845398
https://www.unrealengine.com/marketplace/en-US/product/3d-gaussians-plugin https://twitter.com/Akiya_Souken_VR/status/1705051032265412720
https://lumaai.notion.site/Luma-Unreal-Engine-Plugin-0-4-8005919d93444c008982346185e933a1
https://github.com/clarte53/GaussianSplattingVRViewerUnity
https://github.com/mosure/bevy-gaussian-splatting
https://poly.cam/gaussian-splatting
https://github.com/quadjr/aframe-gaussian-splatting
https://github.com/mkkellogg/GaussianSplats3D
https://github.com/keijiro/SplatVFX https://twitter.com/_kzr/status/1713463270189961530
- Requires Unity
Not sure what this actually is, but some tweets claim this is using Gaussian Splatting: https://twitter.com/Simulon
https://twitter.com/charshenton/status/1704358063036375548
- https://grgkopanas.github.io/ Author of original paper and some follow-up research