Notes about gsplat / 3DGS: 3D Gaussian Splatting (~WIP)
I'm planning to turn this into an "awesome-gsplat" repository (https://github.com/sindresorhus/awesome) or a wiki on some repository.
Feel free to add comments to this gist for now.
I'm contiuining to update this, and will hopefully get to reformatting it with thumbnails and further information (especially on performance and capabilities of implementations).
- https://twitter.com/Ruben_Fro/status/1709844135279272290 3DGS with burning transition effect in Unity
- https://twitter.com/alexcarliera/status/1708466094892085492 Watch
- https://www.youtube.com/watch?v=l3XVSQs9cUc Indiana University Metz Carillon (demolished 2018; Photos from 2017)
- https://twitter.com/Alientrap/status/1707861115294585245 AR
- https://twitter.com/aras_p/status/1708056774597636243 compression (less than 8MB scene)
- https://twitter.com/AlexandreDevaux/status/1707365670596284857 Face
- https://twitter.com/diveshnaidoo/status/1693665169786782123 AR (might not be 3DGS)
- https://www.youtube.com/@historyphotogrammetry2218/videos Sculptures
- https://www.youtube.com/watch?v=KriGDLvGDZI 3D models to GS (Note: using COLMAP and other non-ideal steps)
- https://twitter.com/Aster_NeRF/status/1702704845806047270
- https://twitter.com/DrewMedina20/status/1705357414000701801 Various
- https://twitter.com/bilawalsidhu/status/1705687796638159233 painted ladies SF
- https://twitter.com/s1ddok/status/1704931093466481125 VR person
- https://twitter.com/8Infinite8/status/1704488729509761065 Person lit/captured with HDR background
- https://twitter.com/DSkaale/status/1702944308087730263
- https://www.youtube.com/watch?v=aJFoPmjPH-M
- https://twitter.com/8Infinite8/status/1699463085604397522 animations
- https://twitter.com/8Infinite8/status/1694326628015317017
- https://twitter.com/8Infinite8/status/1699115951436829133
- https://twitter.com/CoffeeVectors/status/1699102928294851062
- https://www.youtube.com/watch?v=c0VNckM21B0
- https://www.youtube.com/@gradeeterna
- https://twitter.com/CoffeeVectors/status/1698392529677295864
- https://twitter.com/dgfigueiredo/status/1696327546005045488
- https://www.youtube.com/watch?v=kShNYOuDnlI
- https://www.youtube.com/watch?v=xgwvU7S0K-k
- https://www.youtube.com/watch?v=uET9y_qzyZg Dark scenes
- EWA Splatting
- https://gsgen3d.github.io/ text-to-3D
- https://dreamgaussian.github.io/ text-to-3D and 3DGS to mesh
- https://dynamic3dgaussians.github.io/
- https://youtu.be/jV1g5OY0L5s?t=1484 style transfer
- https://aras-p.info/blog/2023/09/13/Making-Gaussian-Splats-smaller/ compression
- https://twitter.com/charshenton/status/1702856280598278454 (some unspecified speed optimization)
- https://www.youtube.com/watch?v=1CjRivlvZo8 (Scanning time)
- https://kaba.hilvi.org/homepage/cg/ewa/Enhanced_Ewa.pdf (Splatting quality [already implemented?])
- https://iquilezles.org/articles/volumesort/ (Point cloud sorting)
- https://www.ppsloan.org/publications/StupidSH36.pdf (some common SH tricks)
- https://arxiv.org/pdf/2202.01284.pdf (implement variation using drjit)
- https://replit.com/bounties/@aperture6/c-and-metal-port-of (Apple Metal port bounty)
- https://math.stackexchange.com/questions/2422620/bounding-plane-and-projective-occlusion-of-cone-and-ellipsoid-intersection (thoughts on ellipsoid rendering by paniq)
- https://www.shadertoy.com/view/Nl2Szm ("Ellipsoid Projection" implementation by oneshade)
- Molecule Media DREAMS
- https://twitter.com/the_ross_man/status/1704331583786778895 Discussion about splat rendering
- https://github.com/colmap/colmap
- https://github.com/openMVG/openMVG/wiki/OpenMVG-on-your-image-dataset (supports 360 images?)
- https://github.com/ReshotAI/gaussian-painters 2D and Steganography
- https://www.youtube.com/watch?v=4MPb9JG9QW0
- https://www.youtube.com/watch?v=0STU2vWl8tM
- https://www.youtube.com/watch?v=T_kXY43VZnk
- https://www.youtube.com/watch?v=HVv_IQKlafQ
- https://www.reshot.ai/3d-gaussian-splatting
- https://aras-p.info/blog/2023/09/05/Gaussian-Splatting-is-pretty-cool/
- https://www.youtube.com/watch?v=w43KV79LsFw
- https://www.youtube.com/watch?v=7WuKq1WfIL0
- https://www.youtube.com/watch?v=TLK3TDDcJFU
- https://twitter.com/alexcarliera/status/1699096373814079548 about SH usage
- https://xi.zulipchat.com/#narrow/stream/197075-gpu/topic/Gaussian.20splatting by Raph Levien
- https://www.youtube.com/watch?v=jV1g5OY0L5s
- Requires CUDA
- Debug renderers can be ran on macOS with unreleased code changes (@JayFoxRox)
- Partial splatting support with chipstar with unreleased code changes (@JayFoxRox)
https://github.com/graphdeco-inria/gaussian-splatting
- Fork for easier usage on Windows: https://github.com/jonstephens85/gaussian-splatting-Windows
https://github.com/antimatter15/splat
https://github.com/WangFeng18/3d-gaussian-splatting
https://github.com/heheyas/gaussian_splatting_3d
https://github.com/MrNeRF/gaussian-splatting-cuda
https://github.com/aras-p/UnityGaussianSplatting
- Requires Unity
https://github.com/cvlab-epfl/gaussian-splatting-web
https://github.com/wanmeihuali/taichi_3d_gaussian_splatting
- Requires CUDA (Windows, Linux?)
- Alternatively Vulkan + CPU (macOS)
- Demo: https://tellusim.com/demos/gaussians/main.html
- Code: https://github.com/Tellusim/Manual/tree/main/07_hello_splatting
- Article: https://tellusim.com/07_hello_splatting/
https://twitter.com/LumaLabsAI/status/1709312751938699488
https://gsplat.tech/ https://www.youtube.com/watch?v=oeJbalGBVzw&pp=ygUYcGFwZXIgcmV2aWV3IDNkIGdhdXNzaWFu
- Does some form of compression
https://github.com/laanlabs/metal-splats https://twitter.com/laanlabs/status/1704939447521845398
https://twitter.com/Akiya_Souken_VR/status/1705051032265412720 https://www.unrealengine.com/marketplace/en-US/product/410c8105b3aa41d38ab68660295bd7f3
https://github.com/clarte53/GaussianSplattingVRViewerUnity
https://github.com/mosure/bevy-gaussian-splatting
https://poly.cam/gaussian-splatting
Not sure what this actually is, but some tweets claim this is using Gaussian Splatting: https://twitter.com/Simulon
https://twitter.com/charshenton/status/1704358063036375548
https://twitter.com/alexcarliera/status/1698769174950985787
- https://grgkopanas.github.io/ Author of original paper and some follow-up research