In our latest project, we explored the potential of new technologies to enhance educational experiences. Specifically, we focused on Gaussian Splatting, an advanced 3D visualization technique that offers significant improvements over NeRF in terms of rendering speed and image quality. By using just a video of an object or space, we were able to create high-quality 3D models. To bring these models to life for educational purposes, we utilized Spline, a free 3D design tool that supports real-time collaboration, allowing for the creation of interactive web experiences directly in the browser.
Initial Capture
Our journey began at a theater, where we captured a video of a drum set using our smartphone. While the recommended approach suggests performing three loops around the object from different angles, we opted for additional loops to ensure comprehensive coverage of both details and the exterior.
Post-Processing
The captured video was imported into Postshot, developed by Jawset Visual Computing. Although still in beta, this software is currently available for free. Postshot is a dedicated desktop application designed for training your own 3D Gaussian and Neural Radiance Fields, boasting a simple installation process and a familiar workflow.
Testing and Optimization
During our experimentation phase, we tested other tools such as Polycam and Luma AI for creating Gaussian Splats. However, we found that Postshot yielded the most promising results. Once our Gaussian Splatting process was complete, we transferred the model to Super Splat on PlayCanvas, where we cleaned the splat and exported it as a .ply file.
Interactive Enhancements
This .ply file was then imported into Spline, where we added various interactions, sounds, and user interface elements. The end result of our efforts can be experienced below: https://my.spline.design/drumscopy-94370cf3b3daf7d48bcf49a3cf742fd0/
Credit: Maria Sanchez Isaza | Paolo Tosolini
In collaboration with the NW EDU Network
Last Updated April 29, 2024