Uploaded April 2016 | Updated September 2026, 6 hours ago
This talk was given by undergraduate Scott Loftin during the 10th Annual Computer Science Undergraduate Research Symposium in 2016. Scott‘s research was supervised by Dr. Dinesh Manocha.
“Acoustic Material Classification for Sound Propagation”
We present a novel algorithm to generate virtual acoustic effects in captured 3D models of real-world scenes for multimodal augmented reality. Our approach leverages recent advances in 3D scene reconstruction and presents algorithms to automatically compute acoustic material properties. Our technique applies convolutional neural networks to estimate the acoustic material properties, including frequency-dependent absorption coefficients, that are used for interactive sound propagation. An iterative optimization algorithm is used to adjust the materials until a virtual acoustic simulation converges to measured acoustic samples. We have applied the sound propagation and rendering algorithm to many reconstructed real-world indoor scenes and evaluated its performance for augmented reality applications.
Scott Loftin is a senior majoring in computer science and physics. He has spent the past few months working with graduate student Carl Schissler and Dr. Dinesh Manocha on acoustic scene capture for virtual and augmented reality audio.
This talk was given by undergraduate Scott Loftin during the 10th Annual Computer Science Undergraduate Research Symposium in 2016. Scott‘s research was supervised by Dr. Dinesh Manocha.
“Acoustic Material Classification for Sound Propagation”
We present a novel algorithm to generate virtual acoustic effects in captured 3D models of real-world scenes for multimodal augmented reality. Our approach leverages recent advances in 3D scene reconstruction and presents algorithms to automatically compute acoustic material properties. Our technique applies convolutional neural networks to estimate the acoustic material properties, including frequency-dependent absorption coefficients, that are used for interactive sound propagation. An iterative optimization algorithm is used to adjust the materials until a virtual acoustic simulation converges to measured acoustic samples. We have applied the sound propagation and rendering algorithm to many reconstructed real-world indoor scenes and evaluated its performance for augmented reality applications.
Scott Loftin is a senior majoring in computer science and physics. He has spent the past few months working with graduate student Carl Schissler and Dr. Dinesh Manocha on acoustic scene capture for virtual and augmented reality audio.
