USC ICT
Virtual Reality Augmentation of Social Skills Training for Autism Demo
updated
Thank you to Dhairya Parmar and Andrew Leeds for today's image capture, & Mason Stocking, United States Military Academy (ICT) Cadet and Taylor Driver, United States Military Academy (ICT) Cadet for agreeing to be immortalized as digital #avatars by our team.
Learn more about USC ICT at http://ict.usc.edu
Learn more about USC ICT at http://ict.usc.edu
Learn more about USC ICT at http://ict.usc.edu
Learn more about USC ICT at http://ict.usc.edu
Learn more about USC ICT at http://ict.usc.edu
Learn more about USC ICT at http://ict.usc.edu
RIDE combines a range of commonly used simulation features in a drag-and-drop development environment, including One World Terrain, NPC and vehicle placement, and AI behaviors.
RIDE is being developed at the USC Institute for Creative Technologies (ICT), a non-profit University Affiliated Research Center. RIDE has been made possible by funding from the Army Cross Functional Teams (CFT) and the Office of Naval Research (ONR).
https://ride.ict.usc.edu
http://ict.usc.edu
Promo directed/edited by @anthonydecapite959
Learn more about the Battle Buddy project at https://ict.usc.edu/research/projects...
Learn more about USC ICT at http://ict.usc.edu
Find out more at ride.ict.usc.edu
Music by Lumen Media - audiojungle.net/user/lumenmedia
Find out more at ride.ict.usc.edu
Music by Lumen Media - audiojungle.net/user/lumenmedia
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
USC ICT has a well-recognized history of pioneering research into the creation of high fidelity digital doubles and interactive, embodied conversational agent (AKA virtual humans). Researchers and developers can combine this foundation of knowledge with the cutting edge fields of data analytics, body computing, graphics, and AI to find the way forward.
0:44 - Studies in this field have shown avatars increasing engagement, immersion, and realism. The study shown in the video showed an increased in engagement by users using an avatar. That study, The Effect Of Operating A Virtual Doppelganger In A 3d Simulation, can be found here:
dl.acm.org/doi/10.1145/2994258.2994263
3:19 - This study, Analyzing the Effect of Avatar Self-Similarity on Men and Women in a Search and Rescue Game, can be found here:
dl.acm.org/doi/10.1145/3173574.3174059
Learn more about USC ICT at http://ict.usc.edu
USC ICT's Rapid Integration and Development Environment (RIDE) supports the STE by allowing designers and engineers across the DoD to research and develop TSS and TMT features in a neutral environment dedicated to military training Science & Technology.
Learn more about RIDE at https://ride.ict.usc.edu/
Semi-supervised learning is a machine learning technique that leverages small amounts of manually labeled data to make sense of patterns in unlabeled data which is generally available in larger quantities. Semi-supervised learning incorporated into the SLATS system will be used to assess team quality. Instructors will be provided actionable insights such as overall analysis, common errors and tasks that require additional training.
Learn more about USC ICT at http://ict.usc.edu
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
This AI research effort leverages decades of work in cognitive architectures, probabilistic graphical models, and neural networks. The goal is to create autonomous synthetic characters that will be functionally indistinguishable from real humans. This will make the Army's synthetic training simulations more challenging and less dependent on human participants.
This research has been integrated with the Rapid Integration and Development Environment (RIDE), which supports simulation development across the DoD.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
RIDE combines and integrates – into a single simulation framework – the following unique capabilities created through ICT research and development: One World Terrain (OWT) data and tools; generative programming; networking; machine learning (ML) tools; speech recognition; natural language processing; character AI behaviors; and scenario event development.
For more information, including how to obtain RIDE, visit https://ride.ict.usc.edu
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
The Narrative Summarization AI converts these interpretations into English-language narratives for use in After Action Review.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
This video is a first look at AI research for the STE, depicting three of the myriad efforts on this front.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
Learn more about VT Mak and the STE here: mak.com/ste
Their paper, "Fully Automated Photogrammetric Data Segmentation and Object Information Extraction Approach for Creating Simulation Terrain" presents the development of automated techniques for attributing features to images and 3D data collected by aircraft.
Read the paper here: researchgate.net/publication/338557943_Fully_Automated_Photogrammetric_Data_Segmentation_and_Object_Information_Extraction_Approach_for_Creating_Simulation_Terrain
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
Score by Nikitsan Music: audiojungle.net/user/nikitsan
The Synthetic Training Environment (STE) will provide immersive and intuitive capabilities that keep pace with a changing operational environment, giving Commanders the ability to overcome today’s limitations and take on the challenges of tomorrow.
The STE will leverage advancements in virtual reality, big data analysis, artificial intelligence, reconfigurable virtual collective trainers, and terrain representation to make this possible.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
At its core is the the Training Simulation Software, a centralized runtime engine for simulation and training, powering all the components, middleware, and peripherals that will provide the end-user with realistic and immersive military training.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
At its core is the the Training Simulation Software, a centralized runtime engine for simulation and training, powering all the components, middleware, and peripherals that will provide the end-user with realistic and immersive military training.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
This video dives into the ways OWT research supports not just training, but operations.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more at http://ict.usc.edu/groups/modeling-simulation/
One World Terrain helps power the STE as a key research pillar and the geospatial foundation of the synthetic environment.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
This video was featured at the 2019 LANPAC Symposium & Exposition.
Originally presented at the Motion in Games 2011 conference in Edinburgh, Scotland.
For more information about the project you can access the Character Animation and Simulation project page: http://cas.ict.usc.edu/projects/
Visit ICT on YouTube:
youtube.com/user/USCICT
About:
USC ICT develops award-winning advanced immersive experiences that leverage groundbreaking research technologies and the art of entertainment to simulate human capabilities. Influencing the trajectory of technological exploration and advancement, USC ICT’s mission is to use basic and applied research that benefits learning, education, health, human performance, and knowledge.
Fight On!
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
CONNECT WITH USC ICT:
Web: http://ict.usc.edu
Twitter: http://twitter.com/usc_ict
Facebook: http://www.facebook.com/USCICT
Instagram: http://instagram.com/usc__ict
The 3D terrain pipeline leverages source data collected and managed organically by units, and feature attribution research allows 3D models captured by non-experts to have attributed roads navigable by simulated personnel and vehicles. This same information can also be used for geospatial intelligence analysis and other operational tasks.
This video is an in-depth dive into this research and its utility for military decision-makers.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more at http://ict.usc.edu/groups/modeling-simulation/
The 3D terrain pipeline leverages source data collected and managed organically by units, and feature attribution research allows 3D models captured by non-experts to have attributed roads navigable by simulated personnel and vehicles. This same information can also be used for geospatial intelligence analysis and other operational tasks.
This video is a brief introduction to this research and its utility for military decision-makers.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more at http://ict.usc.edu/groups/modeling-simulation/
Breathing creates sound (breath intakes and exhalations) as well as causes changes to the cadence of speech, head movements (tilt of head to allow air to enter lungs), and facial changes related to breathing such as nose flaring and mouth opening. Breathing might also indicate the health or state of the virtual human (asthma, recently exerted themselves, etc.)
The model includes:
thorax and abdomen volume, mouse versus nose breathing and amount, balance between thorax vs stomach breathing, speaking loudness, and other factors.
We also performed a study using real voice and TTS voices to determine if breathing sounds and movements have any effect on the the perception of the viewer. Did the speech appear to be more real with breathing sounds and/or movements?
Paper presented at Virtual Humans and Crowds in Immersive Environments (VHCIE) that takes place at the 26th IEEE Conference on Virtual Reality and 3D User Interfaces:
Ulysses Bernadette, Sin-hwa Kang, Andrew Feng, Steve DiPaola and Ari Shapiro; Speech Breathing in Virtual Humans: An Interactive Model and Empirical Study , Proceedings of the The Fourth IEEE VR Workshop on Virtual Humans and Crowds in Immersive Environments, March 2019, Osaka, Japan.
Research was sponsored by the Army Research Office and was accomplished under Cooperative Agreement Number W911NF-20-2-0053. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Army Research Office or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein.
Learn more about USC ICT at http://ict.usc.edu
Paper presented at the GRAPP 2019 conference in Prague:
Andrea Bˆnsch, Andrew Feng, Parth Patel and Ari Shapiro; Volumetric Video Capture Using Unsynchronized, Low-Cost Cameras , Proceedings of the 14th International Conference on Computer Graphics Theory and Applications, February 2019
Research was sponsored by the Army Research Office and was accomplished under Cooperative Agreement Number W911NF-20-2-0053. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Army Research Office or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein.
This project is a collaboration between ICT, Arizona State University and the University of Memphis, and is funded by the Office of Naval Research.
Visit ICT on YouTube:
youtube.com/user/USCICT
About:
USC ICT develops award-winning advanced immersive experiences that leverage groundbreaking research technologies and the art of entertainment to simulate human capabilities. Influencing the trajectory of technological exploration and advancement, USC ICT’s mission is to use basic and applied research that benefits learning, education, health, human performance, and knowledge.
Fight On!
This work is sponsored by the Office of Naval Research. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
CONNECT WITH USC ICT:
Web: http://ict.usc.edu
Twitter: http://twitter.com/usc_ict
Facebook: http://www.facebook.com/USCICT
Instagram: http://instagram.com/usc__ict
The STE will leverage advancements in virtual reality, big data analysis, artificial intelligence, and terrain representation to make this possible.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
Visit ICT on YouTube:
youtube.com/user/USCICT
About:
USC ICT develops award-winning advanced immersive experiences that leverage groundbreaking research technologies and the art of entertainment to simulate human capabilities. Influencing the trajectory of technological exploration and advancement, USC ICT’s mission is to use basic and applied research that benefits learning, education, health, human performance, and knowledge.
Fight On!
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
CONNECT WITH USC ICT:
Web: http://ict.usc.edu
Twitter: http://twitter.com/usc_ict
Facebook: http://www.facebook.com/USCICT
Instagram: http://instagram.com/usc__ict
LinkedIn: linkedin.com/company/usc-institute-for-creative-technologies
Pitch us your ideas for how AI will transform Multi-Domain Operations:
futures.armyscitech.com/2018/11/07/aimdb2018
Check out ICT on YouTube:
youtube.com/user/USCICT
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
For more information about the exhibit, visit:
ocfair.com/heroes-hall
To learn more about USC Institute for Creative Technologies, visit: https://ict.usc.edu
Learn more about the process: http://ict.usc.edu/prototypes/one-world-terrain-owt/
Visit ICT on YouTube:
youtube.com/user/USCICT
About:
Experience the University of Southern California like you've never before with this virtual flythrough video of the campus. The featured 3D model was created by researchers from the USC Institute for Creative Technologies using drones to develop a rapid terrain capture and reconstruction pipeline.
The pipeline allows non-experts to visualize digital representations of any area using commercial drones which can be useful for analysis, planning, training, interactive media, cultural heritage, and more.
Fight on!
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
This will be addressed by improved training.
Defense Secretary Mattis has said that our close combat fighters should fight "25 bloodless battles" before they ever face real combat. The S/SVT is designed to make this a reality, using synthetic environment immersion, the replication of complex environments, and tactical/psychological conditioning.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Classification, segmentation, and modelization are the processes that make 3D models simulation-ready. Find out how One World Terrain researchers are pushing these techniques forward in this video.
Learn more here: http://ict.usc.edu/prototypes/one-world-terrain-owt/
Check out more videos on modelization here: vimeo.com/gamesim
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Classification, segmentation, and modelization are the processes that make 3D models simulation-ready. Find out how One World Terrain researchers are pushing these techniques forward in this video.
Learn more here: http://ict.usc.edu/prototypes/one-world-terrain-owt/
Check out more videos on modelization here: vimeo.com/gamesim
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
The aircraft were flown autonomously using an ICT application, and the ICT remote pilots gave Marines from 10th Marine Regiment and 3rd Battalion, 2nd Marines hands-on training on the process.
The images captured will be ingested into photogrammetry software and turned into a high-detail 3D model useful in planning, training, and simulation tasks.
This work is sponsored by the Office of Naval Research. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
One World Terrain research is built on four important principles:
First, that the data and the terrain workflow should not be tied to any specific simulation or rendering technology. Platform-agnostic tools can reach a broader training audience.
The second principle: 3D data must be updatable no less than every month, because the boots on the ground need the most up-to-date reconstructions possible to support decision-making.
Third, applications resulting from the workflow need to be capable of simulating both virtual and constructive capabilities, and also support virtual and augmented reality. This maximizes their utility.
The fourth and final principle is that creation of data should be fully or mostly automated. Set-it-and-forget-it data creation makes tools more accessible.
Ultimately, One World Terrain research will enable Soldiers at different echelons with different requirements to experience a seamless, realistic geospatial foundation when executing their training.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
The CVIT Advanced Situational Awareness Course is an engaging experience that combines interactivity and entertaining multimedia to increase Soldiers' survivability in operational environments.
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements, expressed opinions, and content included do not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Learn more about USC ICT at http://ict.usc.edu
The work is from Character Animation and Simulation research group at the USC Institute for Creative Technologies, headed by Ari Shapiro. This project spearheaded by visiting scholar, Andrea Boensch, with advice from Andrew Jones.
Learn more about USC ICT at http://cas.ict.usc.edu & http://ict.usc.edu.
The Department of Homeland Security will use the photo-realistic reconstruction for infrastructure protection and planning tasks. With the model, decision-makers can identify vulnerable locations, locate optimal routes for security teams, or in cases of disaster response, determine where to emplace first responders and triage points. ICT’s ATLAS, the Aerial Terrain Line of sight Analysis System, allows users to visualize sight-lines and plan tactical movements on and around the reconstructed structure.
Learn more about USC ICT at http://ict.usc.edu.
The 3D reconstructions shown here were created with commercial, off the shelf unmanned aerial systems and photogrammetric software.
The aircraft were flown autonomously using an Android app built by ICT (RAPTRS). Thousands of high-resolution still photographs of the structure were collected by the drones.
Commercial photogrammetry software, in combination with classification algorithms developed at ICT, were used to reconstruct the structures in three dimensions and prepare the models for visualization and analysis, which takes place in ATLAS.
Bookmarks:
[0:10] Muscatatuck Dataset youtu.be/-spEV8dkuOY?t=10s
[0:53] Los Angeles Memorial Coliseum Dataset youtu.be/-spEV8dkuOY?t=53s
[1:46] University of Southern California Dataset youtu.be/-spEV8dkuOY?t=1m46s
[2:59] Catalina Island Dataset youtu.be/-spEV8dkuOY?t=2m59s
[4:32] University of Southern California Galen Center Dataset youtu.be/-spEV8dkuOY?t=4m32s
Learn more about USC ICT at http://ict.usc.edu.
The aircraft were flown autonomously using an ICT application to capture thousands of high-resolution still photographs of the structures. This collection, or “mapping” of the Coliseum took only 4 hours. Commercial photogrammetry software, in combination with classification algorithms developed at ICT, were used to reconstruct the structures in three dimensions and prepare the models for visualization and analysis.
ICT’s ATLAS, the Aerial Terrain Line of sight Analysis System, allows users to visualize sight-lines and plan tactical movements on and around the reconstructed structure.
Aerospace Corporation: youtube.com/use/AerospaceCorpVideos
Learn more about USC ICT:
http://ict.usc.edu.


