TOUCH stands for Telehealth Outreach for Unified Community Health. The project team developed immersive virtual reality applications and created virtual worlds to enhance learning by allowing visualization and exploration of abstract concepts or virtual patients and simulations, along with collaborative virtual group interaction.
The virtual reality visualization environment "Flatland" has been implemented to be shared among dispersed sites with multiple participants. Flatland is an open source programme into which the virtual simulation can be programmed and rendered for visualization and interaction. Access Grid, a broadband Next Generation Internet videoconference multi-casting network serves to allow real-time distribution of the learning environments between academic medical centres and distant training sites. The project partners also introduced an experiential learning approach using realistic medical scenarios and associated models in the virtual environments to better understand complex concepts and translate them to real-world applications.
The Schools of Medicine in Hawaii and New Mexico, in collaboration with rural hospitals or clinics and two of their respective training sites, the Maui Community College Health Center and the Northern Navajo Medical Center, adopted high performance computing methods to enhance and deploy existing experiential learning curricula currently used in the medical education programmes.
Participating students, faculty tutors and rural preceptors can make use of virtual reality experiences, three dimensional volumetric image manipulation, and computer-generated simulations transmitted over the Internet Access Grid, using point-to-point or multi-casting connectivity, to improve learning and understanding of a variety of concepts relevant to a clinical case study. These methods can be evaluated interactively across sites and individually and asynchronously.
Experiential learning is able to promote medical student group involvement in the study of basic concepts and principles as they relate to a variety of clinical problems. Through this process, students begin to understand the relevance of important concepts to actual medical practice and problem solving. In order to enhance the experiential learning, create a greater sense of reality, and better comprehend relevant basic concepts, virtual reality and 3D graphical simulations are being integrated into study cases into which students can be fully immersed in order to achieve defined learning or training goals and objectives.
The immersed students or trainees wear a head-mounted display with trackers, which allows them to gain a sense of presence and interact within the virtual environment. Trainees can independently control their viewpoint and motion within the virtual world. Team members within the virtual environment are able to see each other as full human figures and interact as if they were physically present even when separated by significant distances. TOUCH also offers third person modes of communication using virtual remote cameras for broadcasting to remote audiences.
Participants can examine a virtual patient in order to discover pertinent signs and symptoms. The virtual reality patient is programmed to change dynamically over time and respond to the manipulations by the learner or the trainee. A joy-wand enabes the students to navigate, move and handle objects. If a critical error is made, the virtual patient respondes poorly or, even worse, expires.
The Flatland environment allows real-time exploration, examination, and manipulation of 3D objects and images within the virtual world. The ratio between real time and virtual time can be varied to allow slower or faster progress of events. The relative size of the participant to objects within the virtual worlds will be variable to allow visual extensions and experiences to larger environments at a population level or smaller microscopic environments at the cellular or molecular level.
An interactive patient simulation engine allows a new dimension in experiential learning, in which the students can dynamically determine the direction of the case scenario. The simulator is composed of three components:
- a real-time artificial intelligence (AI) simulation engine,
- a 3D virtual reality environment with human avatars, and
- a system for human-simulation interaction.