The sound component is still missing in
most Augmented Reality (AR) applications, which combine live
video and computer graphics to
produce real-time visual effects. AR could be a solution for many problems in sound delivery.
Augmented Sound Reality allows the user to place and move different sound sources in the real world. With AR technology, the user is equipped with see-through displays and a simple pen input device to place 3D sound sources in the real world. The different sound sources are represented by 3D objects on the head-mounted display. 3D sound can be directly integrated and tested in this AR environment. The user can directly manipulate the 3D sound sources and observe the results immediately. Another advantage of ASR is low cost. This system requires only a PC, a Web cam, and i-glasses.
Vision
Current AR applications do not allow direct manipulation of sound sources. ASR is the first prototype that
combines sound and graphics in an AR environment and offers a wide spectrum for further applications.
Especially in the authoring process for AR applications, it becomes difficult to place the sound sources using
traditional 2D/3D authoring tools. Now, authors can place 3D sound sources in real 3D space, and they
have a more intuitive experience of how the audio really sounds. In another application of this technology,
the user can place virtual furniture in a room. This application will be combined with ASR, so that the user
doesn't see the newly established room, but can hear how the radio or DVD player sounds.
Publications
ASR - Augmented Sound Reality, Dobler D., Haller M., Stampfl P.,
ACM SIGGRAPH 2002 Conference Abstracts and Applications, San Antonio Texas, pp. 148, 2002.
