[ Technology ] | [ Papers ] | [ Get Involved ] | [ Home ]

Haptic Visualization

Scientific visualization is the representation of data in a form suitable for comprehension. Typically, this form is visual since vision is the highest bandwidth human sense. However, people who are blind or visually impaired must rely upon other senses to accomplish this perception. Haptic interface technology allows tangible realizations of data surfaces to be realized, providing an additional modality for data exploration and analysis. Unfortunately, the amount of information that can be perceived through touch is orders of magnitude less than that which can be perceived through vision. Consequently, multimodal techniques must be investigated that enhance the visualization environment and give the user control over the resolution of the visualization.

Current research focuses on multiresolution joint haptic-sonification techniques. Nonlinear multiresolution decomposition algorithms are being developed that reduce the resolution of the data while preserving important perceptual cues, such as discontinuities or edges. Preserving such cues is particularly important in a haptic environment. Environment enhancements under development include object properties such as friction and texture as well as their sonic counterparts. Textures, for instance, can be modeled as stochastic processes that are modulated by the underlying data. Thus both haptic and sonic textures can be used in an analogous fashion to color in graphical visualization methods. The data forms under consideration include 1D, 2D, and 3D mathematical functions or sampled sensor data that can be rendered using points, lines, surfaces, or vector fields. The final goal of this project is to develop methods that allow blind and visually impaired individuals to explore mathematical functions and data in a multimodal environment.

Download

Our MATLAB toolbox for creating haptic plots with the PHANToM is now available. The PHANToM is a haptic robot; it provides the user a haptic interface. Download it and give it a try. Any feedback is appreciated.

PC version: [ haptics.zip ] , [ readme file ]

Papers and Publications

1. J. P. Fritz, "Haptic Rendering Techniques for Scientific Visualization," MSEE Thesis, University of Delaware, 1996. postscript
2. J. P. Fritz and K. E. Barner, "Stochastic Models for Haptic Textures," Proceedings of Photonics East '96 - the SPIE's International Symposium on Intelligent Systems and Advanced Manufacturing, Boston, MA, November, 1996. postscript
3. J. P. Fritz and K. E. Barner, "Design of a Haptic Graphing System," Proceedings of the 19th RESNA Conference, Salt Lake City, UT, June, 1996. postscript
4. J. P. Fritz, T. P. Way, and K. E. Barner, "Haptic Representation of Scientific Data for Visually Impaired or Blind Persons," Proceedings of the Eleventh Annual Technology and Persons with Disabilities Conference, California State University, Northridge, Los Angeles, CA, April, 1996. postscript
5. J. P. Fritz and K. E. Barner, "Haptic Scientific Visualization," Proceedings of the PHANToM User's Group Workshop, Boston, MA, September, 1996.
6. M. Asghar and K. E. Barner, "Multiresolution Representation of Data in a Haptic Environment," Proceedings of Photonics East '96 - the SPIE's International Symposium on Intelligent Systems and Advanced Manufacturing, Boston, MA, November, 1998.
7. N. Grabowski and K. E. Barner, "Visualization Methods for the Blind Using Force Feedback and Sonification," Proceedings of Photonics East '96 - the SPIE's International Symposium on Intelligent Systems and Advanced Manufacturing, Boston, MA, November, 1998.
8. N. Grabowski, M. Asghar, and K. E. Barner, "Joint Haptic and Aural Methods for Data Visualization," Proceedings of the 21st RESNA Conference, Minneapolis, MI, June, 1998.

Staff

Prof. Kenneth Barner, Principle Investigator

Students

[ Nikolai Grabowski ]
[ Mohammad Asghar ]
Jason Fritz (graduated 1996)

Footage

Phantom - movie file of the phantom. MPEG
Computer Graph - phantom would haptically navigate. MPEG