Abstract
Novel shape-changing interfaces promise to provide a rich haptic experience for human-computer interaction. As a specific instance of shape-changing interfaces, Elastic Displays provide large interaction surfaces that can be temporally deformed using force-touch. The unique property of these displays is that they automatically return to their initial flat state. Recently, several review and position papers have stimulated a discussion towards consolidating the knowledge about shape-changing interfaces. The knowledge about Elastic Displays is similarly scattered across multiple publications from recent years. This paper contributes a task taxonomy based on productive uses of Elastic Displays found in literature, on the web, and in our interaction lab. This taxonomy emphasizes tasks, but also encompasses general aspects regarding content types, visualization technology, and interaction styles. All aspects of the taxonomy are illustrated using case studies from literature.
About the authors
Dietrich Kammer is a postdoctoral researcher at Technische Universität Dresden, affiliated with the Chair of Media Design. His research is focused on the formalization of gestural input, especially with regards to multitouch technology. Further areas of research are semiotics in HCI, computer graphics, and information visualization.
Mathias Müller is researcher at Technische Universität Dresden, at the Chair of Media Design. His research is focused on virtual, mixed, and augmented reality, data visualization, and HCI. He has many years of experience in the research of interaction and visualization technologies, including elastic displays and head-mounted displays.
Jan Wojdziak is a postdoctoral researcher at Technische Universität Dresden in Germany as well as co-founder and chief of operations (COO) at GTV – Gesellschaft für Technische Visualistik mbH. His research interests include applied visualistic and interaction design in the range of three-dimensional computer graphics.
Ingmar S. Franke is a graduate in Architecture at the University of Applied Sciences Magdeburg as well as in Computational Visualistics at the Institute Simulation and Computer Graphics at Otto-von-Guericke University. Later he worked as a research assistant at Fraunhofer-Gesellschaft, Institute for Factory Planning and Factory Automation. He teaches at the Chair of Media Design at Department of Computer Science, Technische Universität Dresden, where he also obtained his doctorate. His research interests are in Gestaltung and User Interfaces. He is co-founder and Managing Director of company Technische Visualistik.
Acknowledgment
Many colleagues and students have supported our research about Elastic Displays over the last years: Thomas Gründer, Joshua Peschke, Fabian Göbel, Mandy Keck, Anja Knöfel, Natalie Hube, Erik Lier, Oliver Lenz, Alexander Dick, Albert Steinmetz, Duc Nguyen, Robert Richter, and Rainer Groh.
References
[1] Alexander, J., Roudaut, A., Steimle, J., Hornbæk, K., Alonso, M. B., Follmer, S. and Merritt, T. 2018. Grand Challenges in Shape-Changing Interface Research. In Proc. CHI ’18. ACM, New York, NY, USA, Paper 299, 14 pages. DOI: 10.1145/3173574.3173873.Search in Google Scholar
[2] Agarawala, A. & Balakrishnan, R. 2006. Keepin’ it real: Pushing the desktop metaphor with physics, piles and the pen. In Proceedings of the sigchi conference on human factors in computing systems (pp. 1283–1292). CHI ’06. Montreal, Quebec, Canada: ACM, DOI: 10.1145/1124772.1124965.Search in Google Scholar
[3] Cassinelli, A. and Ishikawa, M. 2005. Khronos projector. ACM SIGGRAPH 2005 Emerging technologies (New York, NY, USA).10.1145/1187297.1187308Search in Google Scholar
[4] Dand, D., and Hemsley, R. 2013. Obake: interactions on a 2.5D elastic display. In Proc. UIST ’13 Adjunct. ACM, New York, NY, USA, 109–110. DOI: 10.1145/2508468.2514734.Search in Google Scholar
[5] Follmer, S., Leithinger, D., Olwal, A., Hogge, A. and Ishii, H. 2013. inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. In Proc. UIST ’13. ACM, New York, NY, USA, 417-–426. DOI: 10.1145/2501988.2502032.Search in Google Scholar
[6] Franke, I. S., Müller, M., Gründer, T., Groh, R. 2014. FlexiWall: Interaction in-between 2D and 3D Interfaces. In Proc. HCII 2014, Springer, Berlin.10.1007/978-3-319-07857-1_73Search in Google Scholar
[7] Hilsing, S. 2010. impress - a flexible display, final documentation. http://www.silkehilsing.de/impress/blog/?cat=5.Search in Google Scholar
[8] Leithinger, D., & Ishii, H. 2010. Relief: a scalable actuated shape display. In Proc. TEI 2011, ACM Press, New York, S. 221.Search in Google Scholar
[9] Gründer, T., Kammer, D., Brade, M., & Groh, R. 2013. Towards a design space for elastic displays. In Acm sigchi conference on human factors in computing systems - workshop: Displays take new shape: An agenda for future interactive surfaces. Paris – France.Search in Google Scholar
[10] Humanware. Braille-Display. URL: http://www.humanware.com/en-usa/products/blindness/braille_displays.Search in Google Scholar
[11] Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., & Zigelbaum, J. 2008. Reality-based interaction: A framework for post-wimp interfaces. In Proceedings of the sigchi conference on human factors in computing systems (pp. 201–210). CHI ’08. Florence, Italy: ACM. DOI: 10.1145/1357054.1357089.Search in Google Scholar
[12] Jansen, Y., Karrer, T. and Borchers, J. 2011. MudPad: tactile feedback for touch surfaces. In Proc. of Extended Abstracts at CHI’11 (New York, NY, USA), 323–328.Search in Google Scholar
[13] Kammer, D., Keck, M., Müller, M., Gründer, T., Groh, R. 2017. Exploring Big Data Landscapes with Elastic Displays. In: Burghardt, M., Wimmer, R., Wolff, C. & Womser-Hacker, C. (Hrsg.), Mensch und Computer 2017 – Workshopband. Gesellschaft für Informatik e.V., Regensburg.10.1145/3206505.3206556Search in Google Scholar
[14] Khalilbeigi, M., Lissermann, R., Kleine, W. and Steimle, J. 2012. FoldMe: interacting with double-sided foldable displays. In Proc. of the TEI’12 (New York, NY ,USA), 33–40.Search in Google Scholar
[15] Khalilbeigi, M., Lissermann, R., Mühlhäuser, M. and Steimle, J. 2011. Xpaaand: interaction techniques for rollable displays. In Proc. of CHI’11 (New York, NY, USA), 2729–2732.Search in Google Scholar
[16] Kingsley, P., Rossiter, J. and Subramanian, S. 2012. eTable: A Haptic Elastic Table for 3D Multi-touch Interactions, University of Bristol. https://youtu.be/v2A4bLSiX6A.Search in Google Scholar
[17] Kyungwon Yun, JunBong Song, Keehong Youn, Sungmin Cho, and Hyunwoo Bang. 2013. ElaScreen: exploring multi-dimensional data using elastic screen. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). ACM, New York, NY, USA, 1311–1316. DOI: 10.1145/2468356.2468590.Search in Google Scholar
[18] Müller, M., Gründer, T., & Groh, R. 2015. Data exploration on elastic displays using physical metaphors. In Proceedings xcoax 2015.Search in Google Scholar
[19] Peschke, J., Göbel, F., Gründer, T., Keck, M., Kammer, D., & Groh, R. 2012. Depthtouch: An elastic surface for tangible computing. In Proceedings of the international working conference on advanced visual interfaces (pp. 770–771). AVI ’12. Capri Island, Italy: ACM. DOI: 10.1145/2254556.2254706.Search in Google Scholar
[20] Poupyrev, I., T. Nashida, S. Maruyama, J. Rekimoto, and Y. Yamaji. 2004. Lumen: Interactive visual and shape display for calm computing. In Proc. SIGGRAPH 2004 Conference Abstracts and Applications, Emerging Technologies, ACM Press.10.1145/1186155.1186173Search in Google Scholar
[21] Riedenklau, E., Hermann, T., & Ritter, H. 2012. An integrated multi-modal actuated tangible user interface for distributed collaborative planning. In Proc. TEI 2012. ACM Press, S. 169–174.Search in Google Scholar
[22] Sahoo, D. R., Hornbæk, K. and Subramanian, S. 2016. TableHop: An Actuated Fabric Display Using Transparent Electrodes. In Proc. CHI ’16. ACM, New York, NY, USA, 3767–3780. DOI: 10.1145/2858036.2858544.Search in Google Scholar
[23] Sato, T., Mamiya, H., Koike, H. and Fukuchi, K. 2009. PhotoelasticTouch. In Proc. of UIST ’09 (New York, NY, USA), 43–50.10.1145/1622176.1622185Search in Google Scholar
[24] Sato, T., Takahashi, N., Matoba, Y. and Koike, H. 2012. Interactive surface that have dynamic softness control. In Proc. of AVI’12 (New York, NY, USA), 796–797.Search in Google Scholar
[25] Sinclair, M., Pahud, M., & Benko, H. 2014. TouchMover 2.0 - 3D touchscreen with force feedback and haptic texture. In Proc. HAPTICS 2014, IEEE, S. 1–6.Search in Google Scholar
[26] Stevenson, A., Perez, C., and Vertegaal, R. 2010. An inflatable hemispherical multi-touch display. In Proc. TEI 2010, ACM Press, 289–292.Search in Google Scholar
[27] Troiano, G. M., Pedersen, E. W., & Hornbæk, K. 2014. User-defined gestures for elastic, deformable displays. In Proceedings of the 2014 international working conference on advanced visual interfaces (pp. 1–8). AVI ’14. Como, Italy: ACM. DOI: 10.1145/2598153.2598184.Search in Google Scholar
[28] Vlack, K., Mizota, T., Kawakami, N., Kamiyama, K., Kajimoto, H., & Tachi, S. 2005. GelForce: a vision-based traction field computer interface. In Ext. Abstracts CHI 2005, New York: ACM, S. 1154–1155.Search in Google Scholar
[29] Watanabe, Y., Cassinelli, A., Komuro, T., and Ishikawa, M. 2008. The deformable workspace: A membrane between real and virtual space, In Proc 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.10.1109/TABLETOP.2008.4660197Search in Google Scholar
[30] Müller, M., Knöfel, A., Gründer, T., Franke, I. S., & Groh, R. 2014. Flexiwall: Exploring layered data with elastic displays. In Proceedings its 2014, november 16.–19., Germany.10.1145/2669485.2669529Search in Google Scholar
[31] Müller, M., Keck, M., Gründer, T., Hube, N., Groh, R. 2017. A Zoomable Product Browser for Elastic Displays. In: 5th Conference on Computation, Communication, Aesthetics & X, Proceedings xCoAx 2017, S. 1–10.Search in Google Scholar
[32] Sturdee, M., Alexander, J. 2018. Analysis and Classification of Shape-Changing Interfaces for Design and Application-based Research. ACM Comput. Surv. 51, 1, Article 2 (January 2018), 32 pages. DOI: 10.1145/3143559.Search in Google Scholar
[33] Rasmussen, M. K., Pedersen, E. W., Petersen, M. G., Hornbæk, K. 2012. Shape-changing interfaces: a review of the design space and open research questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). ACM, New York, NY, USA, 735–744. DOI: 10.1145/2207676.2207781.Search in Google Scholar
[34] Vertegaal, R. & Poupyrev, I. 2008. Introduction – Organic user interfaces. Commun. ACM 51, 6 (June 2008), 26–30. DOI: 10.1145/1349026.1349033.Search in Google Scholar
[35] Shaer, O. & Hornecker, E. 2010. Tangible User Interfaces: Past, Present, and Future Directions. Found. Trends Hum.-Comput. Interact. 3, 1–2 (January 2010), 1–137. DOI: 10.1561/1100000026.Search in Google Scholar
[36] Shneiderman, B. 1996. The eyes have it: A task by data type taxonomy for information visualizations. In Visual Languages, 1996. Proceedings., IEEE Symposium on, IEEE, 336–343.10.1109/VL.1996.545307Search in Google Scholar
[37] Keck, M., Herrmann, M., Both, A., Gaertner, R., Groh, R. 2013. Improving Motive-Based Search: Utilization of Vague Feelings and Ideas in the Process of Information Seeking Conference, Proceedings of the First International Conference on Distributed, Ambient, and Pervasive Interactions – Volume 8028, Springer-Verlag New York, Inc., New York, NY, USA.10.1007/978-3-642-39351-8_48Search in Google Scholar
© 2018 Walter de Gruyter GmbH, Berlin/Boston
