Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Open Computer Science

Editor-in-Chief: van den Broek, Egon

1 Issue per year

Covered by:
Emerging Sources Citation Index (Web of Science)

ICV 2017: 98.90

See all formats and pricing

Access brought to you by:

provisional account

Open Access
More options …

The design of manual domain usability evaluation techniques

Michaela Bačíková / Lukáš Galko
Published Online: 2018-07-25 | DOI: https://doi.org/10.1515/comp-2018-0005


In this paper we design novel techniques for manual domain usability evaluation. Domain usability is the aspect of a particular user interface that relates to its terminology, hierarchy of terms, feature descriptions and icons, used language and consistency. However, domain usability is often neglected not only by software developers, but also by many researchers. The design of formal means to evaluate existing user interfaces would aid the development of better, domain-usable user interfaces. We designed six qualitative evaluation techniques and one formal evaluation technique based on System Usability Scale (SUS). To show the viability of the designed techniques, we demonstrate each of them in the domain of gospel music. Two of the techniques were used to experimentally verify the impact of specific domain usability aspects on usability and user experience. In this paper we also focus on the equality of the domain usability aspects with the goal of designing domain usability metrics. The preliminary design of the metrics is also presented in this paper and areas of future research are suggested.

Keywords: domain usability; usability evaluation techniques; manual techniques; usability metrics


  • [1] Chilana P. K., Wobbrock J. O., Ko A. J., Understanding usability practices in complex domains, In: Grinter R., Rodden T., Aoki P., Cutrell E., Jeffries R., Olson G. (Eds.), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(Atlanta, Georgia, USA), New York: ACM, 2010, 2337-2346, DOI:10.1145/1753326.1753678Google Scholar

  • [2] Lanthaler M., Gütl Ch., Model your application domain, not your JSON structures, In: WWW ’13 Companion Proceedings of the 22nd International Conference on World Wide Web ’13 Companion (Rio de Janeiro, Brazil), New York: ACM, 2013, 1415-1420, DOI:10.1145/2487788.2488184Google Scholar

  • [3] Bačíková M., Porubän J., Ergonomic vs. domain usability of user interfaces, In: Paja W. A., Wiliamowski B. M. (Eds.), 6th International Conference on Human System Interactions (Gdańsk, Sopot, Poland), Washington, DC: IEEE Computer Society, 2013, 159-166, DOI:10.1109/HSI.2013.6577817Google Scholar

  • [4] Bačíková M., Porubän J., Domain usability, user’s perception, In: Hippe Z. S., Kulikowski J. L., Mroczek T., Wtorek J. (Eds.), Human-Computer Systems Interaction: Backgrounds and Applications 3, Germany: Springer International Publishing, 2014, 15-26, DOI: 10.1007/978-3-319-08491-6_2Google Scholar

  • [5] Nielsen J., Usability Engineering, San Francisco: Morgan Kaufmann Publishers Inc., 1993Google Scholar

  • [6] Bačíková M., Galko L., Hvizdová E., Experimental design of metrics for domain usability, Proceedings of the International Conference on Computer-Human Interaction Research and Applications- Volume 1: CHIRA (Funchal,Madeira, Portugal), 2017, 118-125, DOI: 10.5220/0006502501180125Google Scholar

  • [7] Schmettow M., Sommer J., Linking Card Sorting to Browsing Performance- Are Congruent Municipal Websites More Eflcient to Use?, Behaviour and Information Technology, 2016, 35, 452- 470, DOI:10.1080/0144929X.2016.1157207Google Scholar

  • [8] Nielsen J., Usability Inspection Methods, Nielsen J., Mack R. L.(Eds.), New York: John Wiley & Sons, 1994Google Scholar

  • [9] Nielsen J., Desurvire H., Comparative design review: an exercise in parallel design, In: CHI ’93 Proceedings of the INTERACT ’93 and CHI ’93 Conference on Human Factors in Computing Systems (Amsterdam, The Netherlands), New York: ACM, 1993, 414-417, DOI:10.1145/169059.169327Google Scholar

  • [10] Dow S. P., Glassco A., Kass J., Schwarz M., Schwartz D. L., Klemmer S. R., Parallel prototyping leads to better design results, more divergence, and increased self-eflcacy, In: ACM Transactions on Computer-Human Interaction (TOCHI) 2010, 17, article no. 18, DOI:10.1145/1879831.1879836Google Scholar

  • [11] Nielsen J., The use and misuse of focus groups, Nielsen Norman Group, 1997, https://www.nngroup.com/articles/focusgroups/Google Scholar

  • [12] Brooke J., SUS: A retrospective, Journal of Usability Studies 8, 2013, 29-40, http://dl.acm.org/citation.cfm?id=2817912.2817913Google Scholar

  • [13] Kleshchev A. S., How can ontologies contribute to software development?, In: Wolff K. E., Palchunov D. E., Zagoruiko N. G., Andelfinger U. (Eds.), Proceedings of the First international conference on Knowledge processing and data analysis (Novosibirsk, Russia), Berlin, Heidelberg: Springer-Verlag, 2007, 121- 135, DOI:10.1007/978-3-642-22140-8_8Google Scholar

  • [14] Artemieva I. L., Ontology development for domains with complicated structures, In: Wolff K. E., Palchunov D. E., Zagoruiko N. G., Andelfinger U. (Eds.), Knowledge Processing and Data Analysis. Lecture Notes in Computer Science, 2011, 6581, 184-202, DOI:10.1007/978-3-642-22140-8_12Google Scholar

  • [15] Gribova V., A method of estimating usability of a user interface based on its model, International Journal “Information Theories & Applications”, 2007, 14/1, 43-47, http://hdl.handle.net/10525/655Google Scholar

  • [16] Billman D., Arsintescucu L., Feary M., Lee J., Smith A., Tiwary R., Benefits of matching domain structure for planning software: the right stuff, In: Proceedings of the 2011 annual conference on Human factors in computing systems (Vancouver, BC, Canada), New York: ACM, 2011, 2521-2530, DOI:10.1145/1978942.1979311Google Scholar

  • [17] Tilly K., Porkoláb Z., Automatic classification of semantic user interface services, In: Pan J. Z., Staab S., Aßmann U., Ebert J., Zhao Y. (Eds.), Proceedings of Ontology-Driven Software Engineering conference. (Reno, Nevada), New York: ACM, 2010, 1-6Google Scholar

  • [18] Shneiderman B., Response time and display rate in human performance with computers, ACM Computing Surveys 2984, 16, DOI:10.1145/2514.2517Google Scholar

  • [19] Becker S. A., A study of web usability for older adults seeking online health resources,ACM Transactions on Computer-Human Interaction 2004, 11, 387-406, DOI:10.1145/1035575.1035578Google Scholar

  • [20] Kincaid J. P., Fishburne R. P., Rogers R. L., Chissom B. S. - National Technical Information Service, Springfield, Virginia, Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel, 1975, https://eric.ed.gov/?id=ED108134Google Scholar

  • [21] Kincaid J. P., McDaniel W. C., An inexpensive automated way of calculating Flesch Reading Ease scores, Patient Disclosure Document 031350, Us Patient Oflce, Washington, DC, 1974Google Scholar

  • [22] Badashian A. S., Mahdavi M., Pourshirmohammadi A., Nejad M. M., Fundamental usability guidelines for user interface design, In: Gavrilova M. L., Gervasi O., Lagana A., Mun Y., Iglesias A. (Eds.), Proceedings of the 2008 International Conference on Computational Sciences and Its Applications (Perugia, Italy), Washington: IEEE Computer Society, 2008, 106-113, DOI:10.1109/ICCSA.2008.45Google Scholar

  • [23] Hilbert D. M., Redmiles D. F., Extracting usability information from user interface events, ACM Computing Surveys, 2000, 32, 384-421, DOI:10.1145/371578.371593Google Scholar

  • [24] Ivory M. Y., Hearst M. A., The state of the art in automating usability evaluation of user interfaces, ACM Computing Surveys, 2001, 33, 470-516, DOI:10.1145/503112.503114Google Scholar

  • [25] Mahajan R., Shneiderman B., Visual and textual consistency checking tools for graphical user interfaces, IEEE Transactions on Software Engineering, 1997, 23, 722-735, DOI:10.1109/32.637386Google Scholar

  • [26] W3C, Web Content Accessibility Guidelines (WCAG) 2.0, part 3 about understandability, 2008, http://www.w3.org/TR/WCAG20/Google Scholar

  • [27] Isohella S., Nissilä N., Connecting usability with terminology: Achieving usability by using appropriate terms, In: Adler N. (Eds.), IEEE International Professional Communication Conference (IPCC) (Limerick, Ireland), Washington, DC: IEEE Computer Society, 2015, 1-5, DOI:10.1109/IPCC.2015.7235849Google Scholar

  • [28] Kollár J., Halupka I., Chodarev S., Pietriková E., PLERO: Language for grammar refactoring patterns, In: Ganzha M., Maciaszek L., Paprzycki M. (Eds.), Federated Conference on Computer Science and Information Systems (Kraków, Poland),Washington, DC: IEEE Computer Society, 2013, 1503-1510Google Scholar

  • [29] Šťastná J., Tomášek M., The problem of malware packing and its occurence in harmless software, Acta Electrotechnica et Informatica, 2016, 16, 41-47, DOI:10.15546/aeei-2016-0022Google Scholar

  • [30] Šimoňák S., Verification of communication protocols based on formal methods integration, Acta Polytechnica Hungarica 2012, 9, 117-128, http://www.uni-obuda.hu/journal/Simonak_36.pdfGoogle Scholar

  • [31] Kollár J., Spišiak M., Sičák M., Abstract language of the machine mind, Acta Electrotechnica et Informatica, 2015, 15, 24-31, DOI:10.15546/aeei-2015-0025Google Scholar

  • [32] Sulír M., Šimoňák S., A terse string-embedded language for tree searching and replacing, Acta Electrotechnica et Informatica, 2014, 14, 28-35, DOI:10.15546/aeei-2014-0014Google Scholar

  • [33] Juhár J., Vokorokos L., Exploring code projections as a tool for concern management, Acta Electrotechnica et Informatica, 2016, 16, 26-31, DOI:10.15546/aeei-2016-0020Google Scholar

  • [34] Sulír M., Porubän J., Exposing runtime information through source code annotations, Acta Electrotechnica et Informatica, 2017, 17, 3-9, DOI:10.15546/aeei-2017-0001Google Scholar

  • [35] Porubän J., Chodarev S., Model-aware language specification with Java, In: 13th International Conference on Engineering of Modern Electric Systems (Oradea, Romania), Washington, DC: IEEE Computer Society, 2015, art. no. 7158424, DOI:10.1109/EMES.2015.7158424Google Scholar

  • [36] Nosáľ M., Porubän J., Program comprehension with four-layered mental model, In: 13th International Conference on Engineering of Modern Electric Systems (Oradea, Romania), Washington, DC: IEEE Computer Society, 2015, art. no. 7158420, DOI:10.1109/EMES.2015.7158420Google Scholar

  • [37] Szabó C., Korečko Š., Sobota B., Data processing for virtual reality, Intelligent Systems Reference Library 2012, 26, 333-361, DOI:10.1007/978-3-642-23363-0_14Google Scholar

  • [38] Pietriková E., Audience response systems: benefits & utilization, Acta Electrotechnica et Informatica, 2015, 15, 3-7, DOI: 10.15546/aeei-2015-0028Google Scholar

  • [39] Szabóová V., Szabó C., Novitzká V., Demeterová E., Game semantics of the transaction rollback database operation, Acta Electrotechnica et Informatica, 2015, 15, 3-8, DOI:10.15546/aeei-2015-0001Google Scholar

  • [40] Steingartner W., Novitzká V., Coalgebras for modelling observable behaviour of programs, Journal of applied mathematics and computational mechanics, 2017, 16, 145-157, 2017, DOI:10.17512/jamcm.2017.2.12Google Scholar

  • [41] Baláž A., Ádá N., Peer to peer system deployment, Acta Electrotechnica et Informatica, 2016, 16, 11-14, DOI:10.15546/aeei-2016-0002Google Scholar

  • [42] Nosáľ M., Porubän J., XML to annotations mapping definition with patterns, Computer Science and Information Systems, 2014, 11, 1455-1477, DOI:10.2298/CSIS130920049NGoogle Scholar

  • [43] Steingartner W., Radakovič D., Novitzká V., Eldojali M. A. M., An analysis of some aspects of component-based programming for selecting appropriate categorical structures as their models, Acta Electrotechnica et Informatica, 2017, 17, 3-10, DOI:10.15546/aeei-2017-0009Google Scholar

  • [44] Pietriková E., Chodarev S., Towards programmer knowledge profile generation, Acta Electrotechnica et Informatica, 2016, 16, 15-19, DOI:10.15546/aeei-2016-0003.Google Scholar

About the article

Received: 2018-02-27

Accepted: 2018-05-30

Published Online: 2018-07-25

Citation Information: Open Computer Science, Volume 8, Issue 1, Pages 51–67, ISSN (Online) 2299-1093, DOI: https://doi.org/10.1515/comp-2018-0005.

Export Citation

© 2018 Michaela Bačíková, Lukáš Galko, published by De Gruyter. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. BY-NC-ND 4.0

Comments (0)

Please log in or register to comment.
Log in