Usability Analysis of Agricultural Portal eAGRI in Terms of the General Public

Petr BendaMartina ŠmejkalováPavel Šimek

DOI 10.7160/aol.2016.080402
No 4/2016, December
pp. 15-23

Abstract

Nowadays simple usability is one of the key tasks of web portals, especially if these are main information portals of the government. The aim of this paper is to evaluate the usability of a web portal eAGRI (eagri.cz) in terms of unregistered users. This means in terms of general public in particular. The main purpose of the testing is to highlight the issues that users may encounter on this portal and determine the level of portal usability. Our usability testing was focused on a public part of the portal. The main idea of eAGRI portal is to create a central access point to information resources of the Ministry of Agriculture of the Czech Republic and its subordinate organizations. Qualitative research methods were applied. Specifically, we used Heuristic evaluation as a usability inspection method and three methods of usability testing: 5 second test, 30 second test and Formalized think-aloud test.

Keywords

Usability analysis, eAGRI portal, heuristic evaluation, user testing, 5 second test, 30 second test.

References

1. Cervone, H. F. (2005) “Usability training: An overlooked component in an on-going program of web assessment and development”, OCLC Systems & Services: International digital library perspectives, Vol. 21, No. 3, pp. 244-251. ISSN 1065-075X. DOI 10.1108/10650750510612434.
2. Clemmensen, T., Hertzum, M., Hornbæk, K., Shi, Q. and Yammiyavar, P. (2009) “Cultural cognition in usability evaluation: Studies of Cultural Models in Psychological Usability Evaluation Methods”, Interacting with Computers. Vol. 21, No. 3, pp. 274-280. ISSN 1873-7951. DOI 10.1016/j.intcom.2009.05.003.
3. Doncaster, P. (2014) „The UX Five-Second Rules: Guidelines for User Experience Design's Simplest Testing Technique“. Elsevier Inc., pp. 108. ISBN 978-012800534-7. DOI 10.1016/B978-0-12-800534-7.00002-0.
4. Krug, S. (2006) “Don't make me think!: a common sense approach to Web usability”. 2nd ed. Berkeley, Calif: New Riders Pub., ISBN 03-213-4475-8.
5. Lewis, C. H. (1982) “Using the "Thinking Aloud" Method In Cognitive Interface Design (Technical report)”. IBM. RC-9265.
6. Lewis, J. (1994) “Sample sizes for usability studies: additional considerations”, The Journal of the Human Factors and Ergonomics Society, Vol. 36, pp. 368–378. ISSN 1547-8181.
7. Lindgaard, G., Fernandes, G., Dudek, C. and Brown, J. (2006) ”Attention Web Designers: You Have 50 Milliseconds to Make a Good First Impression!”, Behaviour & Information Technology, Vol. 25, No. 2, pp. 115–126. ISSN 0144-929X. DOI 10.1080/01449290500330448.
8. Matausch, K., Peböck B. and Pühretmair F. (2014) “Accessible Web Content: A Noble Desire or A Need?”, Procedia Computer Science, Vol. 27, pp. 312 – 317. ISSN 1877-0509. DOI 10.1016/j.procs.2014.02.034.
9. Molich, R. and Nielsen, J. (1990) “Improving a human - computer dialogue”, Communications of the ACM, Vol. 33, No. 3, pp. 338-348. ISSN 1557-7317. DOI 10.1145/77481.77486.
10. Moon, Hee-Jeoung. (2015) „A Study on UX-Design as a Model for a Data-driven Apps in IoT“, The Journal of The Korea institute of electronic communication sciences, Vol. 10, No. 7, pp. 819 – 824. ISSN 1975-8170. DOI 10.13067/JKIECS.2015.10.7.819.
11. Nielsen, J. (1991) “Usability metrics and methodologies”, ACM SIGCHI Bulletin, Vol. 23, No. 2, pp. 53-69. ISSN 0736-6906. DOI 10.1145/122488.122493.
12. Nielsen, J. (1993) “Usability engineering”. Boston: AP Professional. 1993. ISBN 0125184069.
13. Nielsen, J.and Landauer, T. K. (1993) “A mathematical model of the finding of usability problems”, Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93. New York, USA: ACM Press, pp. 206-213. ISBN 0897915755.
14. Nielsen, J. and Mack R. L. (1994) “Usability inspection methods”. New York: John Wiley & Sons. ISBN 0471018775. DOI 10.1145/259963.260531.
15. Page, K. L., Robson and M. J. and Uncles, M. D. (2012) “Perceptions of web knowledge and usability: When sex and experience matter”, International Journal of Human-Computer Studies, Vol. 70, No. 12, pp. 907-919. ISSN 1071-5819. DOI 10.1016/j.ijhcs.2012.07.006.
16. Reiss, E. (2012) “Usable usability: simple steps for making stuff better”. Indianapolis, Ind.: John Wiley & Sons, Inc. ISBN 978-1118185476.
17. Roghanizad, M. M. and Neufeld, D. J. (2015) “Intuition, risk, and the formation of online trust”, Computers in Human Behavior, Vol. 50, pp. 489-498. ISSN 0747-5632. DOI 10.1016/j.chb.2015.04.025.
18. Sonderegger, A., Schmutz, S. and Sauer, J. (2016) ”The influence of age in usability testing“, Applied Ergonomics, Vol. 52, pp. 291–300. ISSN 0003-6870. DOI 10.1016/j.apergo.2015.06.012.
19. Šimek, P., Pavlík, J., Jarolímek, J. (2015) “Increase in work efficiency with information sources in areas of agriculture and rural development using UX”, Proceedings of the Conference Agrarian Perspectives XXIV, Prague, pp. 433-438. ISBN 978-80-213-2581-4.
20. Tolliver, R. L., Carter, D. S., Chapman, S. E., Edwards, P. M., Fisher, J., E., Haines, A., L., Krolikowski, L. E. and Price, R. M. (2005) “Website redesign and testing with a usability consultant: lessons learned”, OCLC Systems & Services: International digital library perspectives, Vol. 21, No. 3, pp. 156-166. ISSN 1065-075X. DOI 10.1108/10650750510612362.
21. Tullis, T. and Albert, B. (2013) “Measuring the user experience: collecting, analyzing, and presenting usability metrics”. 2nd edition. The Morgan Kaufmann interactive technologies series. ISBN 978-0-12-373558-4.
22. Virzi, R. A. (1992) “Refining the test phase of the usability evaluation: how many subjects is enough?”, The Journal of the Human Factors and Ergonomics Society, Vol. 34, No. 4, pp. 457–468. ISSN 1547-8181. DOI 10.1177/001872089203400407.

Full paper

  Full paper (.pdf, 660.74 KB).