top of page

Chapter

15

:

Evaluation Studies: From Controlled to Natural Settings

Web Resources

The websites in this section present examples of usability testing and in-the-wild studies. Some of them also contain information about how to perform the methods used in usability testing and in-the-wild studies. For example, there are templates for designing questionnaires that are also relevant to chapters 8, 9 and 10, such as usableweb.com/ an early website designed by Keith Instone usableweb.com/topics/000878-0-0.html that provides practical advice to help novices. It discusses the basics of usability testing, how to adapt basic techniques for different situations, whether testing needs to be done in a laboratory, how to find and recruit users to involve in usability testing, and many other important issues. There are also links to articles and to guidelines and there are links to logging tools and articles about logging analysis.


www.asktog.com/columns/042ButterflyBallot.html Bruce Tognazzini's website discusses the well-known usability fiasco of the Butterfly Ballot in Florida in the 2000 US Presidential elections and the design of more recent voting systems. Tog also discusses how, when disasters happen there is typically a sequence of situations that involve poor designs oldwww.acm.org/perlman/question.html This site also provides useful information about questionnaire design and there are templates to build your own questionnaires. Survey Monkey (Surveymonkey.com) is free for small population surveys but a license must be purchased for use on large surveys. A Youtube video provides training to help you get started with Survey Monkey - www.youtube.com/user/SurveyMonkey. Qualtrics also offers survey templates - www.qualtrics.com. Many universities and corporations hold licenses so that their community can use Qualtrics.


This ExperienceUX site describes usability testing and compares various methods for evaluating usability www.experienceux.co.uk/faqs/what-is-usability-testing/. Helpful advice is offered on www.usability.gov/how-to-and-tools/methods/usability-testing.html which describes a range of tools for evaluating the usability of product products for different demographic groups including teens and kids. In addition it discusses the cost implications of different approaches.


www.pewinternet.org The Pew Internet and American Life survey reports regularly on a wide array of topics featured on the Internet; these include health, use by different demographic groups, e-government, education, many topical issues and more. As well as reading about the interesting content it is useful to examine large-scale survey design. A series of reports for 2023 https://www.pewresearch.org/topic/internet-technology/ describe surveys to evaluate Americans’ attitudes to the use of AI in healthcare and in other aspects of life.


The Nielsen/Norman Group website contains discussion about a range of usability testing methods including eye-tracking, and testing for empathy as well as their own method of heuristic evaluation www.nngroup.com/reports/how-to-conduct-usability-studies/. Scroll down for aa list of free reports.


Applause discusses the importance of in-the-wild testing www.applause.com/blog/why-is-in-the-wild-testing-essential. Some other sites that provide insights into the use of ethnography in HCI include culturematters.wordpress.com which is a blog about a range of issues in anthropology. Andy Green from LinkedIn provides an overview of in-the-wild testing https://www.linkedin.com/pulse/in-the-wild-testing-can-provide-real-world-exposure-your-andrew-green

culturematters.wordpress.com/2007/11/27/ethnography-in-human-computer-interaction/ discusses ethnography in HCI. Though old now this blog raises some interesting issues transground.blogspot.com/2006/06/ethnography-in-hci-comments-on-dourish.html


Some links provided in the book are included here:


www.careerfoundry.com/en/blog/ux-design/what-is-usability


www.usability.gov/how-to-and-tools/guidance/hhs-usability-lab.html


www.nngroup.com/videos/remote-usability-test-part-1

www.nngroup.com/videos/remote-usability-test-part-2


www.nngroup.com/reports/ipad-app-and-website-usability.


intricons8.com/articles/usability-practical-definition-ux-design/

twww.youtube.com/watch?v=QckIzHC99Xc

www.youtube.com/watch?v=kSdGG6wEE9k


bottom of page