Course Schedule CS4803/CS8803 – Empirical Methods in HCI David Novick Week 1 January 11-15 We 12:30-14:00: How to read a research paper In class: Read Song et al. (2009); Lee & Zhai (2009) Week 2 January 18-22 Mo 17:30-19:00: Critical thinking We 12:30-14:00: Contextual interviews Before class: Read Holtzblatt handout Due: Summary of key points, questions Week 3 January 25-29 Mo 17:30-19:00: Introduction to usability and descriptive statistics Before class: Read Tullis & Albert, ch. 1 & ch 2.1-2.4 We 12:30-14:00: Introduction to usability and descriptive statistics Before class: Read Tullis & Albert, ch. 2.5-2.9 Week 4 February 1-5 Mo 17:30-19:00: Overview of usability evaluation: empirical vs. expert evaluation Before class: Read Tullis & Albert, ch. 3 We 12:30-14:00: Cognitive models Before class: Read Lewis et al. (1990) Week 5 February 8-12 Mo 17:30-19:00: Qualitative analysis of usability: goals, users, tasks, recording Before class: Read Tullis & Albert, ch. 5 Due: Summary of key points, questions We 12:30-14:00: Qualitative analysis of usability: analysis Week 6 February 15-19 Mo 17:30-19:00: Issue: group size; review Read before class: Woolrych & Cockton (2001) We 12:30-14:00: Midterm 1 Week 7 February 22-26 Recess Week 8 March 1-5 Mo 17:30-19:00: Quantitative analysis of usability: goals, hypotheses, measures, procedures Before class: Read Tullis & Albert, ch. 4 We 12:30-14:00: Quantitative analysis: techniques Read before class: Carletta, 1996; Novick et al., 2008Week 9 March 8-12 Mo 17:30-19:00: Student reports: Qualitative usability evaluation Due: Qualitative usability evaluation report We 12:30-14:00: Forming questions and hypotheses; finding a research paper to present Week 10 March 15-19 Mo 17:30-19:00: How to present a paper; empirical evaluation of UI technology Read before class: Tullis & Alber ch. 7; Mackenzie, Sellen & Buxton, 2001 We 12:30-14:00: Issue: usability over time Read before class: Mendoza & Novick (2005); Barendregt et al., (2006); Karapanos et al. (2009) Due: Summary of key points, questions Week 11 March 22-26 Mo 17:30-19:00: Self-reported metrics Read before class: Tullis & Albert ch. 6; Novick, Elizalde & Bean (2007) We 12:30-14:00: Student reports: Quantitative usability evaluation Due: Quantitative usability evaluation report Week 12 March 29 – April 2 Mo 17:30-19:00: Student research presentations We 12:30-14:00: Student research presentations Week 13 April 5-9 Mo 17:30-19:00: Easter—No class We 12:30-14:00: Advanced metrics Read before class: Tullis & Albert ch. 9 Week 14 April 12-16 Mo 17:30-19:00: Combined measures Read before class: Tullis & Albert ch. 8 We 12:30-14:00: Reliability of methods Read before class: Jeffries et al. (1991); Karat, Campbell & Fiegel (1992); Gray & Salzman (1998) In class: Debate Week 15 April 19-23 Mo 17:30-19:00: Review; presenting a term paper We 12:30-14:00: Midterm 2 Week 16 April 26-30 Mo 17:30-19:00: Term paper practice presentations We 12:30-14:00: Term paper practice presentations Finals Week May 3-7References Barendregt, W., Bekker, M. M., Bouwhuis, D. G., and Baauw, E. 2006. Identifying usability and fun problems in a computer game during first use and after some practice. Int. J. Hum.-Comput. Stud. 64, 9 (Sep. 2006), 830-846. Carletta, J. 1996. Assessing agreement on classification tasks: the kappa statistic. Comput. Linguist. 22, 2 (Jun. 1996), 249-254. Gray, W. D. and Salzman, M. C. 1998. Damaged merchandise? a review of experiments that compare usability evaluation methods. Hum.-Comput. Interact. 13, 3 (Sep. 1998), 203-261. Holtzblatt, K. 2003. Contextual design. In the Human-Computer interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, J. A. Jacko and A. Sears, Eds. Human Factors And Ergonomics. L. Erlbaum Associates, Hillsdale, NJ, 941-963. Jeffries, R., Miller, J. R., Wharton, C., and Uyeda, K. 1991. User interface evaluation in the real world: a comparison of four techniques. In Proceedings of CHI 91 (New Orleans, April 27 - May 02, 1991), 119-124. Karapanos, E., Zimmerman, J., Forlizzi, J., and Martens, J. 2009. User experience over time: an initial framework. In Proceedings CHI 2009 (Boston, April 04 - 09, 2009, 729-738. Karat, C., Campbell, R., and Fiegel, T. 1992. Comparison of empirical testing and walkthrough methods in user interface evaluation. In Proceedings CHI 92 (Monterey, California, May 03 - 07, 1992, 397-404. Lee, S. and Zhai, S. 2009. The performance of touch screen soft buttons. In Proceedings of CHI 2009 (Boston, 2009, 309-318. Lewis, C., Polson, P. G., Wharton, C., and Rieman, J. 1990. Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces. In Proceedings of CHI 90 (Seattle, April 01 - 05, 1990, 235-242. MacKenzie, I. S., Sellen, A., and Buxton, W. A. 1991. A comparison of input devices in element pointing and dragging tasks. In Proceedings of CHI 91 (New Orleans, April 27 - May 02, 1991), 161-166. Mendoza, V., and Novick, D. (2005). Usability over time, Proceedings of SIGDOC 2005 (Coventry, UK, September 21-23, 2005), 151-158. Novick, D., Andrade, O., Bean, N., and Elizalde, E. (2008). Help-based tutorials, Proceedings of SIGDOC 2008 (Lisbon, Portugal, September 22-25, 2008), 1-8. Song, H., Grossman, T., Fitzmaurice, G., Guimbretiere, F., Khan, A., Attar, R., and Kurtenbach, G. 2009. PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In Proceedings of CHI 2009 (Boston, April 04 - 09, 2009), 143-152. Tullis, T., and Albert, B. 2008. Measuring the user experience: Collecting, analyzing and presenting usability metrics. Morgan Kauffman Publishers, Burlington, MA. Woolrych, A., and Cockton, G. 2001. Why and When Five Test Users aren't Enough, in Proceedings of IHM-HCI (Lille, France, Sept. 10-14, 2001), vol. 2, 105-108, 2001.
View Full Document