CPSC 681 - Main Reading List

CPSC681.MainReadingList History

Show minor edits - Show changes to markup

Changed lines 25-28 from:

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED

to:
Deleted lines 27-30:

Experimental methodologies

  1. Quantitative methods Powerpoint or Adobe PDF
    Analysis of Variance Powerpoint or Adobe PDF
    * Lecture notes for the talk I give to the class.
Changed lines 8-97 from:
  1. Muller, M. (1991)
    Pictive: An exploration in participatory design. In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
    • A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

Supplemental Readings

Field Study Methodologies

Introduction

  1. Neustaedter, Carman Overview of Qualitative Data Analysis. (Powerpoint) and (Video) of his presenation
  2. Nielsen, J.
    Jacob Nielsen's Alertbox

Contextual Inquiry

  1. Holtzblatt, K. and Jones, S. (1996)
    Contextual Inquiry: A Participatory Approach. In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
  2. Holtzblatt, K. and Beyer, H. (1993)
    Contextual Design: Principles and Practice. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.

Ethnography

  1. Dourish, P. (2001)
    Where the Action Is. The Foundations of Embodied Interaction. MIT Press, Cambridge MMA.
    • Chapter 3: Social Computing p55-97.
    • Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.
  2. Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992)
    Ethnographically-informed systems design for air traffic control, in Proc CSCW'92, p123-129, November.
  3. Hughes, J., King, V., Rodden, T. and Andersen, H.
    Moving out of the control room: Ethnography in System Design. Proc ACM CSCW 1996.
  4. Randall, D. (1996)
    Ethnography and Systems Development: Bounding the Intersection. Tutorial notes presented at CSCW'96.
    • Excerpts: Sections 3, 4,5,7

Comparing Methods

  1. Greenberg, S. and Buxton, B. (2008)
    Usability Evaluation Considered Harmful (Some of the Time). In Proceedings of the ACM Conference on Human Factors in Computing Systems - ACM CHI'08. (Florence, Italy), ACM Press, pages 111-120, April 5-10.
  2. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
  3. Olson, J. and Moran, T. (1996)
    Mapping the method muddle: Guidance in using methods for user interface design. In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
    • The authors associate a variety of methodological approaches to specific interface design activities.
  4. Preece, J. et. al., (1994)
    Human Computer Interaction, Addison-Wesley
  5. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991)
    User interface evaluation in the real world: A comparison of four techniques. In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
  6. Karat, C., Campbell, R. and Fiegel, T. (1992)
    Comparison of empirical testing and walkthrough methods in user interface evaluation. In ACM Conference on Human Factors in Computing Systems. 397-4044, ACM Press.
  7. Landauer, T. (1991)
    Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, In J. Carroll (ed) Designing Interaction, Cambridge University Press.
  8. Steve M. Easterbrook and J. Singer and M.-A. Storey and D. Damian, 2007
    Selecting Empirical Methods for Software Engineering Research, In Forrest Shull, Janice Singer and Dag I. K. Sjoberg (Eds) Guide to Advanced Empirical Software Engineering, Springer, 285-311.
  9. Ioannidis, J. P. A. (2005)
    Why Most Published Research Findings Are False. PLoS Medicine, August; 2(8): e124. link
  10. Norman, D. (various)
    • Technology First, Needs Last
    • Filling Much Needed Holes
to:
Changed lines 39-42 from:

Open Coding

  • Strauss, A. and Corbin, J. (1998)
    Basics of Qualitative Research, 2nd Edition. Sage Publications.
to:
Deleted lines 13-16:
  1. Gould, J., Conti, J., and Hovanyecz, T. (1981)
    Composing letters with a simulated listening typewriter. Communications of the ACM, 26(4), 295-308. ACM Press.
    • The first description of the Wizard of Oz prototyping/testing method.
Changed lines 9-30 from:

Interface Inspection

Overview

  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)

Usability Heuristics and Heuristic Evaluation

  1. Overview of Heuristic Evaluation Powerpoint or Adobe PDF
    • My presentation that I give in CPSC 481
  2. Molich, R. and Nielsen, J.
    Improving a human-computer dialog. Comm ACM, 33(3), 1990
    • This article lists the heuristics and presents a working example, solutions, and alternatives.
  3. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
to:
  1. Muller, M. (1991)
    Pictive: An exploration in participatory design. In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
    • A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
Changed lines 14-42 from:
  1. Nielsen, J. (1994)
    Enhancing the explanatory power of usability heuristics. In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
    • This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.
  2. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
  3. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.

Task-Centered Walkthroughs

  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
    • My presentation that I give in CPSC 481
  2. Greenberg, S.
    Working through task-centered system design. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
    • A how-to approach to task-centered system design.
  3. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
to:
  1. Gould, J., Conti, J., and Hovanyecz, T. (1981)
    Composing letters with a simulated listening typewriter. Communications of the ACM, 26(4), 295-308. ACM Press.
    • The first description of the Wizard of Oz prototyping/testing method.
Changed lines 19-63 from:
  1. Lewis, C. and Rieman, J. (1993)
    Task-Centered User Interface Design: A Practical Introduction. Available as Shareware.
    • The book that started it off.
    • Read the chapter Getting to Know Users and their Tasks., which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

Cognitive Walkthroughs

  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
  2. Preece, J. et. al., (1994)
    Human Computer Interaction, Addison-Wesley

Prototyping

  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
  2. Rettig, M. (1994)
    Prototyping for tiny fingers. Communications of the ACM, 37(4), ACM Press
    • A simple way to build low fidelity prototypes, similar to Pictive
  3. Rudd, J., Stern, K. and Isensee, S. (1996)
    Low vs. high fidelity prototyping debate. Interactions 3(1), p76-85, ACM Press.
    • When are where you should use low vs. high fidelity prototypes
  4. Muller, M. (1991)
    Pictive: An exploration in participatory design. In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
    • A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
  5. Gould, J., Conti, J., and Hovanyecz, T. (1981)
    Composing letters with a simulated listening typewriter. Communications of the ACM, 26(4), 295-308. ACM Press.
    • The first description of the Wizard of Oz prototyping/testing method.

Supplemental Readings

  • Maulsby, D., Greenberg, S. and Mander, R. (1993).
    Prototyping an intelligent agent through Wizard of Oz. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
    • Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
to:
Deleted lines 22-25:
Changed lines 10-12 from:
  1. (optional) Ehrlich, K., Butler, M. and Pernce, K.
    Getting the whole team into usability testing. IEEE Software, p89-90. (1994)
    • Tips and reasons for including developers as part of the evaluation team.
to:

Interface Inspection

Overview

  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)

Usability Heuristics and Heuristic Evaluation

  1. Overview of Heuristic Evaluation Powerpoint or Adobe PDF
    • My presentation that I give in CPSC 481
  2. Molich, R. and Nielsen, J.
    Improving a human-computer dialog. Comm ACM, 33(3), 1990
    • This article lists the heuristics and presents a working example, solutions, and alternatives.
  3. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Changed lines 32-34 from:
  1. (optional) O'Malley, C., Draper, S. and Riley, M.
    Constructive interaction: A method for studying user-computer-user interaction. (1984) From Proceedings of Interact '84, p1-5.
    • Describes a method for observing people working together.
to:
  1. Nielsen, J. (1994)
    Enhancing the explanatory power of usability heuristics. In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
    • This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.
Changed lines 36-38 from:
  1. (optional) Kennedy, S.
    Using video in the BNR usability lab. SIGCHI Bulletin, 21(2), p92-95, ACM Press.(1989)
    • As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.
to:
  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
Deleted lines 40-103:
  1. (optional) Neal, L.
    The use of video in empirical research. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
    • Further reasons why one should videotape usability sessions.
  2. optional Krug, S.
    Don't Make Me Think: A Common Sense Approach to Web Usability. 1st Edition. Pearson Education, Inc and New riders. (2000) Extract: Chapters 9-11.
    • A simple guide to doing cut-rate usability tests. Written for the lay practitioner.
    • Chapter 9: Usability testing on 10 cents a day
    • Chapter 10: What to do if you're the facilitator
    • Chapter 11: Can this marriage be saved?

Excercise (to be handed out)

  1. Get real with IBM RealPhone
    • We will perform a usability study on IBM's RealPhone system
    • Download the full handout, which contains:
      • the presentation
      • evaluator's instructions and tasks
      • consent form
      • Pre-test, During-test and Post-test questions
      • methods for running a basic observational study
      • discussion of guidelines for user observation
      • IBM Real Phone Instruction Sheet and their test-drive instructions
      • Isys' Hall of Shame critique of RealPhone
    • The system is available here, as an installable .exe
    • The presentation, in powerpoint

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED

Experimental methodologies

  1. Quantitative methods Powerpoint or Adobe PDF
    Analysis of Variance Powerpoint or Adobe PDF
    * Lecture notes for the talk I give to the class.

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards
    • We will perform a 'pilot' controlled study on how people perform on different types of keyboards

Interface Inspection

Overview

  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)

Usability Heuristics and Heuristic Evaluation

  1. Overview of Heuristic Evaluation Powerpoint or Adobe PDF
    • My presentation that I give in CPSC 481
  2. Molich, R. and Nielsen, J.
    Improving a human-computer dialog. Comm ACM, 33(3), 1990
    • This article lists the heuristics and presents a working example, solutions, and alternatives.
Changed lines 43-44 from:
to:
Changed lines 46-48 from:
  1. Nielsen, J. (1994)
    Enhancing the explanatory power of usability heuristics. In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
    • This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.
to:

Task-Centered Walkthroughs

  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
    • My presentation that I give in CPSC 481
Added lines 52-55:
  1. Greenberg, S.
    Working through task-centered system design. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
    • A how-to approach to task-centered system design.
Changed lines 58-59 from:
to:

Supplemental Readings

  1. Lewis, C. and Rieman, J. (1993)
    Task-Centered User Interface Design: A Practical Introduction. Available as Shareware.
    • The book that started it off.
    • Read the chapter Getting to Know Users and their Tasks., which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

Cognitive Walkthroughs

  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
Added lines 74-79:
  1. Preece, J. et. al., (1994)
    Human Computer Interaction, Addison-Wesley

Prototyping

Changed lines 82-83 from:
to:
Changed lines 85-89 from:

Task-Centered Walkthroughs

  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
    • My presentation that I give in CPSC 481
to:
  1. Rettig, M. (1994)
    Prototyping for tiny fingers. Communications of the ACM, 37(4), ACM Press
    • A simple way to build low fidelity prototypes, similar to Pictive
Changed lines 89-91 from:
  1. Greenberg, S.
    Working through task-centered system design. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
    • A how-to approach to task-centered system design.
to:
  1. Rudd, J., Stern, K. and Isensee, S. (1996)
    Low vs. high fidelity prototyping debate. Interactions 3(1), p76-85, ACM Press.
    • When are where you should use low vs. high fidelity prototypes
Changed lines 93-97 from:
  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
to:
  1. Muller, M. (1991)
    Pictive: An exploration in participatory design. In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
    • A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
  2. Gould, J., Conti, J., and Hovanyecz, T. (1981)
    Composing letters with a simulated listening typewriter. Communications of the ACM, 26(4), 295-308. ACM Press.
    • The first description of the Wizard of Oz prototyping/testing method.
Changed lines 102-142 from:
  1. Lewis, C. and Rieman, J. (1993)
    Task-Centered User Interface Design: A Practical Introduction. Available as Shareware.
    • The book that started it off.
    • Read the chapter Getting to Know Users and their Tasks., which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

Cognitive Walkthroughs

  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
  2. Preece, J. et. al., (1994)
    Human Computer Interaction, Addison-Wesley

Prototyping

  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
  2. Rettig, M. (1994)
    Prototyping for tiny fingers. Communications of the ACM, 37(4), ACM Press
    • A simple way to build low fidelity prototypes, similar to Pictive
  3. Rudd, J., Stern, K. and Isensee, S. (1996)
    Low vs. high fidelity prototyping debate. Interactions 3(1), p76-85, ACM Press.
    • When are where you should use low vs. high fidelity prototypes
  4. Muller, M. (1991)
    Pictive: An exploration in participatory design. In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
    • A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
  5. Gould, J., Conti, J., and Hovanyecz, T. (1981)
    Composing letters with a simulated listening typewriter. Communications of the ACM, 26(4), 295-308. ACM Press.
    • The first description of the Wizard of Oz prototyping/testing method.

Supplemental Readings

to:
Added lines 193-225:

Excercise (to be handed out)

  1. Get real with IBM RealPhone
    • We will perform a usability study on IBM's RealPhone system
    • Download the full handout, which contains:
      • the presentation
      • evaluator's instructions and tasks
      • consent form
      • Pre-test, During-test and Post-test questions
      • methods for running a basic observational study
      • discussion of guidelines for user observation
      • IBM Real Phone Instruction Sheet and their test-drive instructions
      • Isys' Hall of Shame critique of RealPhone
    • The system is available here, as an installable .exe
    • The presentation, in powerpoint

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED


Experimental methodologies

  1. Quantitative methods Powerpoint or Adobe PDF
    Analysis of Variance Powerpoint or Adobe PDF
    * Lecture notes for the talk I give to the class.

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards
    • We will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed lines 9-119 from:

Course texts: You should buy these texts. Some of the readings below will be from them.

  • Required
    1. Papers will be made available to you at cost.
  • Some recommended classics
    1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
    2. Usability Engineering, Nielsen, J. (1993) Academic Press.
    3. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.

Overview of methodologies

The following papers introduces (but do not detail) many methodologies. They also discuss and compare methodologies from various perspectives: to influence design, to evaluate products, to encourage end-user feedback, and to compare when and where each is useful. Because you do not yet know the details of these methodologies, the discussions in the papers may be hard to follow at times. Because these papers are just intended to give you a feel for the area, I suggest you give them a quick read now. As the course progresses, you will find that you will be able to go back to them for a more careful read.

  1. Gould, J.D. (1996)
    How to design usable systems. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
    • This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
  2. Dix, A., Finlay, J., Abowd, G., and Beale, R.
    Human Computer Interaction, 2nd Edition. Prentice Hall. 1998
  3. McGrath, J.
    Methodology matters: Doing research in the behavioural and social sciences. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
    • See also a student-created summary by Stephanie Smale
    • This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.

Optional Readings

  1. Norman, D. Applying the Behavioral, Cognitive, and Social Sciences to Products. Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
    • This essay contrasts the academic vs business approach to product development.

User Observation

Experimental methodologies

  1. Dix, A., Finlay, J., Abowd, G., and Beale, R.
    Human Computer Interaction, 2nd Edition. Prentice Hall. 1998
  2. McGrath, J.
    Methodology matters: Doing research in the behavioural and social sciences. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
    • Reread sections of this paper:
      • Experimental Strategies (p157-8)
      • Study Design, Comparison Techniques, and Validity (p159 - 164)
  3. Eberts, R.E.
    User Interface Design, Prentice Hall 1994
  4. Greenberg, S. and Witten, I. (1984)
    Comparison of menu displays for ordered lists. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
    • This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in the lectures.

Ethics

  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
    • Chapter 6: Usability testing. p165-205 2 pages / side. In particular, read Chapter 6.4: Ethical aspects of tests with human subjects, p181-185.
    • A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
  2. University of Calgary Research Services: Ethics
    • University of Calgary’s website for Research Ethics
    • Do I Need to Apply For Ethics Approval?
    • Information to help applicants to fill out the application form
    • Ethics Application Form that you should fill out
    • Example template for a consent form
  3. (optional) Rogers, Tim
    Research Participants' Bill of Rights. (Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html.
    • A concise statement of what participant's should expect as fair treatment
Additional supplemental readings available in the Optional Readings sections

User Observation

Usability Testing

  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
  2. Gomoll, Kathleen & Nicol, Anne (1990)
    User Observation: Guidelines for Apple Developers, Apple Inc., January
    • This reading is an excellent recipe for performing usability studies.
  3. Dumas, J.S. and Redish, J.C.
    A Practical Guide to Usability Testing. Revised Edition. (1999)
to:
  1. (optional) Ehrlich, K., Butler, M. and Pernce, K.
    Getting the whole team into usability testing. IEEE Software, p89-90. (1994)
    • Tips and reasons for including developers as part of the evaluation team.
Added lines 2-5:

READING LIST IS BEING MIGRATED TO THE NEW WEB SITE

Please visit: the New Location

Changed line 364 from:

Last updated Fall, 2006

to:

Last updated Fall, 2006

March 11, 2010, at 12:55 PM by 24.64.76.54 -
Changed lines 356-359 from:
  • Technology First, Needs Last
  • Filling Much Needed Holes
to:
  • Technology First, Needs Last
  • Filling Much Needed Holes
March 11, 2010, at 12:54 PM by 24.64.76.54 -
Added lines 355-359:
  1. Norman, D. (various)
  • Technology First, Needs Last
  • Filling Much Needed Holes
Changed line 116 from:
  1. Ehrlich, K., Butler, M. and Pernce, K. \\
to:
  1. (optional) Ehrlich, K., Butler, M. and Pernce, K. \\
Changed line 120 from:
  1. O'Malley, C., Draper, S. and Riley, M. \\
to:
  1. (optional) O'Malley, C., Draper, S. and Riley, M. \\
Changed line 124 from:
  1. Kennedy, S. \\
to:
  1. (optional) Kennedy, S. \\
Changed line 128 from:
  1. Neal, L. \\
to:
  1. (optional) Neal, L. \\
Deleted lines 87-89:

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED

Deleted lines 89-99:

Experimental methodologies

  1. Quantitative methods Powerpoint or Adobe PDF
    Analysis of Variance Powerpoint or Adobe PDF
    * Lecture notes for the talk I give to the class.

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards
    • We will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed lines 157-174 from:
to:

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED

Experimental methodologies

  1. Quantitative methods Powerpoint or Adobe PDF
    Analysis of Variance Powerpoint or Adobe PDF
    * Lecture notes for the talk I give to the class.

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards
    • We will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed lines 295-298 from:
  1. Incontext, Inc.
    Getting Started with Contextual Techniques. http://www.incent.com
to:
Deleted lines 67-70:

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED

Added lines 88-90:

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED

Deleted lines 68-69:
Changed lines 79-86 from:

University of Calgary Research Services: Ethics

  • University of Calgary’s website for Research Ethics
  • Do I Need to Apply For Ethics Approval?
  • Information to help applicants to fill out the application form
  • Ethics Application Form that you should fill out
  • Example template for a consent form
to:
  1. University of Calgary Research Services: Ethics
    • University of Calgary’s website for Research Ethics
    • Do I Need to Apply For Ethics Approval?
    • Information to help applicants to fill out the application form
    • Ethics Application Form that you should fill out
    • Example template for a consent form
Changed lines 81-89 from:
  1. Rogers, Tim \\
to:

University of Calgary Research Services: Ethics

  • University of Calgary’s website for Research Ethics
  • Do I Need to Apply For Ethics Approval?
  • Information to help applicants to fill out the application form
  • Ethics Application Form that you should fill out
  • Example template for a consent form
  1. (optional) Rogers, Tim \\
Changed lines 91-111 from:
  • A concise statement of what participant's should expect as fair treatment
  1. Research Services
    University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Excerpt.
    • This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update, but unfortunately this is now under review and doesn't seem to be available.
      • Section 1 - verify that your work requires ethics clearance,
      • Section 6 - if your application concerns course-based research,
      • Section 8 for your procedural responsibilities
      • Section 9 for guidelines on balancing risks vs benefits
      • Section 10 on how to do informed consent
      • Section 11 for guidelines on deception (research involving any deception is usually considered risky)
      • Section 12 for guidelines on maintaining privacy and confidentiality
  2. Research Services
    Ethics application
    • Go to the CFREB Ethics Board Web Site. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
      • Ethics Information for U of C Graduate Students, with pointers to what is required in each faculty and the process.
      • Information to Help Applicants
      • Ethics review application form
      • Sample consent form
to:
  • A concise statement of what participant's should expect as fair treatment
Changed lines 51-52 from:
  1. Gould, J.D. (1996)
    How to design usable systems. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
  1. McGrath, J.
    Methodology matters: Doing research in the behavioural and social sciences. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
Changed lines 114-117 from:
  1. Dix, A., Finlay, J., Abowd, G., and Beale, R.
    Human Computer Interaction, 2nd Edition. Prentice Hall. 1998
    • Chapter 11: Evaluation Techniques. 363-400
    • the chapter you previously read includes a section on controlled experiments. Read Section 11.5.1: Empirical methods. p375-385
to:

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards
    • We will perform a 'pilot' controlled study on how people perform on different types of keyboards

Usability Testing

  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Deleted lines 125-148:
  1. Eberts, R.E.
    User Interface Design, Prentice Hall 1994
  2. Greenberg, S. and Witten, I. (1984)
    Comparison of menu displays for ordered lists. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
    • This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards
    • We will perform a 'pilot' controlled study on how people perform on different types of keyboards

Usability Testing

  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Changed lines 47-49 from:
  • Chapter 11: Evaluation Techniques. 363-400
  • the chapter you previously read includes sections on controlled experiments. Read Sections 11.3.1 Laboratory Studies (p365), and 11.5.1: Empirical methods (p375-385)
to:
Changed lines 53-54 from:
  • Reread sections of this paper: Experimental Strategies (p. 157-8), and the major section Study Design, Comparison Techniques, and Validity (p159 - 164)
to:
  • Reread sections of this paper:
    • Experimental Strategies (p157-8)
    • Study Design, Comparison Techniques, and Validity (p159 - 164)
Changed lines 48-49 from:
  • the chapter you previously read includessections on controlled experiments. Read Sections 11.3.1 Laboratory Studies p. 365, and 11.5.1: Empirical methods, p375-385
to:
  • the chapter you previously read includes sections on controlled experiments. Read Sections 11.3.1 Laboratory Studies (p365), and 11.5.1: Empirical methods (p375-385)
  1. Gould, J.D. (1996)
    How to design usable systems. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
    • Reread sections of this paper: Experimental Strategies (p. 157-8), and the major section Study Design, Comparison Techniques, and Validity (p159 - 164)
Changed lines 48-49 from:
  • the chapter you previously read includes a section on controlled experiments. Read Section 11.5.1: Empirical methods. p375-385
to:
  • the chapter you previously read includessections on controlled experiments. Read Sections 11.3.1 Laboratory Studies p. 365, and 11.5.1: Empirical methods, p375-385
Added line 15:
Changed lines 33-39 from:
to:

Optional Readings

  1. Norman, D. Applying the Behavioral, Cognitive, and Social Sciences to Products. Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
    • This essay contrasts the academic vs business approach to product development.
Changed lines 62-66 from:

Optional Readings

  1. Norman, D. Applying the Behavioral, Cognitive, and Social Sciences to Products. Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
    • This essay contrasts the academic vs business approach to product development.
to:
Added lines 32-54:

User Observation

Experimental methodologies

  1. Dix, A., Finlay, J., Abowd, G., and Beale, R.
    Human Computer Interaction, 2nd Edition. Prentice Hall. 1998
    • Chapter 11: Evaluation Techniques. 363-400
    • the chapter you previously read includes a section on controlled experiments. Read Section 11.5.1: Empirical methods. p375-385
  2. Eberts, R.E.
    User Interface Design, Prentice Hall 1994
  3. Greenberg, S. and Witten, I. (1984)
    Comparison of menu displays for ordered lists. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
    • This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in the lectures.
Changed lines 7-10 from:
  • Required:
to:
  • Required
    1. Papers will be made available to you at cost.
  • Some recommended classics
Deleted lines 12-14:
  1. Papers of the remaining readings will be made available to you at cost.
  • Recommended
Deleted line 14:
Changed line 33 from:

Optional Readings

to:

Optional Readings

Changed lines 38-40 from:
to:

YOU SHOULD HAVE READ THE ABOVE PAPERS.

THE PAPERS BELOW ARE STILL TO BE ASSIGNED

Changed lines 32-33 from:
  1. Norman, D. Applying the Behavioral, Cognitive, and Social Sciences to Products. Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
to:

Optional Readings

  1. Norman, D. Applying the Behavioral, Cognitive, and Social Sciences to Products. Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
Changed lines 37-38 from:
  1. Neustaedter, Carman Overview of Qualitative Data Analysis. (Powerpoint) and (Video) of his presenation
to:
Changed lines 277-278 from:
to:
  1. Neustaedter, Carman Overview of Qualitative Data Analysis. (Powerpoint) and (Video) of his presenation
June 08, 2008, at 04:12 PM by 24.64.87.10 -
Changed lines 319-320 from:

Greenberg, S. and Buxton, B. (2008) \\

to:
  1. Greenberg, S. and Buxton, B. (2008) \\
Changed line 352 from:

Last updated Fall, 2006

to:

Last updated Fall, 2006

June 08, 2008, at 04:12 PM by 24.64.87.10 -
Changed lines 319-321 from:
to:

Greenberg, S. and Buxton, B. (2008)
Usability Evaluation Considered Harmful (Some of the Time). In Proceedings of the ACM Conference on Human Factors in Computing Systems - ACM CHI'08. (Florence, Italy), ACM Press, pages 111-120, April 5-10.

April 26, 2008, at 06:14 PM by 24.64.87.10 -
Changed lines 346-348 from:
  1. Ioannidis, J. P. A. (2005)

Why Most Published Research Findings Are False. PLoS Medicine, August; 2(8): e124

to:
  1. Ioannidis, J. P. A. (2005)
    Why Most Published Research Findings Are False. PLoS Medicine, August; 2(8): e124. link
April 26, 2008, at 06:13 PM by 24.64.87.10 -
Added lines 343-348:
  1. Steve M. Easterbrook and J. Singer and M.-A. Storey and D. Damian, 2007
    Selecting Empirical Methods for Software Engineering Research, In Forrest Shull, Janice Singer and Dag I. K. Sjoberg (Eds) Guide to Advanced Empirical Software Engineering, Springer, 285-311.
  2. Ioannidis, J. P. A. (2005)

Why Most Published Research Findings Are False. PLoS Medicine, August; 2(8): e124

Changed line 64 from:
  • Go to the CFREB Ethics Board Web Site. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
to:
  • Go to the CFREB Ethics Board Web Site. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
Changed lines 64-69 from:
  • A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects.
    • Ethics Information for U of C Graduate Students
    • Information to Help Applicants, with pointers to what is required in each faculty and the process.
    • Ethics review application form
    • Sample consent form
to:
  • Go to the CFREB Ethics Board Web Site. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
    • Ethics Information for U of C Graduate Students, with pointers to what is required in each faculty and the process.
    • Information to Help Applicants
    • Ethics review application form
    • Sample consent form
Changed line 67 from:
  • Ethics review application form
to:
  • Ethics review application form
Changed lines 65-66 from:
  • Information to Help Applicants
to:
  • Ethics Information for U of C Graduate Students
  • Information to Help Applicants, with pointers to what is required in each faculty and the process.
Changed line 53 from:
  • This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update, but unfortunately this is now under review and doesn't seem to be available.
to:
  • This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update, but unfortunately this is now under review and doesn't seem to be available.
Changed lines 64-68 from:
to:
  • A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects.
    • Information to Help Applicants
    • Ethics review application form
    • Sample consent form
Changed line 48 from:

Research Participants' Bill of Rights. -(Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html)-.

to:

Research Participants' Bill of Rights. (Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html.

Changed line 53 from:
  • This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
to:
  • This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update, but unfortunately this is now under review and doesn't seem to be available.
Changed line 48 from:

Research Participants' Bill of Rights. Mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html .

to:

Research Participants' Bill of Rights. -(Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html)-.

Changed lines 147-151 from:
  • [[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | Chapter 9: Usability testing on 10 cents a day]
  • [[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | Chapter 10: What to do if you're the facilitator]
  • [[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | Chapter 11: Can this marriage be saved?]
to:
  • Chapter 9: Usability testing on 10 cents a day
  • Chapter 10: What to do if you're the facilitator
  • Chapter 11: Can this marriage be saved?
Changed lines 145-147 from:

Don't Make Me Think: A Common Sense Approach to Web Usability. 1st Edition. Pearson Education, Inc and New riders. (2000)

  • Chapters 9-11 are available for download, which provide a simple guide to doing cut-rate usability tests. Written for the lay practitioner.
to:

Don't Make Me Think: A Common Sense Approach to Web Usability. 1st Edition. Pearson Education, Inc and New riders. (2000) Extract: Chapters 9-11.

  • A simple guide to doing cut-rate usability tests. Written for the lay practitioner.
  • [[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | Chapter 9: Usability testing on 10 cents a day]
  • [[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | Chapter 10: What to do if you're the facilitator]
  • [[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | Chapter 11: Can this marriage be saved?]
Added lines 143-147:
  1. optional Krug, S.
    Don't Make Me Think: A Common Sense Approach to Web Usability. 1st Edition. Pearson Education, Inc and New riders. (2000)
    • Chapters 9-11 are available for download, which provide a simple guide to doing cut-rate usability tests. Written for the lay practitioner.
Changed lines 287-290 from:
to:

Open Coding

  • Strauss, A. and Corbin, J. (1998)
    Basics of Qualitative Research, 2nd Edition. Sage Publications.
March 23, 2007, at 09:13 PM by 24.64.76.194 -
Changed lines 39-40 from:
to:
  1. Neustaedter, Carman Overview of Qualitative Data Analysis. (Powerpoint) and (Video) of his presenation
Changed line 2 from:

-

to:
Changed line 2 from:
to:

-

Deleted line 47:
  • Rogers, Tim. \\
Changed lines 48-49 from:

Research Participants' Bill of Rights also as PDF

to:
Changed lines 305-306 from:

Comparing Methods

to:

Comparing Methods

Changed line 211 from:

Supplemental Readings

to:

Supplemental Readings

Changed line 170 from:
  1. Overview of Heuristic Evaluation Powerpoint or Adobe PDF]
to:
  1. Overview of Heuristic Evaluation Powerpoint or Adobe PDF
Changed line 199 from:
  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
to:
  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
Changed line 203 from:

Working through task-centered system design. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.

to:

Working through task-centered system design. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.

Changed line 213 from:
to:
Changed line 225 from:

'Human Computer Interaction, Addison-Wesley

to:

Human Computer Interaction, Addison-Wesley

Changed line 254 from:

Prototyping an intelligent agent through Wizard of Oz. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.

to:

Prototyping an intelligent agent through Wizard of Oz. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.

Changed lines 262-263 from:

Interactive sketching for the early stages of user interface design. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995**** Describes a system that lets people sketch and storyboard through a live computer interface.

to:

Interactive sketching for the early stages of user interface design. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995

  • Describes a system that lets people sketch and storyboard through a live computer interface.
Changed lines 277-278 from:
  1. Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
to:
  1. Holtzblatt, K. and Jones, S. (1996)
    Contextual Inquiry: A Participatory Approach. In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
Changed lines 280-281 from:
  1. Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
to:
  1. Holtzblatt, K. and Beyer, H. (1993)
    Contextual Design: Principles and Practice. In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
Changed lines 283-285 from:
  1. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com
to:
  1. Incontext, Inc.
    Getting Started with Contextual Techniques. http://www.incent.com
Changed line 289 from:
  • Dourish, P. (2001) \\
to:
  1. Dourish, P. (2001) \\
Changed lines 294-295 from:
  1. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
to:
  1. Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992)
    Ethnographically-informed systems design for air traffic control, in Proc CSCW'92, p123-129, November.
Changed lines 300-301 from:
  1. Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
to:
  1. Randall, D. (1996)
    Ethnography and Systems Development: Bounding the Intersection. Tutorial notes presented at CSCW'96.
Changed line 317 from:

'Human Computer Interaction, Addison-Wesley

to:

Human Computer Interaction, Addison-Wesley

Changed lines 51-52 from:
to:
Changed lines 62-63 from:
  1. Ethics application
to:
  1. Research Services
    Ethics application
Changed lines 69-71 from:

Supplemental Readings available in the Optional Readings sections

to:
Additional supplemental readings available in the Optional Readings sections
Changed line 198 from:
  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
to:
  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
Changed lines 201-202 from:
  1. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
to:
  1. Greenberg, S.
    Working through task-centered system design. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
Changed lines 205-207 from:
  1. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
to:
  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
Changed lines 211-217 from:
to:
  1. Lewis, C. and Rieman, J. (1993)
    Task-Centered User Interface Design: A Practical Introduction. Available as Shareware.
    • The book that started it off.
    • Read the chapter Getting to Know Users and their Tasks., which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
Changed lines 218-220 from:
  1. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
  1. Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
Changed lines 223-225 from:
  1. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
    • This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
to:
  1. Preece, J. et. al., (1994)
    'Human Computer Interaction, Addison-Wesley
Changed lines 227-232 from:

Topics below here are optional and/or subject to change

Prototyping

  1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
to:

Prototyping

  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Changed lines 234-235 from:
  1. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
to:
  1. Rettig, M. (1994)
    Prototyping for tiny fingers. Communications of the ACM, 37(4), ACM Press
Changed lines 238-239 from:
  1. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
to:
  1. Rudd, J., Stern, K. and Isensee, S. (1996)
    Low vs. high fidelity prototyping debate. Interactions 3(1), p76-85, ACM Press.
Changed lines 242-243 from:
  1. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
to:
  1. Muller, M. (1991)
    Pictive: An exploration in participatory design. In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
Changed lines 246-247 from:
  1. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
to:
  1. Gould, J., Conti, J., and Hovanyecz, T. (1981)
    Composing letters with a simulated listening typewriter. Communications of the ACM, 26(4), 295-308. ACM Press.
Changed lines 252-271 from:

Field Study Methodologies (tentative)

Introduction

  1. Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
to:
  • Maulsby, D., Greenberg, S. and Mander, R. (1993).
    Prototyping an intelligent agent through Wizard of Oz. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
    • Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
  • Muller, Michael J.
    Retrospective on a year of participatory design using the PICTIVE technique. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
    • Experiences with Pictive and recommendations.
  • Landay, James A., and Brad A. Myers
    Interactive sketching for the early stages of user interface design. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995**** Describes a system that lets people sketch and storyboard through a live computer interface.

Field Study Methodologies

Introduction

  1. Nielsen, J.
    Jacob Nielsen's Alertbox
Changed lines 284-286 from:
  1. Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.
to:
  • Dourish, P. (2001)
    Where the Action Is. The Foundations of Embodied Interaction. MIT Press, Cambridge MMA.
Changed line 289 from:
  1. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
to:
  1. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
Changed lines 291-292 from:
  1. Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994) In Proc CSCW'94, p429439, ACM Press.
to:
  1. Hughes, J., King, V., Rodden, T. and Andersen, H.
    Moving out of the control room: Ethnography in System Design. Proc ACM CSCW 1996.
Changed lines 300-301 from:
  1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
to:
  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Changed lines 305-306 from:
  1. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
to:
  1. Olson, J. and Moran, T. (1996)
    Mapping the method muddle: Guidance in using methods for user interface design. In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
Changed lines 309-311 from:
  1. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
to:
  1. Preece, J. et. al., (1994)
    'Human Computer Interaction, Addison-Wesley
Changed lines 314-315 from:
  1. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
  1. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991)
    User interface evaluation in the real world: A comparison of four techniques. In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed lines 317-318 from:
  1. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
  1. Karat, C., Campbell, R. and Fiegel, T. (1992)
    Comparison of empirical testing and walkthrough methods in user interface evaluation. In ACM Conference on Human Factors in Computing Systems. 397-4044, ACM Press.
Changed lines 320-322 from:
  1. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2004

to:
  1. Landauer, T. (1991)
    Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2006

Changed line 201 from:
  1. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
to:
  1. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
Deleted lines 16-17:
Changed line 19 from:
to:
Changed lines 22-23 from:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
  1. Gould, J.D. (1996)
    How to design usable systems. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
Changed lines 47-48 from:
  1. Research Participants' Bill of Rights by Tim Rogers also as PDF
to:
  1. Rogers, Tim
    Research Participants' Bill of Rights also as PDF
Changed lines 78-79 from:
  1. To read again: . Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
    • the chapter you previously read includes a section on controlled experiments
to:
  1. Dix, A., Finlay, J., Abowd, G., and Beale, R.
    Human Computer Interaction, 2nd Edition. Prentice Hall. 1998
    • Chapter 11: Evaluation Techniques. 363-400
    • the chapter you previously read includes a section on controlled experiments. Read Section 11.5.1: Empirical methods. p375-385
Changed line 83 from:
  1. * Eberts, R.E. \\
to:
  1. Eberts, R.E. \\
Changed line 90 from:
  1. Greenberg, S. and Witten, I. (1984) \\
to:
  1. Greenberg, S. and Witten, I. (1984) \\
Deleted line 95:
Changed lines 97-99 from:

We will perform a 'pilot' controlled study on how people perform on different types of keyboards

to:
  • We will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed lines 5-7 from:

Course texts You should buy these texts. Some of the readings below will be from them.

to:

Course texts: You should buy these texts. Some of the readings below will be from them.

Changed line 5 from:

Course texts

to:

Course texts

Changed line 5 from:

Course texts

to:

Course texts

Deleted lines 4-9:

All papers are required reading unless otherwise noted.

Papers below the ruled line are not yet finalized.

Deleted lines 5-6:
Changed lines 8-18 from:

Required:

  1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
  2. Usability Engineering, Nielsen, J. (1993) Academic Press.
  3. Papers of the remaining readings will be made available to you at cost.

Recommended

  1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
to:
  • Required:
    1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
    2. Usability Engineering, Nielsen, J. (1993) Academic Press.
    3. Papers of the remaining readings will be made available to you at cost.
  • Recommended
    1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
Changed lines 11-13 from:

Course texts

to:

Course texts

Changed lines 27-29 from:

Overview of methodologies

to:

Overview of methodologies

Changed lines 52-53 from:

Ethics

to:

Ethics

Changed lines 81-84 from:

User Observation

Experimental methodologies

to:

User Observation

Experimental methodologies

Changed lines 104-105 from:

Excercise

to:

Excercise

Changed lines 110-111 from:

Usability Testing

to:

Usability Testing

Changed lines 152-153 from:

Excercise (to be handed out)

to:

Excercise (to be handed out)

Changed lines 169-172 from:

Interface Inspection

Overview

  • Nielsen, J. and R. Mack (eds) ]] \\
to:

Interface Inspection

Overview

  1. Nielsen, J. and R. Mack (eds) ]] \\
Changed lines 177-178 from:

Usability Heuristics and Heuristic Evaluation

to:

Usability Heuristics and Heuristic Evaluation

Changed line 182 from:
  1. * Molich, R. and Nielsen, J. \\
to:
  1. Molich, R. and Nielsen, J. \\
Changed line 186 from:
  1. * Nielsen, J. (1993) \\
to:
  1. Nielsen, J. (1993) \\
Changed line 195 from:
  1. * Nielsen, J. and R. Mack (eds) ]] \\
to:
  1. Nielsen, J. and R. Mack (eds) ]] \\
Changed line 200 from:
  • Nielsen, J. (1993) \\
to:
  1. Nielsen, J. (1993) \\
Changed lines 206-207 from:

Task-Centered Walkthroughs

to:

Task-Centered Walkthroughs

Changed lines 217-218 from:

Supplemental Readings

to:

Supplemental Readings

Changed lines 225-226 from:

Cognitive Walkthroughs

to:

Cognitive Walkthroughs

Changed lines 234-236 from:

Topics below here are optional and/or subject to change

to:

Topics below here are optional and/or subject to change

Deleted line 170:
Changed lines 172-175 from:
  1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
    • An exectuive summary and discussion of inspection methods.
to:
  • Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
Changed lines 182-183 from:
  1. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
to:
  1. * Molich, R. and Nielsen, J.
    Improving a human-computer dialog. Comm ACM, 33(3), 1990
Changed lines 186-188 from:
  1. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
  1. * Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Changed lines 191-192 from:
  1. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
to:
  1. Nielsen, J. (1994)
    Enhancing the explanatory power of usability heuristics. In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
Changed lines 195-197 from:
  1. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
  1. * Nielsen, J. and R. Mack (eds) ]]
    Usability Inspection Methods, p25-62, Wiley and Sons. (1994)
Changed lines 200-202 from:
  1. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
to:
Changed line 117 from:
  • Gomoll, Kathleen & Nicol, Anne (1990) \\
to:
  1. Gomoll, Kathleen & Nicol, Anne (1990) \\
Changed lines 112-114 from:
  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Changed lines 117-118 from:
  1. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
to:
Changed lines 121-135 from:
to:
Changed lines 140-141 from:
  1. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
to:
  1. O'Malley, C., Draper, S. and Riley, M.
    Constructive interaction: A method for studying user-computer-user interaction. (1984) From Proceedings of Interact '84, p1-5.
Changed lines 144-145 from:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
  1. Kennedy, S.
    Using video in the BNR usability lab. SIGCHI Bulletin, 21(2), p92-95, ACM Press.(1989)
Changed lines 148-149 from:
  1. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
to:
  1. Neal, L.
    The use of video in empirical research. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
Changed lines 92-98 from:
  1. Chapter 4: Experimental methodology;
    Chapter 5: Experimental designs and analysis;
    Chapter 6: Hazards to conducting and interpreting HCI experiments
    • From Eberts, R.E. (1994) User Interface Design, Prentice Hall.
    • A general and high level introduction to experimental design.
  2. Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
to:
  1. * Eberts, R.E.
    User Interface Design, Prentice Hall 1994
  2. Greenberg, S. and Witten, I. (1984)
    Comparison of menu displays for ordered lists. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
Changed line 56 from:
to:
Changed lines 53-54 from:
  1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
to:
  1. Nielsen, J. (1993)
    Usability Engineering, p273-4, Academic Press.
Changed lines 38-40 from:
  1. Chapter 11: Evaluation Techniques . Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
to:
  1. Dix, A., Finlay, J., Abowd, G., and Beale, R.
    Human Computer Interaction, 2nd Edition. Prentice Hall. 1998
Added lines 42-46:
  1. McGrath, J.
    Methodology matters: Doing research in the behavioural and social sciences. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
    • See also a student-created summary by Stephanie Smale
    • This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
Changed lines 48-52 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
    • This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
    • see the summary chart of this paper, produced by Stephanie Smale
  2. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
  1. Norman, D. Applying the Behavioral, Cognitive, and Social Sciences to Products. Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
Deleted line 33:
  • Lecture notes for the talk I give to the class.
Changed line 35 from:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
December 01, 2006, at 03:26 PM by 136.159.7.242 -
Changed line 279 from:
  1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
to:
  1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
Changed line 282 from:
  1. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
to:
  1. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
Changed line 285 from:
  1. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
to:
  1. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
Changed line 288 from:
  1. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
  1. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed line 290 from:
  1. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
  1. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
Changed lines 292-293 from:
  1. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
to:
  1. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
December 01, 2006, at 02:30 PM by 136.159.7.242 -
Changed line 186 from:
  1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
to:
  1. Overview of Task Centered Walkthrough Powerpoint or Adobe PDF
Changed line 192 from:
  1. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
to:
  1. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
Changed line 205 from:
  1. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
  1. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 208 from:
  1. Walkthroughs in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
to:
  1. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
December 01, 2006, at 02:16 PM by 136.159.7.242 -
Changed line 171 from:
  1. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
  1. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
December 01, 2006, at 02:13 PM by 136.159.7.242 -
December 01, 2006, at 02:13 PM by 136.159.7.242 -
Changed line 165 from:
  1. Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
to:
  1. Overview of Heuristic Evaluation Powerpoint or Adobe PDF]
Changed line 171 from:
  1. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
  1. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
Changed line 177 from:
  1. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
  1. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 180 from:
  1. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
to:
  1. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
December 01, 2006, at 02:05 PM by 136.159.7.242 -
Changed line 159 from:
  1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
to:
  1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
December 01, 2006, at 02:02 PM by 136.159.7.242 -
Changed line 142 from:
to:
Changed lines 151-154 from:
to:
December 01, 2006, at 01:59 PM by 136.159.7.242 -
Changed line 126 from:
  1. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
to:
  1. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
Changed line 132 from:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
December 01, 2006, at 01:39 PM by 136.159.7.242 -
Changed line 100 from:
to:
Changed line 106 from:
  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
December 01, 2006, at 12:05 PM by 136.159.7.242 -
Changed line 88 from:
  1. [[Attach:Exec4-6.pdf|Chapter 4: Experimental methodology;\\
to:
  1. [[Attach:Chap4-6.pdf|Chapter 4: Experimental methodology;\\
December 01, 2006, at 11:59 AM by 136.159.7.242 -
Changed lines 81-82 from:
  1. Quantitative methods [Powerpoint or Adobe PDF]
    Analysis of Variance [Powerpoint or Adobe PDF]\\
to:
  1. Quantitative methods Powerpoint or Adobe PDF
    Analysis of Variance Powerpoint or Adobe PDF\\
December 01, 2006, at 10:44 AM by 136.159.7.242 -
Changed line 69 from:
  • A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
to:
  • A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
December 01, 2006, at 10:42 AM by 136.159.7.242 -
Changed line 59 from:
  • This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
to:
  • This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
December 01, 2006, at 10:38 AM by 136.159.7.242 -
Changed line 55 from:
  1. Research Participants' Bill of Rights by Tim Rogers also as PDF]
to:
  1. Research Participants' Bill of Rights by Tim Rogers also as PDF
December 01, 2006, at 10:37 AM by 136.159.7.242 -
Changed line 55 from:
  1. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
to:
  1. Research Participants' Bill of Rights by Tim Rogers also as PDF]
December 01, 2006, at 10:36 AM by 136.159.7.242 -
Changed line 53 from:
  • A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
to:
  • A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
December 01, 2006, at 10:32 AM by 136.159.7.242 -
Changed line 52 from:
  1. Text- Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
to:
  1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
December 01, 2006, at 10:28 AM by 136.159.7.242 -
Changed line 42 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 46 from:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
December 01, 2006, at 10:22 AM by 136.159.7.242 -
Changed lines 32-33 from:
to:
Changed line 42 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 42 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 36 from:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
Changed line 42 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
November 29, 2006, at 03:47 PM by 136.159.7.242 -
Changed lines 252-253 from:
  1. Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
to:
  1. Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
November 29, 2006, at 03:45 PM by 136.159.7.242 -
Changed lines 252-253 from:
  1. Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
to:
  1. Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
Changed lines 260-262 from:
  1. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html
to:
  1. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com
November 29, 2006, at 03:14 PM by 136.159.7.242 -
November 29, 2006, at 03:14 PM by 136.159.7.242 -
Changed line 55 from:
to:
  1. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
November 29, 2006, at 03:05 PM by 136.159.7.242 -
Changed line 46 from:
to:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
November 29, 2006, at 03:04 PM by 136.159.7.242 -
Changed line 46 from:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
November 29, 2006, at 02:40 PM by 136.159.7.242 -
Changed lines 212-214 from:

Topics below here are optional and/or subject to change

to:

Topics below here are optional and/or subject to change

Changed lines 252-253 from:
  1. First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational. Jakob Nielsen, Alertbox, August 5, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
to:
  1. Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
Changed lines 260-262 from:
  1. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html
to:
  1. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html
Changed line 279 from:
  1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
to:
  1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
Changed line 282 from:
  1. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
to:
  1. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
Changed line 285 from:
  1. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
to:
  1. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
Changed line 288 from:
  1. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
  1. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed line 290 from:
  1. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
  1. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
Changed lines 292-293 from:
  1. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
to:
  1. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
November 29, 2006, at 02:33 PM by 136.159.7.242 -
Added line 97:
Added line 103:
November 29, 2006, at 02:32 PM by 136.159.7.242 -
Added line 194:
Changed line 196 from:
  • Describes task-centered system design and how tasks are used to define walkthroughs.
to:
  • Describes task-centered system design and how tasks are used to define walkthroughs.
Changed line 198 from:
  • The book that started it off. The above reading is in this book
to:
  • The book that started it off. The above reading is in this book
November 29, 2006, at 02:30 PM by 136.159.7.242 -
Changed line 214 from:

Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.

to:
  1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
Changed lines 232-233 from:
  • Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
to:
  • Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
Changed lines 235-236 from:
  • Experiences with Pictive and recommendations.
to:
  • Experiences with Pictive and recommendations.
Changed lines 238-239 from:
  • Describes a sophisticated video prototyping project.
to:
  • Describes a sophisticated video prototyping project.
Changed lines 241-243 from:
  • Describes a system that lets people sketch and storyboard through a live computer interface.
to:
  • Describes a system that lets people sketch and storyboard through a live computer interface.
November 29, 2006, at 02:26 PM by 136.159.7.242 -
Changed line 85 from:
  1. To read again: . Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
  1. To read again: . Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
November 29, 2006, at 02:24 PM by 136.159.7.242 -
Changed lines 214-216 from:
   1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
          * Describes different styles of prototypes and how they can be used within scenarios.
to:

Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.

  • Describes different styles of prototypes and how they can be used within scenarios.
Changed lines 217-218 from:
   2. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
          * A simple way to build low fidelity prototypes, similar to Pictive
to:
  1. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
    • A simple way to build low fidelity prototypes, similar to Pictive
Changed lines 220-221 from:
   3. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
          * When are where you should use low vs. high fidelity prototypes
to:
  1. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
    • When are where you should use low vs. high fidelity prototypes
Changed lines 223-224 from:
   4. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
          * A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
to:
  1. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
    • A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
Changed lines 226-243 from:
   5. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
          * The first description of the Wizard of Oz prototyping/testing method.

Supplemental Readings

    * Prototyping an intelligent agent through Wizard of Oz. Maulsby, D., Greenberg, S. and Mander, R. (1993).  Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
          o Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.

    * Retrospective on a year of participatory design using the PICTIVE technique Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 
          o Experiences with Pictive and recommendations.

    * The “Starfire” video prototype project: a case history Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
          o Describes a sophisticated video prototyping project.

    * Interactive sketching for the early stages of user interface design. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
          o Describes a system that lets people sketch and storyboard through a live computer interface.
to:
  1. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
    • The first description of the Wizard of Oz prototyping/testing method.

Supplemental Readings

Changed lines 247-254 from:

Introduction

   1. First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.  Jakob Nielsen, Alertbox, August 5, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html

Contextual Inquiry

   1. Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
to:

Introduction

  1. First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational. Jakob Nielsen, Alertbox, August 5, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html

Contextual Inquiry

  1. Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
Changed line 255 from:
   2. Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
to:
  1. Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
Changed lines 257-262 from:
   3. Getting Started with Contextual Techniques. Incontext, Inc.  http://www.incent.com/connection.indx/techniques.html

Ethnography

   1. Chapter 3: Social Computing. In Dourish, P. (2001)  Where the Action Is. MIT Press. p55-97.
          * Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.
to:
  1. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html

Ethnography

  1. Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.
    • Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.
Changed line 265 from:
   2. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992)  in Proc CSCW'92, p123-129, November.
to:
  1. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
Changed line 267 from:
   3. Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994)  In Proc CSCW'94, p429439, ACM Press.
to:
  1. Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994) In Proc CSCW'94, p429439, ACM Press.
Changed lines 269-272 from:
   4. Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
          * Excerpts: Sections 3, 4,5,7
to:
  1. Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
    • Excerpts: Sections 3, 4,5,7
Changed lines 276-277 from:
   1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press.  p207-225
          * Introduces observations, questionnaires and interviews, focus groups, logging, user feedback, and how to choose between them.
to:
  1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
    • Introduces observations, questionnaires and interviews, focus groups, logging, user feedback, and how to choose between them.
Changed lines 279-280 from:
   2. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
          * The authors associate a variety of methodological approaches to specific interface design activities.
to:
  1. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
    • The authors associate a variety of methodological approaches to specific interface design activities.
Changed lines 282-283 from:
   3. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
          * Provides an overview of previous comparative studies of evaluation methods.
to:
  1. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
    • Provides an overview of previous comparative studies of evaluation methods.
Changed line 285 from:
   4. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
  1. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed line 287 from:
   5. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
  1. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
Changed lines 289-291 from:
   6. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2004

to:
  1. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2004

November 29, 2006, at 02:10 PM by 136.159.7.242 -
November 29, 2006, at 02:07 PM by 136.159.7.242 -
Changed line 124 from:
  1. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
to:
  1. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
Changed line 127 from:
  1. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
to:
  1. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
Changed line 130 from:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
Changed line 133 from:
  1. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
to:
  1. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
Changed line 140 from:
  • Download the full handout, which contains:
to:
Changed lines 149-152 from:
  • The system is available here, as an installable .exe
  • The presentation, in powerpoint
to:
Changed line 157 from:
  1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
to:
  1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
Changed line 202 from:
  1. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
  1. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 205 from:
  1. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
to:
  1. Walkthroughs in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
Changed line 215 from:
   1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
to:
   1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
Changed line 218 from:
   2. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
to:
   2. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
Changed line 221 from:
   3. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
to:
   3. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
Changed line 224 from:
   4. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
to:
   4. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
Changed line 227 from:
   5. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
to:
   5. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
Changed line 232 from:
    * Prototyping an intelligent agent through Wizard of Oz. Maulsby, D., Greenberg, S. and Mander, R. (1993).  Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
to:
    * Prototyping an intelligent agent through Wizard of Oz. Maulsby, D., Greenberg, S. and Mander, R. (1993).  Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
Changed lines 234-235 from:
    * Retrospective on a year of participatory design using the PICTIVE technique Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 
to:
    * Retrospective on a year of participatory design using the PICTIVE technique Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 
Changed lines 237-238 from:
    * The “Starfire” video prototype project: a case history Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
to:
    * The “Starfire” video prototype project: a case history Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
Changed line 241 from:
    * Interactive sketching for the early stages of user interface design. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
to:
    * Interactive sketching for the early stages of user interface design. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
November 29, 2006, at 02:01 PM by 136.159.7.242 -
Changed line 85 from:
  1. To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
  1. To read again: . Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
Changed lines 88-90 from:
  1. Chapter 4: Experimental methodology;
    Chapter 5: Experimental designs and analysis;
    Chapter 6: Hazards to conducting and interpreting HCI experiments
to:
Changed lines 93-94 from:
  1. Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
to:
  1. Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
Changed line 99 from:
  1. Mouse-Typing on Phone Pads and Keyboards
to:
Changed line 104 from:
  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
Changed line 107 from:
  1. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
to:
  1. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
Changed lines 112-122 from:
  • 2: Introducing usability testing
  • 6: Establishing a usability program in your organization
  • 7: Planning a usability test
  • 9: Deciding who should be participants
  • 11: Selecting and organizing tasks to test
  • 12: Creating task scenarios
  • 15: Preparing the testing environment
  • 18: Caring for the test participants
  • 19: Conducting the test
  • Appendix A: Setting up a usability laboratory
  • All of the above as a single PDF
to:
November 29, 2006, at 01:57 PM by 136.159.7.242 -
November 29, 2006, at 01:57 PM by 136.159.7.242 -
Changed lines 193-197 from:
    * Getting to Know Users and their Tasks. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
          o Describes task-centered system design and how tasks are used to define walkthroughs.
    * Task-Centered User Interface Design:  A Practical Introduction.  Lewis, C. and Rieman, J. (1993) Available as Shareware.
          o The book that started it off. The above reading is in this book
to:
Changed lines 201-202 from:
   6. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
          * This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
to:
  1. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
    • This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
Changed lines 204-206 from:
   7. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
          * This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
to:
  1. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
    • This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
November 29, 2006, at 01:55 PM by 136.159.7.242 -
Changed line 165 from:
  1. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
to:
  1. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
Changed line 168 from:
  1. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
  1. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
Changed line 171 from:
  1. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
to:
  1. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
Changed line 174 from:
  1. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
  1. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 177 from:
  1. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
to:
  1. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
Changed lines 183-184 from:
   1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
          * My presentation that I give in CPSC 481
to:
  1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
    • My presentation that I give in CPSC 481
Changed lines 186-187 from:
   2. Working through task-centered system design. Greenberg, S.  in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
          * A how-to approach to task-centered system design.
to:
  1. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
    • A how-to approach to task-centered system design.
Changed lines 189-194 from:
   3. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994)  In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
          * Describe the steps in the pluralistic walkthough process.

Supplemental Readings

    * Getting to Know Users and their Tasks. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
to:
  1. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
    • Describe the steps in the pluralistic walkthough process.

Supplemental Readings

    * Getting to Know Users and their Tasks. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
Changed line 196 from:
    * Task-Centered User Interface Design:  A Practical Introduction.  Lewis, C. and Rieman, J. (1993) Available as Shareware.
to:
    * Task-Centered User Interface Design:  A Practical Introduction.  Lewis, C. and Rieman, J. (1993) Available as Shareware.
Changed lines 200-201 from:

Cognitive Walkthroughs

to:

Cognitive Walkthroughs

November 29, 2006, at 01:49 PM by 136.159.7.242 -
Changed line 85 from:
  1. To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
  1. To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
November 29, 2006, at 01:48 PM by 136.159.7.242 -
Changed line 139 from:
  • Download the full handout, which contains
to:
  • Download the full handout, which contains:
Deleted line 155:
Changed line 162 from:
  1. Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
to:
  1. Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
Added lines 164-169:
  1. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
    • This article lists the heuristics and presents a working example, solutions, and alternatives.
  2. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
    • Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.
Changed lines 171-172 from:
   2. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
          * This article lists the heuristics and presents a working example, solutions, and alternatives.
to:
  1. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
    • This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.
Changed lines 174-175 from:
   3. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
          * Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.
to:
  1. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
    • A more in depth discussion of how heuristic evaluation works and its reliability
Changed lines 177-178 from:
   4. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
          * This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.
to:
  1. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
    • Another example, with answers, of a heuristic evaluation.
Changed lines 180-181 from:
   5. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
          * A more in depth discussion of how heuristic evaluation works and its reliability
to:

Task-Centered Walkthroughs

   1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
          * My presentation that I give in CPSC 481
Changed lines 186-187 from:
   6. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
          * Another example, with answers, of a heuristic evaluation.
to:
   2. Working through task-centered system design. Greenberg, S.  in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
          * A how-to approach to task-centered system design.
Deleted lines 188-196:

Task-Centered Walkthroughs

   1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
          * My presentation that I give in CPSC 481

   2. Working through task-centered system design. Greenberg, S.  in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
          * A how-to approach to task-centered system design.
November 29, 2006, at 01:42 PM by 136.159.7.242 -
Changed line 82 from:

Analysis of Variance [Powerpoint or Adobe PDF]

to:

Analysis of Variance [Powerpoint or Adobe PDF]\\

November 29, 2006, at 01:41 PM by 136.159.7.242 -
Changed lines 81-84 from:
  1. Quantitative methods [Powerpoint or Adobe PDF]
      Analysis of Variance [Powerpoint or Adobe PDF]
          * Lecture notes for the talk I give to the class.
to:
  1. Quantitative methods [Powerpoint or Adobe PDF]
    Analysis of Variance [Powerpoint or Adobe PDF]
  • Lecture notes for the talk I give to the class.
Changed line 86 from:
          * the chapter you previously read includes a section on controlled experiments
to:
  • the chapter you previously read includes a section on controlled experiments
Changed lines 88-92 from:
  1. Chapter 4: Experimental methodology;
      Chapter 5: Experimental designs and analysis;
      Chapter 6: Hazards to conducting and interpreting HCI experiments
      From Eberts, R.E. (1994) User Interface Design, Prentice Hall.
          * A general and high level introduction to experimental design.
to:
  1. Chapter 4: Experimental methodology;
    Chapter 5: Experimental designs and analysis;
    Chapter 6: Hazards to conducting and interpreting HCI experiments
    • From Eberts, R.E. (1994) User Interface Design, Prentice Hall.
    • A general and high level introduction to experimental design.
Changed lines 94-100 from:
          * This paper describes the first experiment I ever did, and is an example of how statistical methods  can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards
      We will perform a 'pilot' controlled study on how people perform on different types of keyboards
to:
  • This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise

  1. Mouse-Typing on Phone Pads and Keyboards

We will perform a 'pilot' controlled study on how people perform on different types of keyboards

Changed line 103 from:
  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
Changed line 106 from:
  1. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
to:
  1. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
Changed line 109 from:
  1. Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
to:
  1. Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
Changed line 123 from:
  1. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
to:
  1. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
Changed line 126 from:
  1. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
to:
  1. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
Changed line 129 from:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
Changed line 132 from:
  1. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
to:
  1. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
Changed lines 135-137 from:

Excercise (to be handed out)

  1. Get real with IBM RealPhone
to:

Excercise (to be handed out)

  1. Get real with IBM RealPhone
November 29, 2006, at 12:01 PM by 136.159.7.242 -
Changed lines 80-82 from:

Experimental methodologies

   1. Quantitative methods [Powerpoint or Adobe PDF]
to:

Experimental methodologies

  1. Quantitative methods [Powerpoint or Adobe PDF]
Changed lines 84-86 from:
   2.

      To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
  1. To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
Changed line 88 from:
   3. Chapter 4: Experimental methodology;
to:
  1. Chapter 4: Experimental methodology;
Changed lines 93-95 from:
   4.

      Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
to:
  1. Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
Changed line 98 from:
   5. Mouse-Typing on Phone Pads and Keyboards
to:
  1. Mouse-Typing on Phone Pads and Keyboards
Changed lines 101-104 from:

Usability Testing

   1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press.  Extract
          * An excellent overview to various usability testing methodologies.
to:

Usability Testing

  1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
    • An excellent overview to various usability testing methodologies.
Changed lines 106-107 from:
   2. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
          * This reading is an excellent recipe for performing usability studies.
to:
  1. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
    • This reading is an excellent recipe for performing usability studies.
Changed lines 109-121 from:
   3. Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
          * An in-depth treatment of usability testing. The chapters we use are:
                o 2: Introducing usability testing
                o 6: Establishing a usability program in your organization
                o 7: Planning a usability test
                o 9: Deciding who should be participants
                o 11: Selecting and organizing tasks to test
                o 12: Creating task scenarios
                o 15: Preparing the testing environment
                o 18: Caring for the test participants
                o 19: Conducting the test
                o Appendix A: Setting up a usability laboratory
                o All of the above as a single PDF
to:
  1. Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
    • An in-depth treatment of usability testing. The chapters we use are:
      • 2: Introducing usability testing
      • 6: Establishing a usability program in your organization
      • 7: Planning a usability test
      • 9: Deciding who should be participants
      • 11: Selecting and organizing tasks to test
      • 12: Creating task scenarios
      • 15: Preparing the testing environment
      • 18: Caring for the test participants
      • 19: Conducting the test
      • Appendix A: Setting up a usability laboratory
      • All of the above as a single PDF
Changed lines 123-124 from:
   4. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
          * Tips and reasons for including developers as part of the evaluation team.
to:
  1. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
    • Tips and reasons for including developers as part of the evaluation team.
Changed lines 126-127 from:
   5. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
          * Describes a method for observing people working together.
to:
  1. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
    • Describes a method for observing people working together.
Changed lines 129-130 from:
   6. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
          * As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.
to:
  1. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
    • As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.
Changed lines 132-134 from:
   7. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
          * Further reasons why one should videotape usability sessions.
to:
  1. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
    • Further reasons why one should videotape usability sessions.
Changed lines 137-151 from:
   8. Get real with IBM RealPhone
          * We will perform a usability study on IBM's RealPhone system
          * Download the full handout, which contains
                o the presentation
                o evaluator's instructions and tasks
                o consent form
                o Pre-test, During-test and Post-test questions
                o methods for running a basic observational study
                o discussion of guidelines for user observation
                o IBM Real Phone Instruction Sheet and their test-drive instructions
                o Isys' Hall of Shame critique of RealPhone
          * The system is available here, as an installable .exe
          * The presentation, in powerpoint
to:
  1. Get real with IBM RealPhone
    • We will perform a usability study on IBM's RealPhone system
    • Download the full handout, which contains
      • the presentation
      • evaluator's instructions and tasks
      • consent form
      • Pre-test, During-test and Post-test questions
      • methods for running a basic observational study
      • discussion of guidelines for user observation
      • IBM Real Phone Instruction Sheet and their test-drive instructions
      • Isys' Hall of Shame critique of RealPhone
    • The system is available here, as an installable .exe
    • The presentation, in powerpoint
Changed lines 155-158 from:

Overview

   1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
          * An exectuive summary and discussion of inspection methods.
to:

Overview

  1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
    • An exectuive summary and discussion of inspection methods.
Changed lines 161-164 from:

Usability Heuristics and Heuristic Evaluation

   1. Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
          * My presentation that I give in CPSC 481
to:

Usability Heuristics and Heuristic Evaluation

  1. Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
    • My presentation that I give in CPSC 481
November 29, 2006, at 11:56 AM by 136.159.7.242 -
Changed lines 69-76 from:
  • A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
    • Instructions for Ethics Review Applicants
    • Ethics review application form
    • Sample consent form

Supplemental Readings available in the Optional Readings sections

to:

Supplemental Readings available in the Optional Readings sections

Changed lines 82-83 from:
   1. Quantitative methods [Powerpoint or Adobe PDF]
      Analysis of Variance [Powerpoint or Adobe PDF]
to:
   1. Quantitative methods [Powerpoint or Adobe PDF]
      Analysis of Variance [Powerpoint or Adobe PDF]
November 29, 2006, at 11:54 AM by 136.159.7.242 -
Changed lines 52-53 from:
  1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
    • A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
to:
  1. Text- Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
    • A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
Changed line 55 from:
  1. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
to:
Changed lines 58-59 from:
  1. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
    • This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
to:
  1. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
    • This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
November 29, 2006, at 11:52 AM by 136.159.7.242 -
Changed line 32 from:
  1. Overview of methodologies [Powerpoint]
to:
Changed line 36 from:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
Changed line 39 from:
  1. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
to:
  1. Chapter 11: Evaluation Techniques . Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
Changed line 42 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 46 from:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
November 29, 2006, at 11:50 AM by 136.159.7.242 -
Changed lines 18-21 from:
  1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
  2. Usability Engineering, Nielsen, J. (1993) Academic Press.
  3. Papers of the remaining readings will be made available to you at cost.
to:
  1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
  2. Usability Engineering, Nielsen, J. (1993) Academic Press.
  3. Papers of the remaining readings will be made available to you at cost.
Changed lines 24-26 from:
  1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
to:
  1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
November 29, 2006, at 11:49 AM by 136.159.7.242 -
Changed lines 32-34 from:
  1. Overview of methodologies [Powerpoint]
    * also as [Adobe PDF]
  • Lecture notes for the talk I give to the class.
to:
  1. Overview of methodologies [Powerpoint]
    • also as [Adobe PDF]
    • Lecture notes for the talk I give to the class.
Changed lines 36-37 from:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
    * This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
to:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
    • This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
Changed lines 39-40 from:
  1. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
    * This useful overview chapter briefly surveys a variety of methodologies.
to:
  1. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
    • This useful overview chapter briefly surveys a variety of methodologies.
Changed lines 42-44 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
    * This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
  • see the summary chart of this paper, produced by Stephanie Smale
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
    • This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
    • see the summary chart of this paper, produced by Stephanie Smale
Changed lines 46-49 from:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
    * This essay contrasts the academic vs business approach to product development.
to:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
    • This essay contrasts the academic vs business approach to product development.
Changed lines 52-54 from:
   1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press.  (Read extract p181-185)
          * A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
to:
  1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
    • A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
Changed lines 55-56 from:
   2. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
          * A concise statement of what participant's should expect as fair treatment
to:
  1. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
    • A concise statement of what participant's should expect as fair treatment
Changed lines 58-66 from:
   3. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
          * This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
                o Section 1 - verify that your work requires ethics clearance,
                o Section 6 - if your application concerns course-based research,
                o Section 8 for your procedural responsibilities
                o Section 9 for guidelines on balancing risks vs benefits
                o Section 10 on how to do informed consent
                o Section 11 for guidelines on deception (research involving any deception is usually considered risky)
                o Section 12 for guidelines on maintaining privacy and confidentiality
to:
  1. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
    • This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
      • Section 1 - verify that your work requires ethics clearance,
      • Section 6 - if your application concerns course-based research,
      • Section 8 for your procedural responsibilities
      • Section 9 for guidelines on balancing risks vs benefits
      • Section 10 on how to do informed consent
      • Section 11 for guidelines on deception (research involving any deception is usually considered risky)
      • Section 12 for guidelines on maintaining privacy and confidentiality
Changed lines 68-76 from:
   4. Ethics application
          * A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
                o Instructions for Ethics Review Applicants
                o Ethics review application form
                o Sample consent form

Supplemental Readings available in the Optional Readings sections

to:
  1. Ethics application
    • A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
      • Instructions for Ethics Review Applicants
      • Ethics review application form
      • Sample consent form

Supplemental Readings available in the Optional Readings sections

November 29, 2006, at 11:45 AM by 136.159.7.242 -
Changed line 32 from:
  1. Overview of methodologies [Powerpoint]
to:
  1. Overview of methodologies [Powerpoint]\\
Changed line 36 from:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.\\
Changed line 39 from:
  1. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
to:
  1. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.\\
Changed line 42 from:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.\\
Changed line 46 from:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html\\
November 29, 2006, at 11:44 AM by 136.159.7.242 -
Changed lines 24-26 from:
   1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
to:
  1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
Changed lines 32-36 from:
   1. Overview of methodologies [Powerpoint]
          * also as [Adobe PDF]
          * Lecture notes for the talk I give to the class.
to:
  1. Overview of methodologies [Powerpoint]
  • also as [Adobe PDF]
  • Lecture notes for the talk I give to the class.
Changed lines 36-37 from:
   2. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
          * This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
to:
  1. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
  • This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
Changed lines 39-40 from:
   3. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
          * This useful overview chapter briefly surveys a variety of methodologies.
to:
  1. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
  • This useful overview chapter briefly surveys a variety of methodologies.
Changed lines 42-44 from:
   4. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
          * This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
          * see the summary chart of this paper, produced by Stephanie Smale
to:
  1. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
  • This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
  • see the summary chart of this paper, produced by Stephanie Smale
Changed lines 46-49 from:
   5. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
          * This essay contrasts the academic vs business approach to product development.
to:
  1. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
  • This essay contrasts the academic vs business approach to product development.
November 29, 2006, at 11:39 AM by 136.159.7.242 -
Changed lines 16-21 from:

Required

   1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
   2. Usability Engineering, Nielsen, J. (1993) Academic Press.
   3. Papers of the remaining readings will be made available to you at cost.
to:

Required:

  1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
  2. Usability Engineering, Nielsen, J. (1993) Academic Press.
  3. Papers of the remaining readings will be made available to you at cost.
November 29, 2006, at 11:38 AM by 136.159.7.242 -
Changed lines 9-10 from:

Course texts

to:

Course texts

Changed lines 26-27 from:

Overview of methodologies

to:

Overview of methodologies

Changed lines 51-52 from:

Ethics

to:

Ethics

Changed lines 78-82 from:

User Observation

to:

User Observation

Changed lines 158-159 from:

Interface Inspection

to:

Interface Inspection

Changed lines 217-219 from:

Topics below here are optional and/or subject to change Prototyping

to:

Topics below here are optional and/or subject to change

Prototyping

Changed lines 250-253 from:

Field Study Methodologies (tentative)

to:

Field Study Methodologies (tentative)

Added line 256:
Changed lines 279-280 from:

Comparing Methods

to:

Comparing Methods

November 29, 2006, at 11:34 AM by 136.159.7.242 -
Added lines 1-277:

(:title CPSC 681 - Main Reading List :)

back to CPSC 681

All papers are required reading unless otherwise noted.

Papers below the ruled line are not yet finalized. Course texts

You should buy these texts. Some of the readings below will be from them.

Required

   1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
   2. Usability Engineering, Nielsen, J. (1993) Academic Press.
   3. Papers of the remaining readings will be made available to you at cost.

Recommended

   1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.

Overview of methodologies

The following papers introduces (but do not detail) many methodologies. They also discuss and compare methodologies from various perspectives: to influence design, to evaluate products, to encourage end-user feedback, and to compare when and where each is useful. Because you do not yet know the details of these methodologies, the discussions in the papers may be hard to follow at times. Because these papers are just intended to give you a feel for the area, I suggest you give them a quick read now. As the course progresses, you will find that you will be able to go back to them for a more careful read.

   1. Overview of methodologies [Powerpoint]
          * also as [Adobe PDF]
          * Lecture notes for the talk I give to the class.

   2. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
          * This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

   3. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
          * This useful overview chapter briefly surveys a variety of methodologies.

   4. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
          * This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
          * see the summary chart of this paper, produced by Stephanie Smale

   5. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
          * This essay contrasts the academic vs business approach to product development.

Ethics

   1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press.  (Read extract p181-185)
          * A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.

   2. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
          * A concise statement of what participant's should expect as fair treatment

   3. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
          * This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
                o Section 1 - verify that your work requires ethics clearance,
                o Section 6 - if your application concerns course-based research,
                o Section 8 for your procedural responsibilities
                o Section 9 for guidelines on balancing risks vs benefits
                o Section 10 on how to do informed consent
                o Section 11 for guidelines on deception (research involving any deception is usually considered risky)
                o Section 12 for guidelines on maintaining privacy and confidentiality

   4. Ethics application
          * A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
                o Instructions for Ethics Review Applicants
                o Ethics review application form
                o Sample consent form

Supplemental Readings available in the Optional Readings sections User Observation Experimental methodologies

   1. Quantitative methods [Powerpoint or Adobe PDF]
      Analysis of Variance [Powerpoint or Adobe PDF]
          * Lecture notes for the talk I give to the class.
   2.

      To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
          * the chapter you previously read includes a section on controlled experiments

   3. Chapter 4: Experimental methodology;
      Chapter 5: Experimental designs and analysis;
      Chapter 6: Hazards to conducting and interpreting HCI experiments
      From Eberts, R.E. (1994) User Interface Design, Prentice Hall.
          * A general and high level introduction to experimental design.
   4.

      Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
          * This paper describes the first experiment I ever did, and is an example of how statistical methods  can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise

   5. Mouse-Typing on Phone Pads and Keyboards
      We will perform a 'pilot' controlled study on how people perform on different types of keyboards

Usability Testing

   1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press.  Extract
          * An excellent overview to various usability testing methodologies.

   2. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
          * This reading is an excellent recipe for performing usability studies.

   3. Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
          * An in-depth treatment of usability testing. The chapters we use are:
                o 2: Introducing usability testing
                o 6: Establishing a usability program in your organization
                o 7: Planning a usability test
                o 9: Deciding who should be participants
                o 11: Selecting and organizing tasks to test
                o 12: Creating task scenarios
                o 15: Preparing the testing environment
                o 18: Caring for the test participants
                o 19: Conducting the test
                o Appendix A: Setting up a usability laboratory
                o All of the above as a single PDF

   4. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
          * Tips and reasons for including developers as part of the evaluation team.

   5. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
          * Describes a method for observing people working together.

   6. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
          * As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.

   7. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
          * Further reasons why one should videotape usability sessions.

Excercise (to be handed out)

   8. Get real with IBM RealPhone
          * We will perform a usability study on IBM's RealPhone system
          * Download the full handout, which contains
                o the presentation
                o evaluator's instructions and tasks
                o consent form
                o Pre-test, During-test and Post-test questions
                o methods for running a basic observational study
                o discussion of guidelines for user observation
                o IBM Real Phone Instruction Sheet and their test-drive instructions
                o Isys' Hall of Shame critique of RealPhone
          * The system is available here, as an installable .exe
          * The presentation, in powerpoint

Interface Inspection

Overview

   1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
          * An exectuive summary and discussion of inspection methods.

Usability Heuristics and Heuristic Evaluation

   1. Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
          * My presentation that I give in CPSC 481

   2. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
          * This article lists the heuristics and presents a working example, solutions, and alternatives.

   3. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
          * Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.

   4. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
          * This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

   5. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
          * A more in depth discussion of how heuristic evaluation works and its reliability

   6. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
          * Another example, with answers, of a heuristic evaluation.

Task-Centered Walkthroughs

   1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
          * My presentation that I give in CPSC 481

   2. Working through task-centered system design. Greenberg, S.  in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
          * A how-to approach to task-centered system design.

   3. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994)  In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
          * Describe the steps in the pluralistic walkthough process.

Supplemental Readings

    * Getting to Know Users and their Tasks. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
          o Describes task-centered system design and how tasks are used to define walkthroughs.
    * Task-Centered User Interface Design:  A Practical Introduction.  Lewis, C. and Rieman, J. (1993) Available as Shareware.
          o The book that started it off. The above reading is in this book

Cognitive Walkthroughs

   6. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
          * This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.

   7. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
          * This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.

Topics below here are optional and/or subject to change Prototyping

   1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
          * Describes different styles of prototypes and how they can be used within scenarios.

   2. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
          * A simple way to build low fidelity prototypes, similar to Pictive

   3. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
          * When are where you should use low vs. high fidelity prototypes

   4. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
          * A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

   5. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
          * The first description of the Wizard of Oz prototyping/testing method.

Supplemental Readings

    * Prototyping an intelligent agent through Wizard of Oz. Maulsby, D., Greenberg, S. and Mander, R. (1993).  Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
          o Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
    * Retrospective on a year of participatory design using the PICTIVE technique Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 
          o Experiences with Pictive and recommendations.
    * The “Starfire” video prototype project: a case history Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
          o Describes a sophisticated video prototyping project.

    * Interactive sketching for the early stages of user interface design. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
          o Describes a system that lets people sketch and storyboard through a live computer interface.

Field Study Methodologies (tentative) Introduction

   1. First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.  Jakob Nielsen, Alertbox, August 5, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html

Contextual Inquiry

   1. Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.

   2. Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.

   3. Getting Started with Contextual Techniques. Incontext, Inc.  http://www.incent.com/connection.indx/techniques.html

Ethnography

   1. Chapter 3: Social Computing. In Dourish, P. (2001)  Where the Action Is. MIT Press. p55-97.
          * Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.

   2. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992)  in Proc CSCW'92, p123-129, November.

   3. Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994)  In Proc CSCW'94, p429439, ACM Press.

   4. Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
          * Excerpts: Sections 3, 4,5,7

Comparing Methods

   1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press.  p207-225
          * Introduces observations, questionnaires and interviews, focus groups, logging, user feedback, and how to choose between them.

   2. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
          * The authors associate a variety of methodological approaches to specific interface design activities.

   3. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
          * Provides an overview of previous comparative studies of evaluation methods.

   4. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.

   5. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.

   6. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2004