CPSC 681 - Main Reading List

CPSC681.MainReadingList History

Hide minor edits - Show changes to output

Changed lines 25-28 from:
! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED
to:
Deleted lines 27-30:
!!!Experimental methodologies
#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\
'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\
* Lecture notes for the talk I give to the class.
Changed lines 8-97 from:


# Muller, M. (1991) \\
[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

'''Supplemental Readings'''

* Muller, Michael J. \\
[[HCIPapers:muller-retrospective-chi92.pdf|'''Retrospective on a year of participatory design using the PICTIVE technique'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
** Experiences with Pictive and recommendations.

!!Field Study Methodologies

!!!Introduction
#Neustaedter, Carman '''Overview of Qualitative Data Analysis'''. [[HCILectures:qualitative-data-analysis-neustaedter.ppt |(Powerpoint)]] and [[HCILectures:qualitative-data-analysis-neustaedter.wmv |(Video)]] of his presenation

# Nielsen, J. \\
'''Jacob Nielsen's Alertbox'''
** [[HCIPapers:neilsen-alertbox-observe-field.pdf| First rule of usability? Don't listen to users AND Field Studies done right: Fast and observational,]] August 5, 2001 and January 20, 2002.
** [[http://www.useit.com/alertbox/20010805.html]]
** [[http://www.useit.com/alertbox/20020120.html|20020120.html]]

'''Contextual Inquiry'''

# Holtzblatt, K. and Jones, S. (1996)\\
'''Contextual Inquiry: A Participatory Approach.''' In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.

# Holtzblatt, K. and Beyer, H. (1993) \\
'''Contextual Design: Principles and Practice.''' In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.


'''Ethnography'''

# Dourish, P. (2001) \\
'''Where the Action Is. The Foundations of Embodied Interaction.''' MIT Press, Cambridge MMA.
** [[HCIPapers:dourish-wheretheactionis-ch3.pdf|Chapter 3: Social Computing]] p55-97.
** Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.

# Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) \\
'''Ethnographically-informed systems design for air traffic control''', in Proc CSCW'92, p123-129, November.

# Hughes, J., King, V., Rodden, T. and Andersen, H. \\
[[HCIPapers:hughes-ethnography-cscw94.pdf|'''Moving out of the control room: Ethnography in System Design'''.]] Proc ACM CSCW 1996.

# Randall, D. (1996) \\
Ethnography and Systems Development: Bounding the Intersection. Tutorial notes presented at CSCW'96.
** Excerpts: Sections 3, 4,5,7


!! Comparing Methods

# Greenberg, S. and Buxton, B. (2008) \\
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-UsabilityHarmful.CHI | ''Usability Evaluation Considered Harmful (Some of the Time)'']]. In Proceedings of the ACM Conference on Human Factors in Computing Systems - ACM CHI'08. (Florence, Italy), ACM Press, pages 111-120, April 5-10.

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch7-usability-assessment.pdf|Chapter 7: Usability Assessment Methods Beyond Testing]]
** Introduces observations, questionnaires and interviews, focus groups, logging, user feedback, and how to choose between them.

# Olson, J. and Moran, T. (1996) \\
[[HCIPapers:olson96-methods-muddle.pdf| '''Mapping the method muddle: Guidance in using methods for user interface design'''.]] In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
** The authors associate a variety of methodological approaches to specific interface design activities.

# Preece, J. et. al., (1994) \\
'''Human Computer Interaction,''' Addison-Wesley
** [[HCIPapers:preece94-ch34-comparing-methods.pdf| Chapter 34: Comparing methods.]] p691-707
** Provides an overview of previous comparative studies of evaluation methods.

# Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) \\
[[HCIPapers:jeffries91-ui-evaluation.pdf|'''User interface evaluation in the real world: A comparison of four techniques'''.]] In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.

# Karat, C., Campbell, R. and Fiegel, T. (1992) \\
[[HCIPapers:kaplan-Coevolution.pdf|'''Comparison of empirical testing and walkthrough methods in user interface evaluation'''.]] In ACM Conference on Human Factors in Computing Systems. 397-4044, ACM Press.

# Landauer, T. (1991) \\
[[HCIPapers:landauer-letsgetreal.pdf|'''Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems''',]] In J. Carroll (ed) Designing Interaction, Cambridge University Press.

# Steve M. Easterbrook and J. Singer and M.-A. Storey and D. Damian, 2007 \\
[[HCIPapers:easterbrook-selectingempiricalmethods.pdf |'''Selecting Empirical Methods for Software Engineering Research''']], In Forrest Shull, Janice Singer and Dag I. K. Sjoberg (Eds) Guide to Advanced Empirical Software Engineering, Springer, 285-311.

# Ioannidis, J. P. A. (2005) \\
[[HCIPapers:ioannidis-whymostpubfindingsarefalse.pdf | Why Most Published Research Findings Are False.]] PLoS Medicine, August; 2(8): e124. [[http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1182327 | link]]

# Norman, D. (various)
** [[http://jnd.org/dn.mss/technology_first_needs_last.html | Technology First, Needs Last]]
** [[http://www.jnd.org/dn.mss/filling_much_needed.html | Filling Much Needed Holes]]

to:
Changed lines 39-42 from:
'''Open Coding'''
* Strauss, A. and Corbin, J. (1998) \\
'''Basics of Qualitative Research''', 2nd Edition. Sage Publications.
** [[HCIPapers:strauss-opencoding.pdf|Chapter 8. Open Coding.]]
to:
Deleted lines 13-16:
# Gould, J., Conti, J., and Hovanyecz, T. (1981) \\
[[HCIPapers:gould-composing-cacm83.pdf|'''Composing letters with a simulated listening typewriter'''.]] Communications of the ACM, 26(4), 295-308. ACM Press.
** The first description of the Wizard of Oz prototyping/testing method.
Changed lines 9-30 from:
!! Interface Inspection

!!!Overview
# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods
,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch1-executive-summary.pdf|Chapter 1: Executive summary
. p1-23]]
** An exectuive summary and discussion of inspection methods.

!!!Usability Heuristics and Heuristic Evaluation

#'''Overview of Heuristic Evaluation''' [[Attach:Heuristic.ppt|Powerpoint]] or [[Attach:Heuristic.pdf|Adobe PDF]]
** My presentation that I give in CPSC 481

# Molich, R. and Nielsen, J. \\
[[HCIPapers:molich-nielsen-improving.pdf|'''Improving a human-computer dialog'''.]] Comm ACM, 33(3), 1990
** This article lists the heuristics and presents a working example, solutions, and alternatives.

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch5-usab-heuristics.pdf|Chapter 5: Usability heuristics. p115-163]]
** Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.
to:

# Muller
, M. (1991) \\
[[HCIPapers:muller-pictive-chi91
.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
Changed lines 14-42 from:
# Nielsen, J. (1994) \\
[[HCIPapers:nielsen-enhancing-chi94.pdf| '''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation.pdf|Chapter 2: Heuristic evaluation. ]] [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation-2pages.pdf| as 2 pages per side]]
** A more in depth discussion of how heuristic evaluation works and its reliability

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengappendix-travel-weather.pdf|Exercise 8: Heuristic Evaluation of a Paper Mock-Up. ]]
** Another example, with answers, of a heuristic evaluation.


!!!Task-Centered Walkthroughs

# '''Overview of Task Centered Walkthrough''' [[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
** My presentation that I give in CPSC 481

# Greenberg, S. \\
[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|'''Working through task-centered system design''']]. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
** A how-to approach to task-centered system design.

# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch3-pluralistic.pdf|Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. ]]
** Describe the steps in the pluralistic walkthough process.
to:
# Gould, J., Conti, J., and Hovanyecz, T. (1981) \\
[[HCIPapers:gould-composing-cacm83.pdf|'''Composing letters with a simulated listening typewriter'''.]] Communications of the ACM, 26(4), 295-308. ACM Press.
** The first description of the Wizard of Oz prototyping/testing method.
Changed lines 19-63 from:
# Lewis, C. and Rieman, J. (1993) \\
[[HCIPapers:lewisriemanbook-index.html|'''Task-Centered User Interface Design: A Practical Introduction.''' ]] Available as Shareware.
** The book that started it off.
** Read the chapter '''Getting to Know Users and their Tasks.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

!!!Cognitive Walkthroughs

# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch5-cognitive-walkthrough.pdf|Chapter 5: The Cognitive Walkthrough Method: A Practitioner's Guide. ]] Wharton, C., Rieman, J. Lewis, C. and Polson, P. p25-62
** This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.

# Preece, J. et. al., (1994) \\
'''Human Computer Interaction,''' Addison-Wesley
** [[HCIPapers:preece94-cogwalkthroughs.pdf| Walkthroughs (Excerpt)]], page 679-684

!! Prototyping

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch4.8-prototyping.pdf|Chapter 4.8 Prototyping. (Extract)]] p93-101. [[HCIPapers:nielson93-usabilityengch4.8-prototyping-2page.pdf|(also as 2 pages / side )]]
** Describes different styles of prototypes and how they can be used within scenarios.

# Rettig, M. (1994) \\
[[HCIPapers:rettig94-protyping.pdf| '''Prototyping for tiny fingers'''.]] Communications of the ACM, 37(4), ACM Press
** A simple way to build low fidelity prototypes, similar to Pictive

# Rudd, J., Stern, K. and Isensee, S. (1996) \\
[[HCIPapers:rudd96-prototyping.pdf| '''Low vs. high fidelity prototyping debate'''.]] Interactions 3(1), p76-85, ACM Press.
** When are where you should use low vs. high fidelity prototypes

# Muller, M. (1991) \\
[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

# Gould, J., Conti, J., and Hovanyecz, T. (1981) \\
[[HCIPapers:gould-composing-cacm83.pdf|'''Composing letters with a simulated listening typewriter'''.]] Communications of the ACM, 26(4), 295-308. ACM Press.
** The first description of the Wizard of Oz prototyping/testing method.

'''Supplemental Readings'''

* Maulsby, D., Greenberg, S. and Mander, R. (1993). \\
[[http://grouplab.cpsc.ucalgary.ca/papers/1993/93-Woz.CHI/93-woz.chi.pdf|'''Prototyping an intelligent agent through Wizard of Oz''']]. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
** Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
to:
Deleted lines 22-25:

* Landay, James A., and Brad A. Myers \\
[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
** Describes a system that lets people sketch and storyboard through a live computer interface.
Changed lines 10-12 from:
# ''(optional)'' Ehrlich, K., Butler, M. and Pernce, K. \\
[[HCIPapers:ehrlich-usab-testing.pdf|'''Getting the whole team into usability testing.''' ]] IEEE Software, p89-90. (1994)
** Tips and reasons for including developers as part
of the evaluation team.
to:
!! Interface Inspection

!!!Overview
# Nielsen
, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94
-inspection-ch1-executive-summary.pdf|Chapter 1: Executive summary. p1-23]]
** An exectuive summary and discussion
of inspection methods.

!!!Usability Heuristics and Heuristic Evaluation

#'''Overview of Heuristic Evaluation''' [[Attach:Heuristic.ppt|Powerpoint]] or [[Attach:Heuristic.pdf|Adobe PDF]]
** My presentation that I give in CPSC 481

# Molich, R. and Nielsen, J. \\
[[HCIPapers:molich-nielsen-improving.pdf|'''Improving a human-computer dialog'''.]] Comm ACM, 33(3), 1990
** This article lists the heuristics and presents a working example, solutions, and alternatives.

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch5-usab-heuristics.pdf|Chapter 5: Usability heuristics. p115-163]]
** Describes the heuristics in detail plus how and why it can be used to evaluate interfaces
.
Changed lines 32-34 from:
# ''(optional)'' O'Malley, C., Draper, S. and Riley, M. \\
[[HCIPapers:omalley-constructive-interaction.pdf|
'''Constructive interaction: A method for studying user-computer-user interaction'''.]] (1984) From Proceedings of Interact '84, p1-5.
** Describes a method for observing people working together.
to:
# Nielsen, J. (1994) \\
[[HCIPapers:nielsen-enhancing-chi94
.pdf| '''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.
Changed lines 36-38 from:
# ''(optional)'' Kennedy, S. \\
[[HCIPapers:kennedy-using-video
.pdf|'''Using video in the BNR usability lab'''.]] SIGCHI Bulletin, 21(2), p92-95, ACM Press.(1989)
** As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.
to:
# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation.pdf|Chapter 2: Heuristic evaluation. ]] [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation-2pages.pdf| as 2 pages per side]]
** A more in depth discussion
of how heuristic evaluation works and its reliability
Deleted lines 40-103:
# ''(optional)'' Neal, L. \\
[[HCIPapers:neal-use-video-chibulletin89.pdf|'''The use of video in empirical research'''.]] (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
** Further reasons why one should videotape usability sessions.


# ''optional'' Krug, S. \\
'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000) Extract: Chapters 9-11.
** A simple guide to doing cut-rate usability tests. Written for the lay practitioner.
**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']]
**[[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']]
**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']]


!!!Excercise (to be handed out)

#'''Get real with IBM RealPhone'''
** We will perform a usability study on IBM's RealPhone system
** [[Attach:RealPhoneAll.pdf|Download the full handout]], which contains:
**** the presentation
**** evaluator's instructions and tasks
**** consent form
**** Pre-test, During-test and Post-test questions
**** methods for running a basic observational study
**** discussion of guidelines for user observation
**** IBM Real Phone Instruction Sheet and their test-drive instructions
**** Isys' Hall of Shame critique of RealPhone
** [[Attach:RealPhone.exe|The system is available here]], as an installable .exe
** [[Attach:RealPhone.ppt|The presentation, in powerpoint]]

! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED




!!!Experimental methodologies
#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\
'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\
* Lecture notes for the talk I give to the class.

!!!Excercise
#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''
** We will perform a 'pilot' controlled study on how people perform on different types of keyboards




!! Interface Inspection

!!!Overview
# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch1-executive-summary.pdf|Chapter 1: Executive summary. p1-23]]
** An exectuive summary and discussion of inspection methods.

!!!Usability Heuristics and Heuristic Evaluation

#'''Overview of Heuristic Evaluation''' [[Attach:Heuristic.ppt|Powerpoint]] or [[Attach:Heuristic.pdf|Adobe PDF]]
** My presentation that I give in CPSC 481

# Molich, R. and Nielsen, J. \\
[[HCIPapers:molich-nielsen-improving.pdf|'''Improving a human-computer dialog'''.]] Comm ACM, 33(3), 1990
** This article lists the heuristics and presents a working example, solutions, and alternatives.
Changed lines 43-44 from:
** [[HCIPapers:nielson93-usabilityengch5-usab-heuristics.pdf|Chapter 5: Usability heuristics. p115-163]]
** Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.
to:
** [[HCIPapers:nielson93-usabilityengappendix-travel-weather.pdf|Exercise 8: Heuristic Evaluation of a Paper Mock-Up. ]]
** Another example, with answers, of a heuristic evaluation.
Changed lines 46-48 from:
# Nielsen, J. (1994) \\
[[HCIPapers:nielsen-enhancing-chi94.pdf| '''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.
to:
!!!Task-Centered Walkthroughs

# '''Overview of Task Centered Walkthrough'''
[[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
** My presentation that I give in CPSC 481
Added lines 52-55:
# Greenberg, S. \\
[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|'''Working through task-centered system design''']]. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
** A how-to approach to task-centered system design.
Changed lines 58-59 from:
** [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation.pdf|Chapter 2: Heuristic evaluation. ]] [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation-2pages.pdf| as 2 pages per side]]
** A more in depth discussion of how heuristic evaluation works and its reliability
to:
** [[HCIPapers:nielsen94-inspection-ch3-pluralistic.pdf|Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. ]]
** Describe the steps in the pluralistic walkthough process.

'''Supplemental Readings'''
# Lewis, C.
and Rieman, J. (1993) \\
[[HCIPapers:lewisriemanbook-index.html|'''Task-Centered User Interface Design: A Practical Introduction.''' ]] Available as Shareware.
** The book that started it off.
** Read the chapter '''Getting to Know Users and their Tasks.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

!!!Cognitive Walkthroughs

# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch5-cognitive-walkthrough.pdf|Chapter 5: The Cognitive Walkthrough Method: A Practitioner's Guide. ]] Wharton, C., Rieman, J. Lewis, C. and Polson, P. p25-62
** This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
Added lines 74-79:
# Preece, J. et. al., (1994) \\
'''Human Computer Interaction,''' Addison-Wesley
** [[HCIPapers:preece94-cogwalkthroughs.pdf| Walkthroughs (Excerpt)]], page 679-684

!! Prototyping
Changed lines 82-83 from:
** [[HCIPapers:nielson93-usabilityengappendix-travel-weather.pdf|Exercise 8: Heuristic Evaluation of a Paper Mock-Up. ]]
** Another example, with answers, of a heuristic evaluation
.
to:
** [[HCIPapers:nielson93-usabilityengch4.8-prototyping.pdf|Chapter 4.8 Prototyping. (Extract)]] p93-101. [[HCIPapers:nielson93-usabilityengch4.8-prototyping-2page.pdf|(also as 2 pages / side )]]
** Describes different styles of prototypes and how they can be used within scenarios
.
Changed lines 85-89 from:
!!!Task-Centered Walkthroughs

# '''Overview of Task Centered Walkthrough'''
[[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
** My presentation that I give in CPSC 481
to:
# Rettig, M. (1994) \\
[[HCIPapers:rettig94-protyping.pdf| '''Prototyping for tiny fingers'''.]] Communications of the ACM, 37(4), ACM Press
** A simple way to build low fidelity prototypes, similar to Pictive
Changed lines 89-91 from:
# Greenberg, S. \\
[[http://grouplab
.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|'''Working through task-centered system design''']]. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
** A how-to approach to task-centered system design.
to:
# Rudd, J., Stern, K. and Isensee, S. (1996) \\
[[HCIPapers:rudd96-prototyping
.pdf| '''Low vs. high fidelity prototyping debate'''.]] Interactions 3(1), p76-85, ACM Press.
** When are where you should use low vs. high fidelity prototypes
Changed lines 93-97 from:
# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch3-pluralistic.pdf|Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. ]]
** Describe the steps in the pluralistic walkthough process
.
to:
# Muller, M. (1991) \\
[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

# Gould, J., Conti, J., and Hovanyecz, T. (1981) \\
[[HCIPapers:gould-composing-cacm83.pdf|'''Composing letters with a simulated listening typewriter'''.]] Communications of the ACM, 26(4), 295-308. ACM Press.
** The first description of the Wizard of Oz prototyping/testing method
.
Changed lines 102-142 from:
# Lewis, C. and Rieman, J. (1993) \\
[[HCIPapers:lewisriemanbook-index.html|'''Task-Centered User Interface Design: A Practical Introduction.''' ]] Available as Shareware.
** The book that started it off.
** Read the chapter '''Getting to Know Users and their Tasks.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

!!!Cognitive Walkthroughs

# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch5-cognitive-walkthrough.pdf|Chapter 5: The Cognitive Walkthrough Method: A Practitioner's Guide. ]] Wharton, C., Rieman, J. Lewis, C. and Polson, P. p25-62
** This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.

# Preece, J. et. al., (1994) \\
'''Human Computer Interaction,''' Addison-Wesley
** [[HCIPapers:preece94-cogwalkthroughs.pdf| Walkthroughs (Excerpt)]], page 679-684

!! Prototyping

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch4.8-prototyping.pdf|Chapter 4.8 Prototyping. (Extract)]] p93-101. [[HCIPapers:nielson93-usabilityengch4.8-prototyping-2page.pdf|(also as 2 pages / side )]]
** Describes different styles of prototypes and how they can be used within scenarios.

# Rettig, M. (1994) \\
[[HCIPapers:rettig94-protyping.pdf| '''Prototyping for tiny fingers'''.]] Communications of the ACM, 37(4), ACM Press
** A simple way to build low fidelity prototypes, similar to Pictive

# Rudd, J., Stern, K. and Isensee, S. (1996) \\
[[HCIPapers:rudd96-prototyping.pdf| '''Low vs. high fidelity prototyping debate'''.]] Interactions 3(1), p76-85, ACM Press.
** When are where you should use low vs. high fidelity prototypes

# Muller, M. (1991) \\
[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

# Gould, J., Conti, J., and Hovanyecz, T. (1981) \\
[[HCIPapers:gould-composing-cacm83.pdf|'''Composing letters with a simulated listening typewriter'''.]] Communications of the ACM, 26(4), 295-308. ACM Press.
** The first description of the Wizard of Oz prototyping/testing method.

'''Supplemental Readings'''
to:
Added lines 193-225:



!!!Excercise (to be handed out)

#'''Get real with IBM RealPhone'''
** We will perform a usability study on IBM's RealPhone system
** [[Attach:RealPhoneAll.pdf|Download the full handout]], which contains:
**** the presentation
**** evaluator's instructions and tasks
**** consent form
**** Pre-test, During-test and Post-test questions
**** methods for running a basic observational study
**** discussion of guidelines for user observation
**** IBM Real Phone Instruction Sheet and their test-drive instructions
**** Isys' Hall of Shame critique of RealPhone
** [[Attach:RealPhone.exe|The system is available here]], as an installable .exe
** [[Attach:RealPhone.ppt|The presentation, in powerpoint]]

! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED


----------------

!!!Experimental methodologies
#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\
'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\
* Lecture notes for the talk I give to the class.

!!!Excercise
#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''
** We will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed lines 9-119 from:
'+'''Course texts:'''+' You should buy these texts. Some of the readings below will be from them.

*Required
##'''Papers ''' will be made available to you at cost.

*Some recommended classics
##'''A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
##'''Usability Engineering''', Nielsen, J. (1993) Academic Press.
##'''Usability Inspection Methods''' (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.


!! Overview of methodologies
The following papers introduces (but do not detail) many methodologies. They also discuss and compare methodologies from various perspectives: to influence design, to evaluate products, to encourage end-user feedback, and to compare when and where each is useful. Because you do not yet know the details of these methodologies, the discussions in the papers may be hard to follow at times. Because these papers are just intended to give you a feel for the area, I suggest you give them a quick read now. As the course progresses, you will find that you will be able to go back to them for a more careful read.

#Gould, J.D. (1996)\\
[[HCIPapers:gould-howto-2-pageperside.pdf | '''How to design usable systems'''.]] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
** This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

# Dix, A., Finlay, J., Abowd, G., and Beale, R. \\
'''Human Computer Interaction''', 2nd Edition. Prentice Hall. 1998
** [[HCIPapers:dfab-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques.]] 363-400
** This useful overview chapter briefly surveys a variety of methodologies.

# McGrath, J. \\
[[HCIPapers:mcgrath-methodologymatters-bgbg95.pdf |'''Methodology matters: Doing research in the behavioural and social sciences.''']] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
** See also a [[HCIPapers:mcgrath-methodology-summary-bgbg95.pdf|student-created summary]] by Stephanie Smale
** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.

!!!!Optional Readings
# Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
** This essay contrasts the academic vs business approach to product development.




!!User Observation


!!!Experimental methodologies

# Dix, A., Finlay, J., Abowd, G., and Beale, R. \\
'''Human Computer Interaction''', 2nd Edition. Prentice Hall. 1998
** Selections from [[HCIPapers:dfab-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques.]] 363-400
*** Section 11.3.1 Laboratory Studies (p365)
*** Section 11.5.1: Empirical methods (p375-385)

#McGrath, J. \\
[[HCIPapers:mcgrath-methodologymatters-bgbg95.pdf |'''Methodology matters: Doing research in the behavioural and social sciences.''']] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
** Reread sections of this paper:
*** Experimental Strategies (p157-8)
*** Study Design, Comparison Techniques, and Validity (p159 - 164)

# Eberts, R.E. \\
'''User Interface Design,''' Prentice Hall 1994
** [[HCIPapers:eberts-uidesign-ch4.pdf|Chapter 4: Experimental methodology; ]]
** [[HCIPapers:eberts-uidesign-ch5.pdf|Chapter 5: Experimental designs and analysis; ]]
** [[HCIPapers:eberts-uidesign-ch6.pdf|Chapter 6: Hazards to conducting and interpreting HCI experiments]]
** All chapters give a general and high level introduction to experimental design.

# Greenberg, S. and Witten, I. (1984) \\
[[http://grouplab.cpsc.ucalgary.ca/papers/1984/84-MenuComparison.CIPS/menu-comparison.CIPS84.pdf|'''Comparison of menu displays for ordered lists''']]. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in the lectures.

!! Ethics

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. p165-205 [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]. In particular, read Chapter 6.4: Ethical aspects of tests with human subjects, p181-185.
** A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on [[Attach:Ethics.pdf|Ethics]], which summarizes some of Nielson's points.

# University of Calgary Research Services: Ethics
** [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]
** [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]
** [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form
** [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out
** [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]

#''(optional)'' Rogers, Tim \\
[[HCIPapers:/rogers-participantrights.pdf|'''Research Participants' Bill of Rights''']]. '-(Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html-'.
** A concise statement of what participant's should expect as fair treatment

->'-''Additional supplemental readings available in the [[Optional Readings]] sections''-'

!!User Observation

!!Usability Testing

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]. p165-205 .
** An excellent overview to various usability testing methodologies.

# Gomoll, Kathleen & Nicol, Anne (1990) \\
[[HCIPapers:gomol-userobservations-apple90.pdf|'''User Observation: Guidelines for Apple Developers''',]] Apple Inc., January
** This reading is an excellent recipe for performing usability studies.

# Dumas, J.S. and Redish, J.C. \\
'''A Practical Guide to Usability Testing.''' Revised Edition. (1999)
** The chapters below provide an in-depth treatment of usability testing.
** [[HCIPapers:dumas-usabtesting-ch2.pdf|2: Introducing usability testing ]]
** [[HCIPapers:dumas-usabtesting-ch6.pdf|6: Establishing a usability program in your organization ]]
** [[HCIPapers:dumas-usabtesting-ch7.pdf|7: Planning a usability test ]]
** [[HCIPapers:dumas-usabtesting-ch9.pdf|9: Deciding who should be participants ]]
** [[HCIPapers:dumas-usabtesting-ch11.pdf|11: Selecting and organizing tasks to test ]]
** [[HCIPapers:dumas-usabtesting-ch12.pdf|12: Creating task scenarios ]]
** [[HCIPapers:dumas-usabtesting-ch15.pdf|15: Preparing the testing environment]]
** [[HCIPapers:dumas-usabtesting-ch18.pdf|18: Caring for the test participants ]]
** [[HCIPapers:dumas-usabtesting-ch19.pdf|19: Conducting the test ]]
** [[HCIPapers:dumas-usabtesting-AppA.pdf|Appendix A: Setting up a usability laboratory ]]
** [[HCIPapers:dumas-usabtesting-all.pdf|All of the above as a single PDF]]
to:

# ''(optional)'' Ehrlich, K., Butler, M. and Pernce, K. \\
[[HCIPapers:ehrlich-usab-testing.pdf|'''Getting the whole team into usability testing.''' ]] IEEE Software, p89-90. (1994)
** Tips and reasons for including developers as part of the evaluation team.
Added lines 2-5:

! READING LIST IS BEING MIGRATED TO THE NEW WEB SITE
Please visit: [[http://saul.cpsc.ucalgary.ca/pmwiki.php/HCIResources/ReadingListHCIEvaluation| '''the New Location''']]
Changed line 364 from:
'-''Last updated Fall, 2006''-'
to:
'-''Last updated Fall, 2006''-'
March 11, 2010, at 12:55 PM by 24.64.76.54 -
Changed lines 356-359 from:
* [[http://jnd.org/dn.mss/technology_first_needs_last.html | Technology First, Needs Last]]
* [[http://www.jnd.org/dn.mss/filling_much_needed.html | Filling Much Needed Holes]]
to:
** [[http://jnd.org/dn.mss/technology_first_needs_last.html | Technology First, Needs Last]]
** [[http://www.jnd.org/dn.mss/filling_much_needed.html | Filling Much Needed Holes]]
March 11, 2010, at 12:54 PM by 24.64.76.54 -
Added lines 355-359:
# Norman, D. (various)
* [[http://jnd.org/dn.mss/technology_first_needs_last.html | Technology First, Needs Last]]
* [[http://www.jnd.org/dn.mss/filling_much_needed.html | Filling Much Needed Holes]]
Changed line 116 from:
# Ehrlich, K., Butler, M. and Pernce, K. \\
to:
# ''(optional)'' Ehrlich, K., Butler, M. and Pernce, K. \\
Changed line 120 from:
# O'Malley, C., Draper, S. and Riley, M. \\
to:
# ''(optional)'' O'Malley, C., Draper, S. and Riley, M. \\
Changed line 124 from:
# Kennedy, S. \\
to:
# ''(optional)'' Kennedy, S. \\
Changed line 128 from:
# Neal, L. \\
to:
# ''(optional)'' Neal, L. \\
Deleted lines 87-89:
! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED
Deleted lines 89-99:

!!!Experimental methodologies
#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\
'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\
* Lecture notes for the talk I give to the class.

!!!Excercise
#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''
** We will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed lines 157-174 from:
to:
! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED




!!!Experimental methodologies
#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\
'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\
* Lecture notes for the talk I give to the class.

!!!Excercise
#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''
** We will perform a 'pilot' controlled study on how people perform on different types of keyboards


Changed lines 295-298 from:

# Incontext, Inc.\\
'''Getting Started with Contextual Techniques. ''' [[http://www.incent.com]]
to:
Deleted lines 67-70:

! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED
Added lines 88-90:
! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED
Deleted lines 68-69:
Changed lines 79-86 from:
University of Calgary Research Services: Ethics
* [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]
* [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]
* [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form
* [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out
* [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]
to:
# University of Calgary Research Services: Ethics
** [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]
** [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]
** [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form
** [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out
** [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]
Changed lines 81-89 from:
#Rogers, Tim \\
to:
University of Calgary Research Services: Ethics
* [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]
* [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]
* [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form
* [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out
* [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]


#''(optional)''
Rogers, Tim \\
Changed lines 91-111 from:
** A concise statement of what participant's should expect as fair treatment

#Research Services\\
[[Attach:UofCEthics.pdf|'''University of Calgary Policy Statement Ethical Conduct for Research Involving Humans''']], Excerpt.
** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site ]] for the latest update, but unfortunately this is now under review and doesn't seem to be available.
**** Section 1 - verify that your work requires ethics clearance,
**** Section 6 - if your application concerns course-based research,
**** Section 8 for your procedural responsibilities
**** Section 9 for guidelines on balancing risks vs benefits
**** Section 10 on how to do informed consent
**** Section 11 for guidelines on deception (research involving any deception is usually considered risky)
**** Section 12 for guidelines on maintaining privacy and confidentiality

#Research Services \\
'''Ethics application'''
** Go to the '''[[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]'''. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
**** '''Ethics Information for U of C Graduate Students''', with pointers to what is required in each faculty and the process.
**** '''Information to Help Applicants'''
**** '''Ethics review application form'''
**** '''Sample consent form'''
to:
** A concise statement of what participant's should expect as fair treatment
Changed lines 51-52 from:
#Gould, J.D. (1996)\\
[[HCIPapers:gould-howto-2-pageperside.pdf | '''How to design usable systems'''.]] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
#McGrath, J. \\
[[HCIPapers:mcgrath-methodologymatters-bgbg95.pdf |'''Methodology matters: Doing research in the behavioural and social sciences.''']] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
Changed lines 114-117 from:
# Dix, A., Finlay, J., Abowd, G., and Beale, R. \\
'''Human Computer Interaction''', 2nd Edition. Prentice Hall. 1998
** [[HCIPapers:dfab-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques
.]] 363-400
** the chapter you previously read includes a section on controlled experiments
. Read Section 11.5.1: Empirical methods. p375-385
to:
!!!Excercise
#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''
** We will perform a 'pilot' controlled study on how people perform on different types of keyboards


!!Usability Testing

# Nielsen, J
. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]
. p165-205 .
** An excellent overview to various usability testing methodologies.
Deleted lines 125-148:
# Eberts, R.E. \\
'''User Interface Design,''' Prentice Hall 1994
** [[HCIPapers:eberts-uidesign-ch4.pdf|Chapter 4: Experimental methodology; ]]
** [[HCIPapers:eberts-uidesign-ch5.pdf|Chapter 5: Experimental designs and analysis; ]]
** [[HCIPapers:eberts-uidesign-ch6.pdf|Chapter 6: Hazards to conducting and interpreting HCI experiments]]
** All chapters give a general and high level introduction to experimental design.

# Greenberg, S. and Witten, I. (1984) \\
[[http://grouplab.cpsc.ucalgary.ca/papers/1984/84-MenuComparison.CIPS/menu-comparison.CIPS84.pdf|'''Comparison of menu displays for ordered lists''']]. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.


!!!Excercise
#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''
** We will perform a 'pilot' controlled study on how people perform on different types of keyboards


!!Usability Testing

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]. p165-205 .
** An excellent overview to various usability testing methodologies.
Changed lines 47-49 from:
** [[HCIPapers:dfab-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques.]] 363-400
** the chapter you previously read includes sections on controlled experiments. Read Sections 11.3.1 Laboratory Studies (p365), and 11.5.1: Empirical methods (p375-385)
to:
** Selections from [[HCIPapers:dfab-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques.]] 363-400
*** Section 11.3.1 Laboratory Studies (p365)
*** Section
11.5.1: Empirical methods (p375-385)
Changed lines 53-54 from:
** Reread sections of this paper: Experimental Strategies (p. 157-8), and the major section Study Design, Comparison Techniques, and Validity (p159 - 164)
to:
** Reread sections of this paper:
*** Experimental Strategies (p157-8)
*** Study Design, Comparison Techniques, and Validity (p159 - 164)
Changed lines 48-49 from:
** the chapter you previously read includessections on controlled experiments. Read Sections 11.3.1 Laboratory Studies p. 365, and 11.5.1: Empirical methods, p375-385
to:
** the chapter you previously read includes sections on controlled experiments. Read Sections 11.3.1 Laboratory Studies (p365), and 11.5.1: Empirical methods (p375-385)

#Gould, J.D. (1996)\\
[[HCIPapers:gould-howto-2-pageperside.pdf | '''How to design usable systems'''.]] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
** Reread sections of this paper: Experimental Strategies (p. 157-8), and the major section Study Design, Comparison Techniques, and Validity (p159 - 164)
Changed lines 48-49 from:
** the chapter you previously read includes a section on controlled experiments. Read Section 11.5.1: Empirical methods. p375-385
to:
** the chapter you previously read includessections on controlled experiments. Read Sections 11.3.1 Laboratory Studies p. 365, and 11.5.1: Empirical methods, p375-385
Added line 15:
Changed lines 33-39 from:
to:
!!!!Optional Readings
# Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
** This essay contrasts the academic vs business approach to product development.


Changed lines 62-66 from:
!!!!Optional Readings
# Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
** This essay contrasts the academic vs business approach to product development.
to:
Added lines 32-54:

!!User Observation


!!!Experimental methodologies

# Dix, A., Finlay, J., Abowd, G., and Beale, R. \\
'''Human Computer Interaction''', 2nd Edition. Prentice Hall. 1998
** [[HCIPapers:dfab-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques.]] 363-400
** the chapter you previously read includes a section on controlled experiments. Read Section 11.5.1: Empirical methods. p375-385

# Eberts, R.E. \\
'''User Interface Design,''' Prentice Hall 1994
** [[HCIPapers:eberts-uidesign-ch4.pdf|Chapter 4: Experimental methodology; ]]
** [[HCIPapers:eberts-uidesign-ch5.pdf|Chapter 5: Experimental designs and analysis; ]]
** [[HCIPapers:eberts-uidesign-ch6.pdf|Chapter 6: Hazards to conducting and interpreting HCI experiments]]
** All chapters give a general and high level introduction to experimental design.

# Greenberg, S. and Witten, I. (1984) \\
[[http://grouplab.cpsc.ucalgary.ca/papers/1984/84-MenuComparison.CIPS/menu-comparison.CIPS84.pdf|'''Comparison of menu displays for ordered lists''']]. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in the lectures.
Changed lines 7-10 from:
* Required:
to:
*Required
##'''Papers ''' will be made available to you at cost.

*Some recommended classics
Deleted lines 12-14:
##'''Papers of the remaining readings''' will be made available to you at cost.

*Recommended
Deleted line 14:
Changed line 33 from:
!!!Optional Readings
to:
!!!!Optional Readings
Changed lines 38-40 from:
to:
! YOU SHOULD HAVE READ THE ABOVE PAPERS.
THE PAPERS BELOW ARE STILL TO BE ASSIGNED
Changed lines 32-33 from:

# Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
to:
!!!Optional Readings
# Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
Changed lines 37-38 from:
#Neustaedter, Carman '''Overview of Qualitative Data Analysis'''. [[HCILectures:qualitative-data-analysis-neustaedter.ppt |(Powerpoint)]] and [[HCILectures:qualitative-data-analysis-neustaedter.wmv |(Video)]] of his presenation
to:
Changed lines 277-278 from:
to:
#Neustaedter, Carman '''Overview of Qualitative Data Analysis'''. [[HCILectures:qualitative-data-analysis-neustaedter.ppt |(Powerpoint)]] and [[HCILectures:qualitative-data-analysis-neustaedter.wmv |(Video)]] of his presenation
Deleted lines 18-19:
#[[HCILectures:methodology_overview.ppt|'''Overview of methodologies''' [Powerpoint]]]
June 08, 2008, at 04:12 PM by 24.64.87.10 -
Changed lines 319-320 from:
Greenberg, S. and Buxton, B. (2008) \\
to:

#
Greenberg, S. and Buxton, B. (2008) \\
Changed line 352 from:
'-''Last updated Fall, 2006''-'
to:
'-''Last updated Fall, 2006''-'
June 08, 2008, at 04:12 PM by 24.64.87.10 -
Changed lines 319-321 from:
to:
Greenberg, S. and Buxton, B. (2008) \\
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-UsabilityHarmful.CHI | ''Usability Evaluation Considered Harmful (Some of the Time)'']]. In Proceedings of the ACM Conference on Human Factors in Computing Systems - ACM CHI'08. (Florence, Italy), ACM Press, pages 111-120, April 5-10.
April 26, 2008, at 06:14 PM by 24.64.87.10 -
Changed lines 346-348 from:
# Ioannidis, J. P. A. (2005)
[[HCIPapers:ioannidis-whymostpubfindingsarefalse.pdf | Why Most Published Research Findings Are False.]] PLoS Medicine, August; 2(8): e124
to:
# Ioannidis, J. P. A. (2005) \\
[[HCIPapers:ioannidis-whymostpubfindingsarefalse.pdf | Why Most Published Research Findings Are False.]] PLoS Medicine, August; 2(8): e124. [[http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1182327 | link]]
April 26, 2008, at 06:13 PM by 24.64.87.10 -
Added lines 343-348:
# Steve M. Easterbrook and J. Singer and M.-A. Storey and D. Damian, 2007 \\
[[HCIPapers:easterbrook-selectingempiricalmethods.pdf |'''Selecting Empirical Methods for Software Engineering Research''']], In Forrest Shull, Janice Singer and Dag I. K. Sjoberg (Eds) Guide to Advanced Empirical Software Engineering, Springer, 285-311.

# Ioannidis, J. P. A. (2005)
[[HCIPapers:ioannidis-whymostpubfindingsarefalse.pdf | Why Most Published Research Findings Are False.]] PLoS Medicine, August; 2(8): e124
Changed line 64 from:
** Go to the [[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
to:
** Go to the '''[[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]'''. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
Changed lines 64-69 from:
** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects.
**** [[http://www.ucalgary.ca/research/compliance/ethics/info/grad/|Ethics Information for U
of C Graduate Students]]
**** [[http://www.ucalgary.ca/
research/files/ethics_info_applicants.doc|Information to Help Applicants]], with pointers to what is required in each faculty and the process.
**** [[http://www.ucalgary.ca/research/files/CFREB Application Form - Revised March 2007 (Final)
.doc|Ethics review application form]]
**** [[http://www.ucalgary.ca/research/files/ethics_consent.doc|Sample consent
form]]
to:
** Go to the [[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.
**** '''Ethics Information for U of C Graduate Students''', with pointers to what is required in each faculty and the process
.
**** '''Information to Help Applicants'''
**** '''Ethics review application
form'''
**** '''Sample consent form'''
Changed line 67 from:
**** [[http://www.ucalgary.ca/research/files/CFREB%20Application%20Form%20-%20Revised%20March%202007%20(Final).doc|Ethics review application form]]
to:
**** [[http://www.ucalgary.ca/research/files/CFREB Application Form - Revised March 2007 (Final).doc|Ethics review application form]]
Changed lines 65-66 from:
**** [[http://www.ucalgary.ca/research/files/ethics_info_applicants.doc|Information to Help Applicants]]
to:
**** [[http://www.ucalgary.ca/research/compliance/ethics/info/grad/|Ethics Information for U of C Graduate Students]]
**** [[http://www.ucalgary.ca/research/files/ethics_info_applicants.doc|Information to Help Applicants]], with pointers to what is required in each faculty and the process.
Changed line 53 from:
** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site for the latest update]], but unfortunately this is now under review and doesn't seem to be available.
to:
** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site ]] for the latest update, but unfortunately this is now under review and doesn't seem to be available.
Changed lines 64-68 from:
** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[Attach:ExcerptEthical.doc|excerpt from that page]] includes:
**** [[Attach:EthicsGuide.doc|Instructions for Ethics Review Applicants]]
**** [[Attach:EthicsReview.doc|Ethics review application form]]
**** [[Attach:Consent
.doc|Sample consent form]]
to:
** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects.
****
[[http://www.ucalgary.ca/research/files/ethics_info_applicants.doc|Information to Help Applicants]]
**** [[http://www.ucalgary.ca/research/files/CFREB%20Application%20Form%20-%20Revised%20March%202007%20(Final).doc|Ethics review application form]]
**** [[http://www.ucalgary.ca/research/files/ethics_consent.doc|Sample consent form]]
Changed line 48 from:
[[HCIPapers:/rogers-participantrights.pdf|'''Research Participants' Bill of Rights''']]. '--(Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html)--'.
to:
[[HCIPapers:/rogers-participantrights.pdf|'''Research Participants' Bill of Rights''']]. '-(Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html-'.
Changed line 53 from:
** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/UofC/research/html/ethics/poli_guide.html|Ethics site for the latest update]]
to:
** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site for the latest update]], but unfortunately this is now under review and doesn't seem to be available.
Changed line 48 from:
[[HCIPapers:/rogers-participantrights.pdf|'''Research Participants' Bill of Rights''']]. Mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html .
to:
[[HCIPapers:/rogers-participantrights.pdf|'''Research Participants' Bill of Rights''']]. '--(Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html)--'.
Changed lines 147-151 from:
**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']
**[[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']
**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']
to:
**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']]
**[[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']]
**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']]
Changed lines 145-147 from:
'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000)
**
Chapters 9-11 are available for download, which provide a simple guide to doing cut-rate usability tests. Written for the lay practitioner.
to:
'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000) Extract: Chapters 9-11.
** A simple guide to doing cut-rate usability tests. Written for the lay practitioner
.
**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']
**[[http://sensible
.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']
**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']
Added lines 143-147:

# ''optional'' Krug, S. \\
'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000)
** Chapters 9-11 are available for download, which provide a simple guide to doing cut-rate usability tests. Written for the lay practitioner.
Changed line 19 from:
#[[Attach:HCILectures/methodology_overview.ppt|'''Overview of methodologies''' [Powerpoint]]]
to:
#[[HCILectures:methodology_overview.ppt|'''Overview of methodologies''' [Powerpoint]]]
Changed lines 19-20 from:
#[[Attach:OverviewMethod.ppt|'''Overview of methodologies''' [Powerpoint]]]
** also as [[Attach:OverviewMethod.pdf|Adobe PDF
]]
to:
#[[Attach:HCILectures/methodology_overview.ppt|'''Overview of methodologies''' [Powerpoint]]]
Changed lines 287-290 from:
to:
'''Open Coding'''
* Strauss, A. and Corbin, J. (1998) \\
'''Basics of Qualitative Research''', 2nd Edition. Sage Publications.
** [[HCIPapers:strauss-opencoding.pdf|Chapter 8. Open Coding.]]
March 23, 2007, at 09:13 PM by 24.64.76.194 -
Changed lines 39-40 from:
to:
#Neustaedter, Carman '''Overview of Qualitative Data Analysis'''. [[HCILectures:qualitative-data-analysis-neustaedter.ppt |(Powerpoint)]] and [[HCILectures:qualitative-data-analysis-neustaedter.wmv |(Video)]] of his presenation
Changed line 2 from:
%rfloat% -[[CPSC681/Courses|Attach:logo-681.png]]
to:
%rfloat% [[CPSC681/Courses|Attach:logo-681.png]]
Changed line 2 from:
%rfloat% Attach:logo-681.png
to:
%rfloat% -[[CPSC681/Courses|Attach:logo-681.png]]
Deleted line 47:
* Rogers, Tim. \\
Changed lines 48-49 from:
[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|'''Research Participants' Bill of Rights''']] [[Attach:ParticipantsRights.pdf|also as PDF]]
to:
* Rogers, Tim. \\
[[HCIPapers:/rogers-participantrights.pdf|'''Research Participants' Bill of Rights''']]. Mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html .
Changed lines 305-306 from:
!!! Comparing Methods
to:
!! Comparing Methods
Changed line 211 from:
!!!Supplemental Readings
to:
'''Supplemental Readings'''
Changed line 170 from:
#'''Overview of Heuristic Evaluation''' [[Attach:Heuristic.ppt|Powerpoint]] or [[Attach:Heuristic.pdf|Adobe PDF]]]
to:
#'''Overview of Heuristic Evaluation''' [[Attach:Heuristic.ppt|Powerpoint]] or [[Attach:Heuristic.pdf|Adobe PDF]]
Changed line 199 from:
# Overview of Task Centered Walkthrough [[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
to:
# '''Overview of Task Centered Walkthrough''' [[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
Changed line 203 from:
[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|Working through task-centered system design]]. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
to:
[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|'''Working through task-centered system design''']]. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
Changed line 213 from:
[[HCIPapers:lewisriemanbook-index.html|Task-Centered User Interface Design: A Practical Introduction. ]] Available as Shareware.
to:
[[HCIPapers:lewisriemanbook-index.html|'''Task-Centered User Interface Design: A Practical Introduction.''' ]] Available as Shareware.
Changed line 225 from:
'''Human Computer Interaction,'' Addison-Wesley
to:
'''Human Computer Interaction,''' Addison-Wesley
Changed line 254 from:
[[http://grouplab.cpsc.ucalgary.ca/papers/1993/93-Woz.CHI/93-woz.chi.pdf|Prototyping an intelligent agent through Wizard of Oz]]. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
to:
[[http://grouplab.cpsc.ucalgary.ca/papers/1993/93-Woz.CHI/93-woz.chi.pdf|'''Prototyping an intelligent agent through Wizard of Oz''']]. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
Changed lines 262-263 from:
[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995**** Describes a system that lets people sketch and storyboard through a live computer interface.
to:
[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
** Describes a system that lets people sketch and storyboard through a live computer interface.
Changed lines 277-278 from:
#Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
to:
# Holtzblatt, K. and Jones, S. (1996)\\
'''Contextual Inquiry: A Participatory Approach.'''
In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
Changed lines 280-281 from:
#Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
to:
# Holtzblatt, K. and Beyer, H. (1993) \\
'''Contextual Design: Principles and Practice.'''
In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
Changed lines 283-285 from:
#Getting Started with Contextual Techniques. Incontext, Inc. [[http://www.incent.com]]
to:
# Incontext, Inc.\\
'''Getting Started with Contextual Techniques
. ''' [[http://www.incent.com]]
Changed line 289 from:
* Dourish, P. (2001) \\
to:
# Dourish, P. (2001) \\
Changed lines 294-295 from:
# Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
to:
# Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) \\
'''Ethnographically-informed systems design for air traffic control''',
in Proc CSCW'92, p123-129, November.
Changed lines 300-301 from:
#Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
to:
# Randall, D. (1996) \\
Ethnography and Systems Development: Bounding the Intersection.
Tutorial notes presented at CSCW'96.
Changed line 317 from:
'''Human Computer Interaction,'' Addison-Wesley
to:
'''Human Computer Interaction,''' Addison-Wesley
Changed lines 51-52 from:
#Excerpt of [[Attach:UofCEthics.pdf|University of Calgary Policy Statement Ethical Conduct for Research Involving Humans]], Research Services
to:
#Research Services\\
[[Attach:UofCEthics.pdf|'''University of Calgary Policy Statement Ethical Conduct for Research Involving Humans''']], Excerpt.
Changed lines 62-63 from:
#Ethics application
to:
#Research Services \\
'''Ethics application'''
Changed lines 69-71 from:
'-''Supplemental Readings available in the [[Optional Readings]] sections''-'
to:
->'-''Additional supplemental readings available in the [[Optional Readings]] sections''-'
Changed line 198 from:
#Overview of Task Centered Walkthrough [[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
to:
# Overview of Task Centered Walkthrough [[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
Changed lines 201-202 from:
#[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|Working through task-centered system design]]. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
to:
# Greenberg, S. \\
[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|Working through task-centered system design]]. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
Changed lines 205-207 from:
#[[Attach:Chap3Plural.pdf|Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies]]. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
to:
# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons.
(1994)
** [[HCIPapers:nielsen94-inspection-ch3-pluralistic.pdf|Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. ]]
Changed lines 211-217 from:
* [[Getting to Know Users and their Tasks]]. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
**** Describes task-centered system design and how tasks are used to define walkthroughs.
* [[Task-Centered User Interface Design: A Practical Introduction]]. Lewis, C. and Rieman, J. (1993) Available as Shareware.
**** The book that started it off. The above reading is in this book
to:
# Lewis, C. and Rieman, J. (1993) \\
[[HCIPapers:lewisriemanbook-index
.html|Task-Centered User Interface Design: A Practical Introduction. ]] Available as Shareware.
** The book that started it off.
** Read the chapter '''Getting to Know Users and their Tasks
.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
Changed lines 218-220 from:
#[[Attach:Chap5CogwalkThr.pdf|The Cognitive Walkthrough Method: A Practioner's Guide]]. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
# Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods
,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch5-cognitive-walkthrough.pdf|Chapter 5: The Cognitive Walkthrough Method: A Practitioner's Guide. ]] Wharton, C., Rieman, J. Lewis, C. and Polson, P. p25-62
Changed lines 223-225 from:
#[[Attach:CogWalkThrouPre.pdf|Walkthroughs (Excerpt, page 679-684)]] in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
** This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
to:
# Preece, J. et. al., (1994) \\
'''
Human Computer Interaction,'' Addison-Wesley
** [[HCIPapers:preece94-cogwalkthroughs.pdf| Walkthroughs (Excerpt)]], page 679-684
Changed lines 227-232 from:
!!Topics below here are optional and/or subject to change


!!! Prototyping

#
[[Text-Extract-Chapter 4.8: Prototyping]]. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
to:
!! Prototyping

# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
**
[[HCIPapers:nielson93-usabilityengch4.8-prototyping.pdf|Chapter 4.8 Prototyping. (Extract)]] p93-101. [[HCIPapers:nielson93-usabilityengch4.8-prototyping-2page.pdf|(also as 2 pages / side )]]
Changed lines 234-235 from:
#[[Prototyping for tiny fingers]]. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
to:
# Rettig, M. (1994) \\
[[HCIPapers:rettig94-protyping
.pdf| '''Prototyping for tiny fingers'''.]] Communications of the ACM, 37(4), ACM Press
Changed lines 238-239 from:
#[[Low vs. high fidelity prototyping debate]]. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
to:
# Rudd, J., Stern, K. and Isensee, S. (1996) \\
[[HCIPapers:rudd96-prototyping.pdf| '''Low vs
. high fidelity prototyping debate'''.]] Interactions 3(1), p76-85, ACM Press.
Changed lines 242-243 from:
#[[Pictive: An exploration in participatory design]]. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
to:
# Muller, M. (1991) \\
[[HCIPapers:muller-pictive-chi91
.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
Changed lines 246-247 from:
#[[Composing letters with a simulated listening typewriter]]. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
to:
# Gould, J., Conti, J., and Hovanyecz, T. (1981) \\
[[HCIPapers:gould-composing-cacm83
.pdf|'''Composing letters with a simulated listening typewriter'''.]] Communications of the ACM, 26(4), 295-308. ACM Press.
Changed lines 252-271 from:
* [[Prototyping an intelligent agent through Wizard of Oz]]. Maulsby, D., Greenberg, S. and Mander, R. (1993). Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
**** Describes a sophisticated Wizard of Oz experiment
, plus gives advice on how to apply WOZ.

* [[Retrospective on a year of participatory design using the PICTIVE technique]] Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
**** Experiences with Pictive and recommendations.

* [[The “Starfire” video prototype project: a case history]] Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
**** Describes a sophisticated video prototyping project.

* [[Interactive sketching for the early stages of user interface design]]. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
**** Describes a system that lets people sketch and storyboard through a live computer interface.


!!!Field Study Methodologies (tentative)


'''Introduction'''

#[[First Rule of Usability? Don't Listen to Users
and Field Studies Done Right: Fast and Observational.]] Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. [[http://www.useit.com/alertbox/20010805.html]] and [[http://www.useit.com/alertbox/20020120.html|20020120.html]]
to:
* Maulsby, D., Greenberg, S. and Mander, R. (1993). \\
[[http://grouplab
.cpsc.ucalgary.ca/papers/1993/93-Woz.CHI/93-woz.chi.pdf|Prototyping an intelligent agent through Wizard of Oz]]. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
** Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.

* Muller, Michael J. \\
[[HCIPapers:muller-retrospective-chi92.pdf|'''Retrospective
on a year of participatory design using the PICTIVE technique'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
** Experiences with Pictive and recommendations.

* Landay, James A., and Brad A. Myers \\
[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995**** Describes a system that lets people sketch and storyboard through a live computer interface.

!!Field Study Methodologies

!!!Introduction

# Nielsen, J. \\
'''Jacob Nielsen's Alertbox'''
** [[HCIPapers:neilsen-alertbox-observe-field.pdf| First rule of usability? Don't listen to users AND Field Studies done right: Fast
and observational,]] August 5, 2001 and January 20, 2002.
**
[[http://www.useit.com/alertbox/20010805.html]]
**
[[http://www.useit.com/alertbox/20020120.html|20020120.html]]
Changed lines 284-286 from:
#Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.
to:
* Dourish, P. (2001) \\
'''Where the Action Is. The Foundations of Embodied Interaction
.''' MIT Press, Cambridge MMA.
** [[HCIPapers:dourish-wheretheactionis-ch3.pdf|Chapter 3: Social Computing]]
p55-97.
Changed line 289 from:
#Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
to:
# Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
Changed lines 291-292 from:
#Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994) In Proc CSCW'94, p429439, ACM Press.
to:
# Hughes, J., King, V., Rodden, T. and Andersen, H. \\
[[HCIPapers:hughes-ethnography-cscw94
.pdf|'''Moving out of the control room: Ethnography in System Design'''.]] Proc ACM CSCW 1996.
Changed lines 300-301 from:
#Text-[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Chapter 7: Usability Assessment Methods Beyond Testing]]. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
to:
# Nielsen, J. (1993) \\
'''
Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengch7-usability-assessment.pdf|Chapter 7: Usability Assessment Methods Beyond Testing]]
Changed lines 305-306 from:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Mapping the method muddle: Guidance in using methods for user interface design]]. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
to:
# Olson, J. and Moran, T. (1996) \\
[[HCIPapers
:olson96-methods-muddle.pdf| '''Mapping the method muddle: Guidance in using methods for user interface design'''.]] In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
Changed lines 309-311 from:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Chapter 34: Comparing methods]]. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
to:
# Preece, J. et. al., (1994) \\
'''Human Computer Interaction
,'' Addison-Wesley
** [[HCIPapers:preece94-ch34-comparing-methods
.pdf| Chapter 34: Comparing methods.]] p691-707
Changed lines 314-315 from:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|User interface evaluation in the real world: A comparison of four techniques]]. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
# Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) \\
[[HCIPapers:jeffries91-ui-evaluation.pdf|'''User interface evaluation in the real world: A comparison of four techniques'''
.]] In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed lines 317-318 from:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Comparison of empirical testing and walkthrough methods in user interface evaluation]]. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
# Karat, C., Campbell, R. and Fiegel, T. (1992) \\
[[HCIPapers:kaplan-Coevolution.pdf|'''Comparison of empirical testing and walkthrough methods in user interface
evaluation'''.]] In ACM Conference on Human Factors in Computing Systems. 397-4044, ACM Press.
Changed lines 320-322 from:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

'-''Last updated Fall, 2004''-'
to:
# Landauer, T. (1991) \\
[[HCIPapers:landauer-letsgetreal.pdf|'''Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable
Systems''',]] In J. Carroll (ed) Designing Interaction, Cambridge University Press.

'-''Last updated Fall, 2006''-'
Changed line 201 from:
#[[Working through task-centered system design]]. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
to:
#[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|Working through task-centered system design]]. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
Deleted lines 16-17:
Changed line 19 from:
#[[Attach:OverviewMethod.ppt|Overview of methodologies [Powerpoint]]]
to:
#[[Attach:OverviewMethod.ppt|'''Overview of methodologies''' [Powerpoint]]]
Changed lines 22-23 from:
#[[HCIPapers:gould-howto-2-pageperside.pdf | How to design usable systems.]] Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
#Gould, J.D. (1996)\\
[[HCIPapers:gould-howto-2-pageperside.pdf | '''How to design usable
systems'''.]] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
Changed lines 47-48 from:
#[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|Research Participants' Bill of Rights]] by Tim Rogers [[Attach:ParticipantsRights.pdf|also as PDF]]
to:
#Rogers, Tim \\
[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|'''Research Participants' Bill of Rights''']] [[Attach:ParticipantsRights.pdf|also as PDF]]
Changed lines 78-79 from:
#'''To read again: [[Section 11.5.1: Empirical methods (Extract)]]'''. Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
** the chapter you previously read includes a section on controlled experiments
to:
# Dix, A., Finlay, J., Abowd, G., and Beale, R. \\
'''Human Computer Interaction''', 2nd Edition
. Prentice Hall. 1998
** [[HCIPapers:dfab
-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques.]] 363-400
** the chapter you previously read includes a section on controlled experiments. Read Section 11.5.1: Empirical methods. p375-385
Changed line 83 from:
#* Eberts, R.E. \\
to:
# Eberts, R.E. \\
Changed line 90 from:
#Greenberg, S. and Witten, I. (1984) \\
to:
# Greenberg, S. and Witten, I. (1984) \\
Deleted line 95:
Changed lines 97-99 from:
We will perform a 'pilot' controlled study on how people perform on different types of keyboards
to:
** We will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed lines 5-7 from:
'+'''Course texts'''+'
You should buy these texts. Some of the readings below will be from them.
to:
'+'''Course texts:'''+' You should buy these texts. Some of the readings below will be from them.
Changed line 5 from:
'''Course texts'''
to:
'+'''Course texts'''+'
Changed line 5 from:
!! Course texts
to:
'''Course texts'''
Deleted lines 4-9:

All papers are required reading unless otherwise noted.

Papers below the ruled line are not yet finalized.
Deleted lines 5-6:
Changed lines 8-18 from:
Required:

#'''A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
#'''Usability Engineering''', Nielsen, J. (1993) Academic Press.
#'''Papers of the remaining readings''' will be made available to you at cost.

Recommended

#'''Usability Inspection Methods''' (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
to:
* Required:
##'''A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
##'''Usability Engineering''', Nielsen, J. (1993) Academic Press.
##'''Papers of the remaining readings''' will be made available to you at cost.

*Recommended
##'''Usability Inspection Methods''' (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
Changed lines 11-13 from:
!!! Course texts
to:
!! Course texts
Changed lines 27-29 from:
!!! Overview of methodologies
to:
!! Overview of methodologies
Changed lines 52-53 from:
!!! Ethics
to:
!! Ethics
Changed lines 81-84 from:
!!!User Observation


'''Experimental methodologies'''
to:
!!User Observation


!!!Experimental methodologies
Changed lines 104-105 from:
'''Excercise'''
to:
!!!Excercise
Changed lines 110-111 from:
'''Usability Testing'''
to:
!!Usability Testing
Changed lines 152-153 from:
'''Excercise (to be handed out)'''
to:
!!!Excercise (to be handed out)
Changed lines 169-172 from:
!!! Interface Inspection

'''Overview'''
*
Nielsen, J. and R. Mack (eds) ]] \\
to:
!! Interface Inspection

!!!Overview
# Nielsen, J. and R. Mack (eds) ]] \\
Changed lines 177-178 from:
'''Usability Heuristics and Heuristic Evaluation'''
to:
!!!Usability Heuristics and Heuristic Evaluation
Changed line 182 from:
#* Molich, R. and Nielsen, J. \\
to:
# Molich, R. and Nielsen, J. \\
Changed line 186 from:
#* Nielsen, J. (1993) \\
to:
# Nielsen, J. (1993) \\
Changed line 195 from:
#* Nielsen, J. and R. Mack (eds) ]] \\
to:
# Nielsen, J. and R. Mack (eds) ]] \\
Changed line 200 from:
* Nielsen, J. (1993) \\
to:
# Nielsen, J. (1993) \\
Changed lines 206-207 from:
'''Task-Centered Walkthroughs'''
to:
!!!Task-Centered Walkthroughs
Changed lines 217-218 from:
'''Supplemental Readings'''
to:
!!!Supplemental Readings
Changed lines 225-226 from:
'''Cognitive Walkthroughs'''
to:
!!!Cognitive Walkthroughs
Changed lines 234-236 from:
!!''Topics below here are optional and/or subject to change''
to:
!!Topics below here are optional and/or subject to change
Deleted line 170:
Changed lines 172-175 from:
#[[Attach:ExecSum.pdf|Chapter 1: Executive summary]]. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
** An exectuive summary and discussion of inspection methods.
to:
* Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley
and Sons. (1994)
** [[HCIPapers:nielsen94-inspection-ch1-executive-summary.pdf|Chapter 1: Executive summary. p1-23]]
**
An exectuive summary and discussion of inspection methods.
Changed lines 182-183 from:
#'''[[Improving a human-computer dialogue]]''', Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
to:
#* Molich, R. and Nielsen, J. \\
[[HCIPapers:molich-nielsen-improving
.pdf|'''Improving a human-computer dialog'''.]] Comm ACM, 33(3), 1990
Changed lines 186-188 from:
#'''[[Attach:Chapt5.pdf|Text-Chapter 5: Usability heuristics]]'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
#* Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93
-usabilityengch5-usab-heuristics.pdf|Chapter 5: Usability heuristics. p115-163]]
Changed lines 191-192 from:
#'''[[Enhancing the explanatory power of usability heuristics]]'''. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
to:
# Nielsen, J. (1994) \\
[[HCIPapers:nielsen-enhancing-chi94.pdf|
'''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
Changed lines 195-197 from:
#'''[[Attach:Chap2.pdf|Chapter 2: Heuristic evaluation]]'''. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
#* Nielsen, J. and R. Mack (eds) ]] \\
'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)
** [[HCIPapers:nielsen94
-inspection-ch2-heuristic-evaluation.pdf|Chapter 2: Heuristic evaluation. ]] [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation-2pages.pdf| as 2 pages per side]]
Changed lines 200-202 from:
#'''[[Attach:Exercise8.pdf|Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up]]'''. Nielsen, J. In Usability Engineering, p273, Academic Press.
to:
* Nielsen, J. (1993) \\
'''Usability Engineering,''' p273
-4, Academic Press.
** [[HCIPapers:nielson93-usabilityengappendix-travel-weather.pdf|Exercise 8: Heuristic Evaluation of a Paper Mock-Up
. ]]
Changed line 117 from:
* Gomoll, Kathleen & Nicol, Anne (1990) \\
to:
# Gomoll, Kathleen & Nicol, Anne (1990) \\
Changed lines 112-114 from:
#'''Text-[[Attach:UsabilityTesting.pdf|Chapter 6: Usability testing]]'''. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press.
** [[HCIPapers:nielson93
-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]. p165-205 .
Changed lines 117-118 from:
#'''[[Discussion of guidelines for user observation]]'''. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
to:
* Gomoll, Kathleen & Nicol, Anne (1990) \\
[[HCIPapers:gomol-userobservations-apple90
.pdf|'''User Observation: Guidelines for Apple Developers''',]] Apple Inc., January
Changed lines 121-135 from:
#'''Text-A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
** An in-depth treatment of usability testing. The chapters we use are:
**** [[2:
Introducing usability testing]]
**** [[6: Establishing a usability program in your organization]]
**** [[7: Planning a usability test]]
**** [[9: Deciding who should be participants]]
**** [[11: Selecting and organizing tasks to test]]
**** [[12: Creating task scenarios]]
**** [[15: Preparing the testing environment]]
**** [[18: Caring for the test participants]]
**** [[19: Conducting the test]]
**** [[Appendix A: Setting up a usability laboratory]]
**** [[All of the above as a single PDF]]

#'''[[Attach:EhrlichTesting
.pdf|Getting the whole team into usability testing]]'''. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
to:
# Dumas, J.S. and Redish, J.C. \\
'''A Practical Guide to Usability Testing
.''' Revised Edition. (1999)
** The chapters below provide an in-depth treatment of usability testing.
** [[HCIPapers
:dumas-usabtesting-ch2.pdf|2: Introducing usability testing ]]
** [[HCIPapers:dumas-usabtesting-ch6.pdf|6: Establishing a usability program in your organization ]]
** [[HCIPapers:dumas-usabtesting-ch7.pdf|7: Planning a usability test ]]
** [[HCIPapers:dumas-usabtesting-ch9.pdf|9: Deciding who should be participants ]]
** [[HCIPapers:dumas-usabtesting-ch11.pdf|11: Selecting and organizing tasks to test ]]
** [[HCIPapers:dumas-usabtesting-ch12.pdf|12: Creating task scenarios ]]
** [[HCIPapers:dumas-usabtesting-ch15.pdf|15: Preparing the testing environment]]
** [[HCIPapers:dumas-usabtesting-ch18.pdf|18: Caring for the test participants ]]
** [[HCIPapers:dumas-usabtesting-ch19.pdf|19: Conducting the test ]]
** [[HCIPapers:dumas-usabtesting-AppA.pdf|Appendix A: Setting up a usability laboratory ]]
** [[HCIPapers:dumas-usabtesting-all.pdf|All of the above as a single PDF]]

# Ehrlich, K., Butler, M. and Pernce, K. \\
[[HCIPapers:ehrlich-usab-
testing.pdf|'''Getting the whole team into usability testing.''' ]] IEEE Software, p89-90. (1994)
Changed lines 140-141 from:
#'''[[Constructive interaction: A method for studying user-computer-user interaction]]'''. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
to:
# O'Malley, C., Draper, S. and Riley, M. \\
[[HCIPapers:omalley-constructive-interaction.pdf|
'''Constructive interaction: A method for studying user-computer-user interaction'''.]] (1984) From Proceedings of Interact '84, p1-5.
Changed lines 144-145 from:
#'''[[Attach:KennedyVideo.pdf|Using video in the BNR usability lab]]'''. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
# Kennedy, S. \\
[[HCIPapers:kennedy-using-video.pdf|'''Using video in the BNR usability
lab'''.]] SIGCHI Bulletin, 21(2), p92-95, ACM Press.(1989)
Changed lines 148-149 from:
#'''[[The use of video in empirical research]]'''. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
to:
# Neal, L. \\
[[HCIPapers:neal-use-video-chibulletin89.pdf|'''The use of video in empirical
research'''.]] (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
Changed lines 92-98 from:
#'''[[Attach:Chap4-6.pdf|Chapter 4: Experimental methodology''';\\
'''Chapter 5: Experimental designs and analysis''';\\
'''Chapter 6
: Hazards to conducting and interpreting HCI experiments]]'''
** From Eberts, R.E. (1994) User Interface Design, Prentice Hall.
** A general and high level introduction to experimental design.

#[[Comparison of menu displays for ordered lists]]. Greenberg, S. and Witten, I. (1984)
In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
to:
#* Eberts, R.E. \\
'''User Interface Design,''' Prentice Hall 1994
** [[HCIPapers
:eberts-uidesign-ch4.pdf|Chapter 4: Experimental methodology; ]]
** [[HCIPapers:eberts-uidesign-ch5.pdf|Chapter 5: Experimental designs and analysis; ]]
** [[HCIPapers:eberts-uidesign-ch6.pdf|Chapter 6: Hazards to conducting and interpreting HCI experiments]]
** All chapters give a general and high level introduction to experimental design.

#Greenberg, S. and Witten, I. (1984) \\
[[http://grouplab.cpsc.ucalgary.ca/papers/1984/84-MenuComparison.CIPS/menu-comparison.CIPS84.pdf|'''Comparison of menu displays for ordered lists''']].
In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
Changed line 56 from:
** [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. p165-205 [[Attach:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]. In particular, read Chapter 6.4: Ethical aspects of tests with human subjects, p181-185.
to:
** [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. p165-205 [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]. In particular, read Chapter 6.4: Ethical aspects of tests with human subjects, p181-185.
Changed lines 53-54 from:

#Text-[[Attach:UsabilityTesting
.pdf|Chapter 6.4: Ethical aspects of tests with human subjects.]] Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
to:
# Nielsen, J. (1993) \\
'''Usability Engineering,''' p273-4, Academic Press
.
** [[HCIPapers:nielson93-usabilityengch6-usabilitytesting-1page.pdf|Chapter 6: Usability testing]]. p165-205 [[Attach:nielson93-usabilityengch6-usabilitytesting-2page.pdf| 2 pages / side ]]. In particular, read Chapter 6.4: Ethical aspects of tests with human subjects, p181-185.
Changed lines 38-40 from:
#[[Chapter 11: Evaluation Techniques (Extract).]] Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
to:
# Dix, A., Finlay, J., Abowd, G., and Beale, R. \\
'''Human Computer
Interaction''', 2nd Edition. Prentice Hall. 1998
** [[HCIPapers:dfab-ch11-evaluation.pdf|Chapter 11: Evaluation Techniques.]] 363-400
Added lines 42-46:

# McGrath, J. \\
[[HCIPapers:mcgrath-methodologymatters-bgbg95.pdf |'''Methodology matters: Doing research in the behavioural and social sciences.''']] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996).
** See also a [[HCIPapers:mcgrath-methodology-summary-bgbg95.pdf|student-created summary]] by Stephanie Smale
** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
Changed lines 48-52 from:
#[[Attach:MethodMatters.pdf|Methodology matters: Doing research in the behavioural and social sciences]]. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
** see the summary chart of this paper, produced by Stephanie Smale

#[[Attach:ApplyingBehav.pdf|Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from [[http://www.jnd.org/dn.mss/BCCSandProducts.html]]
to:
# Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.
Deleted line 33:
** Lecture notes for the talk I give to the class.
Changed line 35 from:
#[[http://www.cpsc.ucalgary.ca/~saul/hci_educ_papers/gould/gould-howto-2-pageperside.pdf | How to design usable systems.]] Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
#[[HCIPapers:gould-howto-2-pageperside.pdf | How to design usable systems.]] Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
December 01, 2006, at 03:26 PM by 136.159.7.242 -
Changed line 279 from:
#Text-[[Chapter 7: Usability Assessment Methods Beyond Testing]]. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
to:
#Text-[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Chapter 7: Usability Assessment Methods Beyond Testing]]. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
Changed line 282 from:
#[[Mapping the method muddle: Guidance in using methods for user interface design]]. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
to:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Mapping the method muddle: Guidance in using methods for user interface design]]. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
Changed line 285 from:
#[[Chapter 34: Comparing methods]]. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
to:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Chapter 34: Comparing methods]]. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
Changed line 288 from:
#[[User interface evaluation in the real world: A comparison of four techniques]]. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|User interface evaluation in the real world: A comparison of four techniques]]. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed line 290 from:
#[[Comparison of empirical testing and walkthrough methods in user interface evaluation]]. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Comparison of empirical testing and walkthrough methods in user interface evaluation]]. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
Changed lines 292-293 from:
#[[Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
to:
#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
December 01, 2006, at 02:30 PM by 136.159.7.242 -
Changed line 186 from:
#Overview of Task Centered Walkthrough [[[Powerpoint]] or [[Adobe PDF]]]
to:
#Overview of Task Centered Walkthrough [[Attach:TaskCentred.ppt|Powerpoint]] or [[Attach:TaskCentred.pdf|Adobe PDF]]
Changed line 192 from:
#[[Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies]]. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
to:
#[[Attach:Chap3Plural.pdf|Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies]]. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
Changed line 205 from:
#[[The Cognitive Walkthrough Method: A Practioner's Guide]]. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
#[[Attach:Chap5CogwalkThr.pdf|The Cognitive Walkthrough Method: A Practioner's Guide]]. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 208 from:
#[[Walkthroughs (Excerpt, page 679-684)]] in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
to:
#[[Attach:CogWalkThrouPre.pdf|Walkthroughs (Excerpt, page 679-684)]] in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
December 01, 2006, at 02:16 PM by 136.159.7.242 -
Changed line 171 from:
#'''[[Attach:Chapt4.pdf|Text-Chapter 5: Usability heuristics]]'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
#'''[[Attach:Chapt5.pdf|Text-Chapter 5: Usability heuristics]]'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
December 01, 2006, at 02:13 PM by 136.159.7.242 -
December 01, 2006, at 02:13 PM by 136.159.7.242 -
Changed line 165 from:
#'''Overview of Heuristic Evaluation''' [[[Powerpoint]] or [[Adobe PDF]]]
to:
#'''Overview of Heuristic Evaluation''' [[Attach:Heuristic.ppt|Powerpoint]] or [[Attach:Heuristic.pdf|Adobe PDF]]]
Changed line 171 from:
#'''[[Text-Chapter 5: Usability heuristics]]'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
#'''[[Attach:Chapt4.pdf|Text-Chapter 5: Usability heuristics]]'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
Changed line 177 from:
#'''[[Chapter 2: Heuristic evaluation]]'''. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
#'''[[Attach:Chap2.pdf|Chapter 2: Heuristic evaluation]]'''. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 180 from:
#'''[[Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up]]'''. Nielsen, J. In Usability Engineering, p273, Academic Press.
to:
#'''[[Attach:Exercise8.pdf|Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up]]'''. Nielsen, J. In Usability Engineering, p273, Academic Press.
December 01, 2006, at 02:05 PM by 136.159.7.242 -
Changed line 159 from:
#[[Chapter 1: Executive summary]]. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
to:
#[[Attach:ExecSum.pdf|Chapter 1: Executive summary]]. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
December 01, 2006, at 02:02 PM by 136.159.7.242 -
Changed line 142 from:
** [[Download the full handout]], which contains:
to:
** [[Attach:RealPhoneAll.pdf|Download the full handout]], which contains:
Changed lines 151-154 from:
** [[The system is available here]], as an installable .exe
** [[The presentation, in powerpoint]]
to:
** [[Attach:RealPhone.exe|The system is available here]], as an installable .exe
** [[Attach:RealPhone.ppt|The presentation, in powerpoint]]
December 01, 2006, at 01:59 PM by 136.159.7.242 -
Changed line 126 from:
#'''[[Getting the whole team into usability testing]]'''. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
to:
#'''[[Attach:EhrlichTesting.pdf|Getting the whole team into usability testing]]'''. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
Changed line 132 from:
#'''[[Using video in the BNR usability lab]]'''. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
#'''[[Attach:KennedyVideo.pdf|Using video in the BNR usability lab]]'''. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
December 01, 2006, at 01:39 PM by 136.159.7.242 -
Changed line 100 from:
#'''[[Mouse-Typing on Phone Pads and Keyboards]]'''
to:
#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''
Changed line 106 from:
#'''Text-[[Chapter 6: Usability testing]]'''. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
#'''Text-[[Attach:UsabilityTesting.pdf|Chapter 6: Usability testing]]'''. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
December 01, 2006, at 12:05 PM by 136.159.7.242 -
Changed line 88 from:
#'''[[Attach:Exec4-6.pdf|Chapter 4: Experimental methodology''';\\
to:
#'''[[Attach:Chap4-6.pdf|Chapter 4: Experimental methodology''';\\
December 01, 2006, at 12:02 PM by 136.159.7.242 -
Changed lines 88-90 from:
#'''[[Chapter 4: Experimental methodology]]''';\\
'''[[Chapter 5: Experimental designs and analysis]]''';\\
'''[[Chapter 6: Hazards to conducting and interpreting HCI experiments]]'''
to:
#'''[[Attach:Exec4-6.pdf|Chapter 4: Experimental methodology''';\\
'''Chapter 5: Experimental designs and analysis''';\\
'''Chapter 6: Hazards to conducting and interpreting HCI experiments]]'''
December 01, 2006, at 11:59 AM by 136.159.7.242 -
Changed lines 81-82 from:
#'''Quantitative methods''' [[[Powerpoint]] or [[Adobe PDF]]]\\
'''Analysis of Variance''' [[[Powerpoint]] or [[Adobe PDF]]]\\
to:
#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\
'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\
December 01, 2006, at 10:47 AM by 136.159.7.242 -
Changed lines 70-73 from:
**** [[Instructions for Ethics Review Applicants]]
**** [[Ethics review application form]]
**** [[Sample consent form]]
to:
**** [[Attach:EthicsGuide.doc|Instructions for Ethics Review Applicants]]
**** [[Attach:EthicsReview.doc|Ethics review application form]]
**** [[Attach:Consent.doc|Sample consent form]]
December 01, 2006, at 10:44 AM by 136.159.7.242 -
Changed line 69 from:
** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[excerpt from that page]] includes:
to:
** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[Attach:ExcerptEthical.doc|excerpt from that page]] includes:
December 01, 2006, at 10:42 AM by 136.159.7.242 -
Changed line 59 from:
** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[U of C]] [[Ethics site for the latest update]]
to:
** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/UofC/research/html/ethics/poli_guide.html|Ethics site for the latest update]]
December 01, 2006, at 10:40 AM by 136.159.7.242 -
Changed line 58 from:
#Excerpt of [[University of Calgary Policy Statement Ethical Conduct for Research Involving Humans]], Research Services
to:
#Excerpt of [[Attach:UofCEthics.pdf|University of Calgary Policy Statement Ethical Conduct for Research Involving Humans]], Research Services
December 01, 2006, at 10:38 AM by 136.159.7.242 -
Changed line 55 from:
#[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|Research Participants' Bill of Rights]] by Tim Rogers [[[Attach:ParticipantsRights.pdf|also as PDF]]]
to:
#[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|Research Participants' Bill of Rights]] by Tim Rogers [[Attach:ParticipantsRights.pdf|also as PDF]]
December 01, 2006, at 10:37 AM by 136.159.7.242 -
Changed line 55 from:
#[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|Research Participants' Bill of Rights]] by Tim Rogers [[[also as PDF]]]
to:
#[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|Research Participants' Bill of Rights]] by Tim Rogers [[[Attach:ParticipantsRights.pdf|also as PDF]]]
December 01, 2006, at 10:36 AM by 136.159.7.242 -
Changed line 53 from:
** A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on [[Ethics]], which summarizes some of Nielson's points.
to:
** A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on [[Attach:Ethics.pdf|Ethics]], which summarizes some of Nielson's points.
December 01, 2006, at 10:32 AM by 136.159.7.242 -
Changed line 52 from:
#Text-[[Chapter 6.4: Ethical aspects of tests with human subjects.]] Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
to:
#Text-[[Attach:UsabilityTesting.pdf|Chapter 6.4: Ethical aspects of tests with human subjects.]] Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
December 01, 2006, at 10:28 AM by 136.159.7.242 -
Changed line 42 from:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
#[[Attach:MethodMatters.pdf|Methodology matters: Doing research in the behavioural and social sciences]]. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 46 from:
#[[Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from [[http://www.jnd.org/dn.mss/BCCSandProducts.html]]
to:
#[[Attach:ApplyingBehav.pdf|Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from [[http://www.jnd.org/dn.mss/BCCSandProducts.html]]
December 01, 2006, at 10:22 AM by 136.159.7.242 -
Changed lines 32-33 from:
#[[Overview of methodologies [Powerpoint]]]
** also as [Adobe PDF]
to:
#[[Attach:OverviewMethod.ppt|Overview of methodologies [Powerpoint]]]
** also as [[Attach:OverviewMethod.pdf|Adobe PDF]]
Changed line 42 from:
#[[http://www.cpsc.ucalgary.ca/~saul/hci_educ_papers/mcgrath/mcgrath-typology.pdf| Methodology matters: Doing research in the behavioural and social sciences.]] McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 42 from:
#[[http://www.cpsc.ucalgary.ca/~saul/hci_educ_papers/mcgrath-typology.pdf| Methodology matters: Doing research in the behavioural and social sciences.]] McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
#[[http://www.cpsc.ucalgary.ca/~saul/hci_educ_papers/mcgrath/mcgrath-typology.pdf| Methodology matters: Doing research in the behavioural and social sciences.]] McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 36 from:
#[[How to design usable systems.]] Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
#[[http://www.cpsc.ucalgary.ca/~saul/hci_educ_papers/gould/gould-howto-2-pageperside.pdf | How to design usable systems.]] Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
Changed line 42 from:
#[[Methodology matters: Doing research in the behavioural and social sciences.]] McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
#[[http://www.cpsc.ucalgary.ca/~saul/hci_educ_papers/mcgrath-typology.pdf| Methodology matters: Doing research in the behavioural and social sciences.]] McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
November 29, 2006, at 03:47 PM by 136.159.7.242 -
Changed lines 252-253 from:
#[[First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.]] Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. [[http://www.useit.com/alertbox/20010805.html]] and [[20020120.html]]
to:
#[[First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.]] Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. [[http://www.useit.com/alertbox/20010805.html]] and [[http://www.useit.com/alertbox/20020120.html|20020120.html]]
November 29, 2006, at 03:45 PM by 136.159.7.242 -
Changed lines 252-253 from:
#[[First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.]] Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and [[20020120.html]]
to:
#[[First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.]] Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. [[http://www.useit.com/alertbox/20010805.html]] and [[20020120.html]]
Changed lines 260-262 from:
#Getting Started with Contextual Techniques. Incontext, Inc. [[http://www.incent.com/connection.indx/techniques.html]]
to:
#Getting Started with Contextual Techniques. Incontext, Inc. [[http://www.incent.com]]
November 29, 2006, at 03:14 PM by 136.159.7.242 -
November 29, 2006, at 03:14 PM by 136.159.7.242 -
Changed line 55 from:
#[[Research Participants' Bill of Rights]] by Tim Rogers [[[also as PDF]]]
to:
#[[http://www.psych.ucalgary.ca/research/ethics/participant_rights.html|Research Participants' Bill of Rights]] by Tim Rogers [[[also as PDF]]]
November 29, 2006, at 03:05 PM by 136.159.7.242 -
Changed line 46 from:
#[[Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from [[ERRORhttp://www.jnd.org/dn.mss/BCCSandProducts.html]]
to:
#[[Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from [[http://www.jnd.org/dn.mss/BCCSandProducts.html]]
November 29, 2006, at 03:04 PM by 136.159.7.242 -
Changed line 46 from:
#[[Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
#[[Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from [[ERRORhttp://www.jnd.org/dn.mss/BCCSandProducts.html]]
November 29, 2006, at 02:40 PM by 136.159.7.242 -
Changed lines 212-214 from:
!!! Topics below here are optional and/or subject to change
to:
!!''Topics below here are optional and/or subject to change''
Changed lines 252-253 from:
#First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational. Jakob Nielsen, Alertbox, August 5, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html
to:
#[[First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.]] Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. http://www.useit.com/alertbox/20010805.html and [[20020120.html]]
Changed lines 260-262 from:
#Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html
to:
#Getting Started with Contextual Techniques. Incontext, Inc. [[http://www.incent.com/connection.indx/techniques.html]]
Changed line 279 from:
#Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
to:
#Text-[[Chapter 7: Usability Assessment Methods Beyond Testing]]. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
Changed line 282 from:
#Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
to:
#[[Mapping the method muddle: Guidance in using methods for user interface design]]. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
Changed line 285 from:
#Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
to:
#[[Chapter 34: Comparing methods]]. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
Changed line 288 from:
#User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
#[[User interface evaluation in the real world: A comparison of four techniques]]. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed line 290 from:
#Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
#[[Comparison of empirical testing and walkthrough methods in user interface evaluation]]. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
Changed lines 292-293 from:
#Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
to:
#[[Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.
November 29, 2006, at 02:33 PM by 136.159.7.242 -
Added line 97:
Added line 103:
November 29, 2006, at 02:32 PM by 136.159.7.242 -
Added line 194:
Changed line 196 from:
** Describes task-centered system design and how tasks are used to define walkthroughs.
to:
**** Describes task-centered system design and how tasks are used to define walkthroughs.
Changed line 198 from:
** The book that started it off. The above reading is in this book
to:
**** The book that started it off. The above reading is in this book
November 29, 2006, at 02:30 PM by 136.159.7.242 -
Changed line 214 from:
[[Text-Extract-Chapter 4.8: Prototyping]]. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
to:
#[[Text-Extract-Chapter 4.8: Prototyping]]. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
Changed lines 232-233 from:
** Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
to:
**** Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
Changed lines 235-236 from:
** Experiences with Pictive and recommendations.
to:
**** Experiences with Pictive and recommendations.
Changed lines 238-239 from:
** Describes a sophisticated video prototyping project.
to:
**** Describes a sophisticated video prototyping project.
Changed lines 241-243 from:
** Describes a system that lets people sketch and storyboard through a live computer interface.
to:
**** Describes a system that lets people sketch and storyboard through a live computer interface.
November 29, 2006, at 02:26 PM by 136.159.7.242 -
Changed line 85 from:
#'''To read again: [[Section 11.5.1: Empirical methods''' (Extract)]]. Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
#'''To read again: [[Section 11.5.1: Empirical methods (Extract)]]'''. Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
November 29, 2006, at 02:24 PM by 136.159.7.242 -
Changed lines 214-216 from:
1. [[Text-Extract-Chapter 4.8: Prototyping]]. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
* Describes different styles of prototypes and how they can be used within scenarios.
to:
[[Text-Extract-Chapter 4.8: Prototyping]]. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
** Describes different styles of prototypes and how they can be used within scenarios.
Changed lines 217-218 from:
2. [[Prototyping for tiny fingers]]. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
* A simple way to build low fidelity prototypes, similar to Pictive
to:
#[[Prototyping for tiny fingers]]. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
** A simple way to build low fidelity prototypes, similar to Pictive
Changed lines 220-221 from:
3. [[Low vs. high fidelity prototyping debate]]. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
* When are where you should use low vs. high fidelity prototypes
to:
#[[Low vs. high fidelity prototyping debate]]. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
** When are where you should use low vs. high fidelity prototypes
Changed lines 223-224 from:
4. [[Pictive: An exploration in participatory design]]. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
* A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
to:
#[[Pictive: An exploration in participatory design]]. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies
Changed lines 226-243 from:
5. [[Composing letters with a simulated listening typewriter]]. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
* The first description of the Wizard of Oz prototyping/testing method.

Supplemental Readings

* [[Prototyping an intelligent agent through Wizard of Oz]]. Maulsby, D., Greenberg, S. and Mander
, R. (1993). Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
o Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.

* [[Retrospective on a year of participatory design using the PICTIVE technique]] Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
o Experiences with Pictive and recommendations.

* [[The “Starfire” video prototype project: a case history]] Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
o Describes a sophisticated video prototyping project.

* [[Interactive sketching for the early stages of user interface design]]. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
o
Describes a system that lets people sketch and storyboard through a live computer interface.
to:
#[[Composing letters with a simulated listening typewriter]]. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
** The first description of the Wizard of Oz prototyping/testing method.

'''Supplemental Readings'''

* [[Prototyping an intelligent agent through
Wizard of Oz]]. Maulsby, D., Greenberg, S. and Mander, R. (1993). Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
** Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ
.

* [[Retrospective on a year of participatory design using the PICTIVE technique]] Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
** Experiences with Pictive and recommendations.

* [[The “Starfire” video prototype project: a case history]] Bruce Tognazzini
Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
** Describes a sophisticated video prototyping project.

* [[Interactive sketching for the early stages of user interface design]]
. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
**
Describes a system that lets people sketch and storyboard through a live computer interface.
Changed lines 247-254 from:
Introduction


1. First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational. Jakob Nielsen
, Alertbox, August 5, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html

Contextual Inquiry

1.
Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
to:
'''Introduction'''

#First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational. Jakob Nielsen, Alertbox, August 5
, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html

'''Contextual Inquiry'''

#
Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.
Changed line 255 from:
2. Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
to:
#Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.
Changed lines 257-262 from:
3. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html

Ethnography

1
. Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.
* Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.
to:
#Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html


'''
Ethnography'''

#Chapter 3: Social Computing
. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.
** Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.
Changed line 265 from:
2. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
to:
#Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.
Changed line 267 from:
3. Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994) In Proc CSCW'94, p429439, ACM Press.
to:
#Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994) In Proc CSCW'94, p429439, ACM Press.
Changed lines 269-272 from:
4. Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
* Excerpts: Sections 3, 4,5,7
to:
#Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
** Excerpts: Sections 3, 4,5,7
Changed lines 276-277 from:
1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
* Introduces observations, questionnaires and interviews, focus groups, logging, user feedback, and how to choose between them.
to:
#Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
** Introduces observations, questionnaires and interviews, focus groups, logging, user feedback, and how to choose between them.
Changed lines 279-280 from:
2. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
* The authors associate a variety of methodological approaches to specific interface design activities.
to:
#Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
** The authors associate a variety of methodological approaches to specific interface design activities.
Changed lines 282-283 from:
3. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
* Provides an overview of previous comparative studies of evaluation methods.
to:
#Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
** Provides an overview of previous comparative studies of evaluation methods.
Changed line 285 from:
4. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
to:
#User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.
Changed line 287 from:
5. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
to:
#Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.
Changed lines 289-291 from:
6. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2004
to:
#Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

'-''Last updated Fall, 2004''-'
November 29, 2006, at 02:10 PM by 136.159.7.242 -
November 29, 2006, at 02:07 PM by 136.159.7.242 -
Changed line 124 from:
#'''Getting the whole team into usability testing'''. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
to:
#'''[[Getting the whole team into usability testing]]'''. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
Changed line 127 from:
#'''Constructive interaction: A method for studying user-computer-user interaction'''. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
to:
#'''[[Constructive interaction: A method for studying user-computer-user interaction]]'''. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
Changed line 130 from:
#'''Using video in the BNR usability lab'''. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
#'''[[Using video in the BNR usability lab]]'''. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
Changed line 133 from:
#'''The use of video in empirical research'''. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
to:
#'''[[The use of video in empirical research]]'''. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
Changed line 140 from:
** Download the full handout, which contains:
to:
** [[Download the full handout]], which contains:
Changed lines 149-152 from:
** The system is available here, as an installable .exe
** The presentation, in powerpoint
to:
** [[The system is available here]], as an installable .exe
** [[The presentation, in powerpoint]]
Changed line 157 from:
#Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
to:
#[[Chapter 1: Executive summary]]. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
Changed line 202 from:
#The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
#[[The Cognitive Walkthrough Method: A Practioner's Guide]]. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 205 from:
#Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
to:
#[[Walkthroughs (Excerpt, page 679-684)]] in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
Changed line 215 from:
1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
to:
1. [[Text-Extract-Chapter 4.8: Prototyping]]. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
Changed line 218 from:
2. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
to:
2. [[Prototyping for tiny fingers]]. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
Changed line 221 from:
3. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
to:
3. [[Low vs. high fidelity prototyping debate]]. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
Changed line 224 from:
4. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
to:
4. [[Pictive: An exploration in participatory design]]. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
Changed line 227 from:
5. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
to:
5. [[Composing letters with a simulated listening typewriter]]. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
Changed line 232 from:
* Prototyping an intelligent agent through Wizard of Oz. Maulsby, D., Greenberg, S. and Mander, R. (1993). Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
to:
* [[Prototyping an intelligent agent through Wizard of Oz]]. Maulsby, D., Greenberg, S. and Mander, R. (1993). Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
Changed lines 234-235 from:
* Retrospective on a year of participatory design using the PICTIVE technique Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
to:
* [[Retrospective on a year of participatory design using the PICTIVE technique]] Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
Changed lines 237-238 from:
* The “Starfire” video prototype project: a case history Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
to:
* [[The “Starfire” video prototype project: a case history]] Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
Changed line 241 from:
* Interactive sketching for the early stages of user interface design. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
to:
* [[Interactive sketching for the early stages of user interface design]]. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
November 29, 2006, at 02:01 PM by 136.159.7.242 -
Changed line 85 from:
#'''To read again: Section 11.5.1: Empirical methods''' (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
#'''To read again: [[Section 11.5.1: Empirical methods''' (Extract)]]. Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
Changed lines 88-90 from:
#'''Chapter 4: Experimental methodology''';\\
'''Chapter 5: Experimental designs and analysis''';\\
'''Chapter 6: Hazards to conducting and interpreting HCI experiments'''
to:
#'''[[Chapter 4: Experimental methodology]]''';\\
'''[[Chapter 5: Experimental designs and analysis]]''';\\
'''[[Chapter 6: Hazards to conducting and interpreting HCI experiments]]'''
Changed lines 93-94 from:
#Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
to:
#[[Comparison of menu displays for ordered lists]]. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
Changed line 99 from:
#'''Mouse-Typing on Phone Pads and Keyboards'''
to:
#'''[[Mouse-Typing on Phone Pads and Keyboards]]'''
Changed line 104 from:
#'''Text-Chapter 6: Usability testing'''. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
#'''Text-[[Chapter 6: Usability testing]]'''. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
Changed line 107 from:
#'''Discussion of guidelines for user observation'''. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
to:
#'''[[Discussion of guidelines for user observation]]'''. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
Changed lines 112-122 from:
**** 2: Introducing usability testing
**** 6: Establishing a usability program in your organization
**** 7: Planning a usability test
**** 9: Deciding who should be participants
**** 11: Selecting and organizing tasks to test
**** 12: Creating task scenarios
**** 15: Preparing the testing environment
**** 18: Caring for the test participants
**** 19: Conducting the test
**** Appendix A: Setting up a usability laboratory
**** All of the above as a single PDF
to:
**** [[2: Introducing usability testing]]
**** [[6: Establishing a usability program in your organization]]
**** [[7: Planning a usability test]]
**** [[9: Deciding who should be participants]]
**** [[11: Selecting and organizing tasks to test]]
**** [[12: Creating task scenarios]]
**** [[15: Preparing the testing environment]]
**** [[18: Caring for the test participants]]
**** [[19: Conducting the test]]
**** [[Appendix A: Setting up a usability laboratory]]
**** [[All of the above as a single PDF]]
November 29, 2006, at 01:57 PM by 136.159.7.242 -
November 29, 2006, at 01:57 PM by 136.159.7.242 -
Changed lines 193-197 from:
* [[Getting to Know Users and their Tasks]]. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
o Describes task-centered system design and how tasks are used to define walkthroughs.
* [[Task-Centered User Interface Design: A Practical Introduction]]. Lewis, C. and Rieman, J. (1993) Available as Shareware.
o
The book that started it off. The above reading is in this book
to:
* [[Getting to Know Users and their Tasks]]. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
** Describes task-centered system design and how tasks are used to define walkthroughs.
* [[Task-Centered User Interface Design: A Practical Introduction]]. Lewis, C
. and Rieman, J. (1993) Available as Shareware.
**
The book that started it off. The above reading is in this book
Changed lines 201-202 from:
6. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
* This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
to:
#The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
** This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
Changed lines 204-206 from:
7. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
* This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
to:
#Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
** This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.
November 29, 2006, at 01:55 PM by 136.159.7.242 -
Changed line 165 from:
#'''Improving a human-computer dialogue''', Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
to:
#'''[[Improving a human-computer dialogue]]''', Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
Changed line 168 from:
#'''Text-Chapter 5: Usability heuristics'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
to:
#'''[[Text-Chapter 5: Usability heuristics]]'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
Changed line 171 from:
#'''Enhancing the explanatory power of usability heuristics'''. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
to:
#'''[[Enhancing the explanatory power of usability heuristics]]'''. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
Changed line 174 from:
#'''Chapter 2: Heuristic evaluation'''. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
to:
#'''[[Chapter 2: Heuristic evaluation]]'''. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
Changed line 177 from:
#'''Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up'''. Nielsen, J. In Usability Engineering, p273, Academic Press.
to:
#'''[[Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up]]'''. Nielsen, J. In Usability Engineering, p273, Academic Press.
Changed lines 183-184 from:
1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
* My presentation that I give in CPSC 481
to:
#Overview of Task Centered Walkthrough [[[Powerpoint]] or [[Adobe PDF]]]
**
My presentation that I give in CPSC 481
Changed lines 186-187 from:
2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
* A how-to approach to task-centered system design.
to:
#[[Working through task-centered system design]]. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
** A how-to approach to task-centered system design.
Changed lines 189-194 from:
3. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
* Describe the steps in the pluralistic walkthough process.

Supplemental Readings

* Getting to Know Users and their Tasks
. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
to:
#[[Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies]]. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
** Describe the steps in the pluralistic walkthough process.

'''Supplemental Readings'''

* [[Getting to Know Users and their Tasks]]. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
Changed line 196 from:
* Task-Centered User Interface Design: A Practical Introduction. Lewis, C. and Rieman, J. (1993) Available as Shareware.
to:
* [[Task-Centered User Interface Design: A Practical Introduction]]. Lewis, C. and Rieman, J. (1993) Available as Shareware.
Changed lines 200-201 from:
Cognitive Walkthroughs
to:
'''Cognitive Walkthroughs'''
November 29, 2006, at 01:49 PM by 136.159.7.242 -
Changed line 85 from:
#To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
#'''To read again: Section 11.5.1: Empirical methods''' (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
November 29, 2006, at 01:48 PM by 136.159.7.242 -
Changed line 139 from:
** Download the full handout, which contains
to:
** Download the full handout, which contains:
Deleted line 155:
Changed line 162 from:
#Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
to:
#'''Overview of Heuristic Evaluation''' [[[Powerpoint]] or [[Adobe PDF]]]
Added lines 164-169:

#'''Improving a human-computer dialogue''', Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
** This article lists the heuristics and presents a working example, solutions, and alternatives.

#'''Text-Chapter 5: Usability heuristics'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
** Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.
Changed lines 171-172 from:
2. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
* This article lists the heuristics and presents a working example, solutions, and alternatives
.
to:
#'''Enhancing the explanatory power of usability heuristics'''. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database
.
Changed lines 174-175 from:
3. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
* Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.
to:
#'''Chapter 2: Heuristic evaluation'''. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
** A more in depth discussion of how heuristic evaluation works and its reliability
Changed lines 177-178 from:
4. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
* This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database
.
to:
#'''Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up'''. Nielsen, J. In Usability Engineering, p273, Academic Press.
** Another example, with answers, of a heuristic evaluation
.
Changed lines 180-181 from:
5. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
* A more in depth discussion of how heuristic evaluation works and its reliability
to:
'''Task-Centered Walkthroughs'''

1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
* My presentation that I give in CPSC 481
Changed lines 186-187 from:
6. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
* Another example, with answers, of a heuristic evaluation
.
to:
2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
* A how-to approach to task-centered system design
.
Deleted lines 188-196:

Task-Centered Walkthroughs

1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
* My presentation that I give in CPSC 481

2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
* A how-to approach to task-centered system design.
November 29, 2006, at 01:42 PM by 136.159.7.242 -
Changed line 82 from:
'''Analysis of Variance''' [[[Powerpoint]] or [[Adobe PDF]]]
to:
'''Analysis of Variance''' [[[Powerpoint]] or [[Adobe PDF]]]\\
November 29, 2006, at 01:41 PM by 136.159.7.242 -
Changed lines 81-84 from:
#Quantitative methods [[[Powerpoint]] or [[Adobe PDF]]]
Analysis of Variance [[[Powerpoint]] or [[Adobe PDF]]]
* Lecture notes for the talk I give to the class.
to:
#'''Quantitative methods''' [[[Powerpoint]] or [[Adobe PDF]]]\\
'''Analysis of Variance''' [[[Powerpoint]] or [[Adobe PDF
]]]
* Lecture notes for the talk I give to the class.
Changed line 86 from:
* the chapter you previously read includes a section on controlled experiments
to:
** the chapter you previously read includes a section on controlled experiments
Changed lines 88-92 from:
#Chapter 4: Experimental methodology;
Chapter 5: Experimental designs and analysis;
Chapter 6: Hazards to conducting and interpreting HCI experiments
From Eberts, R.E. (1994) User Interface Design, Prentice Hall.
* A general and high level introduction to experimental design.
to:
#'''Chapter 4: Experimental methodology''';\\
'''Chapter 5: Experimental designs and
analysis''';\\
'''Chapter 6: Hazards to conducting and interpreting HCI
experiments'''
** From Eberts, R.E. (1994) User Interface Design
, Prentice Hall.
**
A general and high level introduction to experimental design.
Changed lines 94-100 from:
* This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise

#Mouse-Typing on Phone Pads and Keyboards
We will perform a 'pilot' controlled study on how people perform on different types of keyboards
to:
** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

'''Excercise'''

#'''Mouse-Typing on Phone Pads and Keyboards'''
We
will perform a 'pilot' controlled study on how people perform on different types of keyboards
Changed line 103 from:
#Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
to:
#'''Text-Chapter 6: Usability testing'''. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
Changed line 106 from:
#Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
to:
#'''Discussion of guidelines for user observation'''. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
Changed line 109 from:
#Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
to:
#'''Text-A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
Changed line 123 from:
#Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
to:
#'''Getting the whole team into usability testing'''. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
Changed line 126 from:
#Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
to:
#'''Constructive interaction: A method for studying user-computer-user interaction'''. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
Changed line 129 from:
#Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
to:
#'''Using video in the BNR usability lab'''. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
Changed line 132 from:
#The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
to:
#'''The use of video in empirical research'''. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
Changed lines 135-137 from:
Excercise (to be handed out)

#Get real with IBM RealPhone
to:
'''Excercise (to be handed out)'''

#'''Get real with IBM RealPhone'''
November 29, 2006, at 12:01 PM by 136.159.7.242 -
Changed lines 80-82 from:
Experimental methodologies

1.
Quantitative methods [[[Powerpoint]] or [[Adobe PDF]]]
to:
'''Experimental methodologies'''
#
Quantitative methods [[[Powerpoint]] or [[Adobe PDF]]]
Changed lines 84-86 from:
2.

To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
to:
#To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
Changed line 88 from:
3. Chapter 4: Experimental methodology;
to:
#Chapter 4: Experimental methodology;
Changed lines 93-95 from:
4.

Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
to:
#Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
Changed line 98 from:
5. Mouse-Typing on Phone Pads and Keyboards
to:
#Mouse-Typing on Phone Pads and Keyboards
Changed lines 101-104 from:
Usability Testing

1
. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
* An excellent overview to various usability testing methodologies.
to:
'''Usability Testing'''

#Text-Chapter 6: Usability testing
. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
**
An excellent overview to various usability testing methodologies.
Changed lines 106-107 from:
2. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
* This reading is an excellent recipe for performing usability studies.
to:
#Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
** This reading is an excellent recipe for performing usability studies.
Changed lines 109-121 from:
3. Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
* An in-depth treatment of usability testing. The chapters we use are:
o 2: Introducing usability testing
o 6
: Establishing a usability program in your organization
o 7: Planning a usability test
o 9: Deciding who should be participants
o 11: Selecting and organizing tasks to test
o 12: Creating task scenarios
o 15: Preparing the testing environment
o 18: Caring for the test participants
o 19: Conducting the test
o Appendix A: Setting up a usability laboratory
o
All of the above as a single PDF
to:
#Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
** An in-depth treatment of usability testing. The chapters we use are:
**** 2: Introducing usability testing
**** 6: Establishing a usability program in your organization
**** 7: Planning a usability test
**** 9: Deciding who should be participants
**** 11: Selecting and organizing tasks to test
**** 12: Creating task scenarios
**** 15: Preparing the testing environment
**** 18: Caring for the test participants
**** 19
: Conducting the test
**** Appendix A: Setting up a usability laboratory
****
All of the above as a single PDF
Changed lines 123-124 from:
4. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
* Tips and reasons for including developers as part of the evaluation team.
to:
#Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
** Tips and reasons for including developers as part of the evaluation team.
Changed lines 126-127 from:
5. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
* Describes a method for observing people working together.
to:
#Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
** Describes a method for observing people working together.
Changed lines 129-130 from:
6. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
* As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.
to:
#Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
** As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.
Changed lines 132-134 from:
7. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
* Further reasons why one should videotape usability sessions.
to:
#The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
** Further reasons why one should videotape usability sessions.
Changed lines 137-151 from:
8. Get real with IBM RealPhone
* We will perform a usability study on IBM's RealPhone system
* Download the full handout, which contains
o the presentation
o evaluator's instructions and tasks
o consent form
o Pre-test, During-test and Post-test questions
o methods for running a basic observational study
o discussion of guidelines for user observation
o IBM Real Phone Instruction Sheet and their test-drive instructions
o Isys' Hall of Shame critique of RealPhone
* The system is available here, as an installable .exe
* The presentation, in powerpoint
to:
#Get real with IBM RealPhone
** We will perform a usability study on IBM's RealPhone system
** Download the full handout, which contains
**** the presentation
**** evaluator's instructions and tasks
**** consent form
**** Pre-test, During-test and Post-test questions
**** methods for running a basic observational study
**** discussion of guidelines for user observation
**** IBM Real Phone Instruction Sheet and their test-drive instructions
**** Isys' Hall of Shame critique of RealPhone
** The system is available here, as an installable .exe
**
The presentation, in powerpoint
Changed lines 155-158 from:
Overview

1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
* An exectuive summary and discussion of inspection methods.
to:
'''Overview'''

#Chapter
1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
** An exectuive summary and discussion of inspection methods.
Changed lines 161-164 from:
Usability Heuristics and Heuristic Evaluation

1. Overview of Heuristic Evaluation [Powerpoint or Adobe
PDF]
* My presentation that I give in CPSC 481
to:
'''Usability Heuristics and Heuristic Evaluation'''

#Overview of Heuristic Evaluation [Powerpoint or Adobe
PDF]
** My presentation that I give in CPSC 481
November 29, 2006, at 11:56 AM by 136.159.7.242 -
Changed lines 69-76 from:
** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
**** Instructions for Ethics Review Applicants
**** Ethics review application form
**** Sample consent form

'-''Supplemental Readings available in the Optional Readings sections''-'
to:
** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[excerpt from that page]] includes:
**** [[Instructions for Ethics Review Applicants]]
**** [[Ethics review application form]]
**** [[Sample consent form]]

'-''Supplemental Readings available in the [[Optional Readings]] sections''-'
Changed lines 82-83 from:
1. Quantitative methods [Powerpoint or Adobe PDF]
Analysis of Variance [Powerpoint or Adobe PDF]
to:
1. Quantitative methods [[[Powerpoint]] or [[Adobe PDF]]]
Analysis of Variance [[[Powerpoint]] or [[Adobe PDF]]]
November 29, 2006, at 11:54 AM by 136.159.7.242 -
Changed lines 52-53 from:
#Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
** A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
to:
#Text-[[Chapter 6.4: Ethical aspects of tests with human subjects.]] Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
** A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on [[Ethics]], which summarizes some of Nielson's points.
Changed line 55 from:
#Research Participants' Bill of Rights by Tim Rogers [also as PDF]
to:
#[[Research Participants' Bill of Rights]] by Tim Rogers [[[also as PDF]]]
Changed lines 58-59 from:
#Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
to:
#Excerpt of [[University of Calgary Policy Statement Ethical Conduct for Research Involving Humans]], Research Services
** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[U of C]] [[Ethics site for the latest update]]
November 29, 2006, at 11:52 AM by 136.159.7.242 -
Changed line 32 from:
#Overview of methodologies [Powerpoint]
to:
#[[Overview of methodologies [Powerpoint]]]
Changed line 36 from:
#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
#[[How to design usable systems.]] Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
Changed line 39 from:
#Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
to:
#[[Chapter 11: Evaluation Techniques (Extract).]] Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
Changed line 42 from:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
#[[Methodology matters: Doing research in the behavioural and social sciences.]] McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
Changed line 46 from:
#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
#[[Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
November 29, 2006, at 11:50 AM by 136.159.7.242 -
Changed lines 18-21 from:
#A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
#Usability Engineering, Nielsen, J. (1993) Academic Press.
#Papers of the remaining readings will be made available to you at cost.
to:
#'''A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
#'''Usability Engineering''', Nielsen, J. (1993) Academic Press.
#'''Papers of the remaining readings''' will be made available to you at cost.
Changed lines 24-26 from:
#Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
to:
#'''Usability Inspection Methods''' (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
November 29, 2006, at 11:49 AM by 136.159.7.242 -
Changed lines 32-34 from:
#Overview of methodologies [Powerpoint]\\
* also as [Adobe PDF]
* Lecture notes for the talk I give to the class.
to:
#Overview of methodologies [Powerpoint]
** also as [Adobe PDF]
** Lecture notes for the talk I give to the class.
Changed lines 36-37 from:
#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.\\
* This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
to:
#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
** This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
Changed lines 39-40 from:
#Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.\\
* This useful overview chapter briefly surveys a variety of methodologies.
to:
#Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
** This useful overview chapter briefly surveys a variety of methodologies.
Changed lines 42-44 from:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.\\
* This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
* see the summary chart of this paper, produced by Stephanie Smale
to:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
** see the summary chart of this paper, produced by Stephanie Smale
Changed lines 46-49 from:
#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html\\
* This essay contrasts the academic vs business approach to product development.
to:
#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
** This essay contrasts the academic vs business approach to product development.
Changed lines 52-54 from:
1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
* A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
to:
#Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
** A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.
Changed lines 55-56 from:
2. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
* A concise statement of what participant's should expect as fair treatment
to:
#Research Participants' Bill of Rights by Tim Rogers [also as PDF]
** A concise statement of what participant's should expect as fair treatment
Changed lines 58-66 from:
3. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
* This is an extract from the official University of Calgary policy on ethics
. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
o Section 1 - verify that your work requires ethics clearance,
o Section 6 - if your application concerns course-based research,
o Section 8 for your procedural responsibilities
o Section 9 for guidelines on balancing risks vs benefits
o Section 10 on how to do informed consent
o Section 11 for guidelines on deception (research involving any deception is usually considered risky)
o
Section 12 for guidelines on maintaining privacy and confidentiality
to:
#Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University
. Go to the U of C Ethics site for the latest update
**** Section 1 - verify that your work requires ethics clearance,
**** Section 6 - if your application concerns course-based research,
**** Section 8 for your procedural responsibilities
**** Section 9 for guidelines on balancing risks vs benefits
**** Section 10 on how to do informed consent
**** Section 11 for guidelines on deception (research involving any deception is usually considered risky)
****
Section 12 for guidelines on maintaining privacy and confidentiality
Changed lines 68-76 from:
4. Ethics application
* A set
of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
o Instructions for Ethics Review Applicants
o Ethics review application form
o Sample consent form

Supplemental Readings available in the Optional Readings
sections
to:
#Ethics application
** A set of pointers and steps describing what you need to do at the University
of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
**** Instructions for Ethics Review Applicants
**** Ethics review application form
**** Sample consent form

'-''Supplemental Readings available in the Optional Readings
sections''-'
November 29, 2006, at 11:45 AM by 136.159.7.242 -
Changed line 32 from:
#Overview of methodologies [Powerpoint]
to:
#Overview of methodologies [Powerpoint]\\
Changed line 36 from:
#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
to:
#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.\\
Changed line 39 from:
#Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
to:
#Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.\\
Changed line 42 from:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
to:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.\\
Changed line 46 from:
#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
to:
#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html\\
November 29, 2006, at 11:44 AM by 136.159.7.242 -
Changed lines 24-26 from:
1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
to:
#Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.
Changed lines 32-36 from:


1. Overview of methodologies [Powerpoint]
* also as [Adobe PDF]
* Lecture notes for the talk I give to the class.
to:
#Overview of methodologies [Powerpoint]
* also as [Adobe PDF
]
* Lecture notes for the talk I give to the class.
Changed lines 36-37 from:
2. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
* This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
to:
#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
* This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.
Changed lines 39-40 from:
3. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
* This useful overview chapter briefly surveys a variety of methodologies.
to:
#Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
* This useful overview chapter briefly surveys a variety of methodologies.
Changed lines 42-44 from:
4. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
* This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
* see the summary chart of this paper, produced by Stephanie Smale
to:
#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
* This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
* see the summary chart of this paper, produced by Stephanie Smale
Changed lines 46-49 from:
5. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
* This essay contrasts the academic vs business approach to product development.
to:
#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
* This essay contrasts the academic vs business approach to product development.
November 29, 2006, at 11:39 AM by 136.159.7.242 -
Changed lines 16-21 from:
Required

1. A Practical Guide to Usability Testing
. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
2. Usability Engineering, Nielsen, J. (1993) Academic Press.
3.
Papers of the remaining readings will be made available to you at cost.
to:
Required:

#A Practical Guide to Usability Testing. Revised Edition. Dumas, J
.S. and Redish, J.C. (1999)
#Usability Engineering
, Nielsen, J. (1993) Academic Press.
#Papers of the remaining readings will be made available to you at cost.
November 29, 2006, at 11:38 AM by 136.159.7.242 -
Changed lines 9-10 from:
Course texts
to:


!!!
Course texts
Changed lines 26-27 from:
Overview of methodologies
to:

!!!
Overview of methodologies
Changed lines 51-52 from:
Ethics
to:

!!!
Ethics
Changed lines 78-82 from:
User Observation
to:


!!!
User Observation
Changed lines 158-159 from:
Interface Inspection
to:

!!!
Interface Inspection
Changed lines 217-219 from:
Topics below here are optional and/or subject to change
Prototyping
to:
!!! Topics below here are optional and/or subject to change


!!!
Prototyping
Changed lines 250-253 from:
Field Study Methodologies (tentative)
to:

!!!
Field Study Methodologies (tentative)
Added line 256:
Changed lines 279-280 from:
Comparing Methods
to:

!!!
Comparing Methods
November 29, 2006, at 11:34 AM by 136.159.7.242 -
Added lines 1-277:
(:title CPSC 681 - Main Reading List :)
%rfloat% Attach:logo-681.png
'''-[[CPSC681/Courses|back to CPSC 681]]-'''


All papers are required reading unless otherwise noted.

Papers below the ruled line are not yet finalized.
Course texts

You should buy these texts. Some of the readings below will be from them.

Required

1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
2. Usability Engineering, Nielsen, J. (1993) Academic Press.
3. Papers of the remaining readings will be made available to you at cost.

Recommended

1. Usability Inspection Methods (1994) J. Nielsen and R. Mack (eds), Wiley and Sons.

Overview of methodologies

The following papers introduces (but do not detail) many methodologies. They also discuss and compare methodologies from various perspectives: to influence design, to evaluate products, to encourage end-user feedback, and to compare when and where each is useful. Because you do not yet know the details of these methodologies, the discussions in the papers may be hard to follow at times. Because these papers are just intended to give you a feel for the area, I suggest you give them a quick read now. As the course progresses, you will find that you will be able to go back to them for a more careful read.



1. Overview of methodologies [Powerpoint]
* also as [Adobe PDF]
* Lecture notes for the talk I give to the class.

2. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.
* This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

3. Chapter 11: Evaluation Techniques (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p363-400, Prentice Hall.
* This useful overview chapter briefly surveys a variety of methodologies.

4. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.
* This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.
* see the summary chart of this paper, produced by Stephanie Smale

5. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html
* This essay contrasts the academic vs business approach to product development.

Ethics


1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)
* A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.

2. Research Participants' Bill of Rights by Tim Rogers [also as PDF]
* A concise statement of what participant's should expect as fair treatment

3. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services
* This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update
o Section 1 - verify that your work requires ethics clearance,
o Section 6 - if your application concerns course-based research,
o Section 8 for your procedural responsibilities
o Section 9 for guidelines on balancing risks vs benefits
o Section 10 on how to do informed consent
o Section 11 for guidelines on deception (research involving any deception is usually considered risky)
o Section 12 for guidelines on maintaining privacy and confidentiality

4. Ethics application
* A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:
o Instructions for Ethics Review Applicants
o Ethics review application form
o Sample consent form

Supplemental Readings available in the Optional Readings sections
User Observation
Experimental methodologies

1. Quantitative methods [Powerpoint or Adobe PDF]
Analysis of Variance [Powerpoint or Adobe PDF]
* Lecture notes for the talk I give to the class.
2.

To read again: Section 11.5.1: Empirical methods (Extract). Dix, A., Finlay, J., Abowd, G. and Beale, R. (1993) Human Computer Interaction, p375-385, Prentice Hall.
* the chapter you previously read includes a section on controlled experiments

3. Chapter 4: Experimental methodology;
Chapter 5: Experimental designs and analysis;
Chapter 6: Hazards to conducting and interpreting HCI experiments
From Eberts, R.E. (1994) User Interface Design, Prentice Hall.
* A general and high level introduction to experimental design.
4.

Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May
* This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise

5. Mouse-Typing on Phone Pads and Keyboards
We will perform a 'pilot' controlled study on how people perform on different types of keyboards

Usability Testing

1. Text-Chapter 6: Usability testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. Extract
* An excellent overview to various usability testing methodologies.

2. Discussion of guidelines for user observation. Gomoll, K and Nicol, A. (1990) From User Observation: Guidelines for Apple Developers, January, 1990. [HTML].
* This reading is an excellent recipe for performing usability studies.

3. Text-A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)
* An in-depth treatment of usability testing. The chapters we use are:
o 2: Introducing usability testing
o 6: Establishing a usability program in your organization
o 7: Planning a usability test
o 9: Deciding who should be participants
o 11: Selecting and organizing tasks to test
o 12: Creating task scenarios
o 15: Preparing the testing environment
o 18: Caring for the test participants
o 19: Conducting the test
o Appendix A: Setting up a usability laboratory
o All of the above as a single PDF

4. Getting the whole team into usability testing. Ehrlich, K., Butler, M. and Pernce, K. (1994) IEEE Software, p89-90.
* Tips and reasons for including developers as part of the evaluation team.

5. Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.
* Describes a method for observing people working together.

6. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.
* As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.

7. The use of video in empirical research. Neal, L. (1989) SIGCHI Bulletin, 21(2), p100-101, ACM Press.
* Further reasons why one should videotape usability sessions.

Excercise (to be handed out)

8. Get real with IBM RealPhone
* We will perform a usability study on IBM's RealPhone system
* Download the full handout, which contains
o the presentation
o evaluator's instructions and tasks
o consent form
o Pre-test, During-test and Post-test questions
o methods for running a basic observational study
o discussion of guidelines for user observation
o IBM Real Phone Instruction Sheet and their test-drive instructions
o Isys' Hall of Shame critique of RealPhone
* The system is available here, as an installable .exe
* The presentation, in powerpoint

Interface Inspection

Overview

1. Chapter 1: Executive summary. Mack, R. and Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p1-23, Wiley and Sons.
* An exectuive summary and discussion of inspection methods.


Usability Heuristics and Heuristic Evaluation

1. Overview of Heuristic Evaluation [Powerpoint or Adobe PDF]
* My presentation that I give in CPSC 481

2. Improving a human-computer dialogue, Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.
* This article lists the heuristics and presents a working example, solutions, and alternatives.

3. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.
* Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.

4. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.
* This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

5. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
* A more in depth discussion of how heuristic evaluation works and its reliability

6. Text-Exercise 8: Heuristic Evaluation of a Paper Mock-Up. Nielsen, J. In Usability Engineering, p273, Academic Press.
* Another example, with answers, of a heuristic evaluation.


Task-Centered Walkthroughs

1. Overview of Task Centered Walkthrough [Powerpoint or Adobe PDF]
* My presentation that I give in CPSC 481

2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.
* A how-to approach to task-centered system design.

3. Chapter 3: The pluralistic usability walkthrough: Coordinated Empathies. Bias, R.G. (1994) In J. Nielsen and R. Mack (eds), Usability Inspection Methods, p63-76, Wiley and Sons.
* Describe the steps in the pluralistic walkthough process.

Supplemental Readings

* Getting to Know Users and their Tasks. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.
o Describes task-centered system design and how tasks are used to define walkthroughs.
* Task-Centered User Interface Design: A Practical Introduction. Lewis, C. and Rieman, J. (1993) Available as Shareware.
o The book that started it off. The above reading is in this book


Cognitive Walkthroughs

6. The Cognitive Walkthrough Method: A Practioner's Guide. Wharton, C., Rieman, J. Lewis, C. and Polson, P. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.
* This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.

7. Walkthroughs (Excerpt, page 679-684) in Preece, J. (1994) Human Computer Interaction. Addison-Wesley.
* This more complex but more complete cognitive walkthrough method inspired the discount task-centered walkthrough method.


Topics below here are optional and/or subject to change
Prototyping

1. Text-Extract-Chapter 4.8: Prototyping. Nielsen, J. (1993) In Usability Engineering, p93-101, Academic Press.
* Describes different styles of prototypes and how they can be used within scenarios.

2. Prototyping for tiny fingers. Rettig, M. (1994) Communications of the ACM, 37(4), ACM Press.
* A simple way to build low fidelity prototypes, similar to Pictive

3. Low vs. high fidelity prototyping debate. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.
* When are where you should use low vs. high fidelity prototypes

4. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.
* A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

5. Composing letters with a simulated listening typewriter. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.
* The first description of the Wizard of Oz prototyping/testing method.

Supplemental Readings

* Prototyping an intelligent agent through Wizard of Oz. Maulsby, D., Greenberg, S. and Mander, R. (1993). Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.
o Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ.
* Retrospective on a year of participatory design using the PICTIVE technique Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992
o Experiences with Pictive and recommendations.
* The “Starfire” video prototype project: a case history Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994
o Describes a sophisticated video prototyping project.

* Interactive sketching for the early stages of user interface design. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995
o Describes a system that lets people sketch and storyboard through a live computer interface.

Field Study Methodologies (tentative)
Introduction

1. First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational. Jakob Nielsen, Alertbox, August 5, 2001 andJanuary 20, 2002. http://www.useit.com/alertbox/20010805.html and 20020120.html

Contextual Inquiry

1. Contextual Inquiry: A Participatory Approach. Holtzblatt, K. and Jones, S. (1996) In D. Schuler and A. Namioka (eds) Participatory Design: Principles and Practices, p177-210.

2. Contextual Design: Principles and Practice. Holtzblatt, K. and Beyer, H. (1993) In D. Wixon and J. Ramey (eds) Field Methods Casebook for Software Design, p303-333.

3. Getting Started with Contextual Techniques. Incontext, Inc. http://www.incent.com/connection.indx/techniques.html

Ethnography

1. Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.
* Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.

2. Ethnographically-informed systems design for air traffic control, Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) in Proc CSCW'92, p123-129, November.

3. Moving out of the control room: Ethnography in system design. Hughes, J., King, V., Rodden, T. and Andersen, H. (1994) In Proc CSCW'94, p429439, ACM Press.

4. Ethnography and Systems Development: Bounding the Intersection. Randall, D. (1996) Tutorial notes presented at CSCW'96.
* Excerpts: Sections 3, 4,5,7

Comparing Methods

1. Text-Chapter 7: Usability Assessment Methods Beyond Testing. Nielsen, J. (1993) In Usability Engineering, p165-205, Academic Press. p207-225
* Introduces observations, questionnaires and interviews, focus groups, logging, user feedback, and how to choose between them.

2. Mapping the method muddle: Guidance in using methods for user interface design. Olson, J. and Moran, T. (1996) In M. Rudisill, C. Lewis, P. Polson and T. McKay (eds) Human-Computer Interface Design: Success Stories, Emerging Methods, and Real-World Context, p269-300, Morgan-Kaufmann.
* The authors associate a variety of methodological approaches to specific interface design activities.

3. Chapter 34: Comparing methods. Preece, J. et. al., (1994) in Human Computer Interaction, p691-707, Addison-Wesley.
* Provides an overview of previous comparative studies of evaluation methods.

4. User interface evaluation in the real world: A comparison of four techniques. Jeffries, R., Miller, J., Wharton, C. and Uyeda, K. (1991) In ACM Conference on Human Factors in Computing Systems. p119-124, ACM Press.

5. Comparison of empirical testing and walkthrough methods in user interface evaluation. Karat, C., Campbell, R. and Fiegel, T. (1992) In ACM Conference on Human Factors in Computing Systems. 397-404, ACM Press.

6. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2004