CPSC 681 - Topic: Researching and Presenting a Methodology

CPSC681.Topic History

Hide minor edits - Show changes to markup

Changed lines 4-94 from:

Worth: 25% of your grade.

Research a particular methodological topic, present that topic to the class, and produce a web-based handout summarizing that topic (including an example).

Deliverables

See schedule for tentative dates. All students will deliver written materials (presentations / handouts) on the same date. The date of the actual presentation will be scheduled by the instructor.

  1. A list of 2 or 3 topics (early in the course) indicating your choice of topic
  2. A web-based handout, added to the CPSC 681 student site, in the form of a tutorial that concisely summarizes the methodology and the concrete exercise. The handout should include
    • What it is i.e., an overview of the method, how it works, and (if known)who developed it
    • When and where it is typically used in the development/evaluation/research cycle
    • Benefits and problems of this method
    • A simple worked-through concrete exercise, suitable for teaching, of how to apply the method (should include all material needed to do the method (instructions, materials, etc.)
    • An annotated bibliography of several key papers / resources that others can use to help them get started
  3. A classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem.

Resources

See the Main reading list and Optional and supplemental readings for resources on evaluation topics. I have a huge number of relevant books in my personal library. This includes textbooks with good introductory chapters on evaluation methods. Browse these for ideas. As well, the ACM Digital Library and the HCI Bibliography include many articles applying evaluation methods.

I will be happy to point you to some key resources once you have chosen a topic. Ask me!

A note on plagiarism. You must avoid plagiarism when using the above resources. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately. Plagiarism - whether intentional or accidental - has severe consequences.

Example topics

Various topics are listed below, structured as groups. This list is far from complete - see the Main reading list, the Optional and supplemental readings and/or peruse the books in my personal library for other possible topics.

While I will ask you to suggest a topic, I will ultimately assign topics so they are balanced across groups. For complex topics or for going into a topic into greater detail, two students may split the topic into two parts.

(:table width=90%:) (:cellnr :) Interviews

  • Contextual interviews
  • Ethnographic interview
  • Focus groups

(:cell :) Heuristic Inspection

  • Heuristic evaluation (general)
  • Heuristic evaluation (specialized: groupware, ambient displays, etc.)

(:cellnr :) User/task models and walkthroughs

  • Personas
  • Task centered walkthrough
  • Cognitive walkthrough

(:cell :) Qualitative Analysis

  • Open coding
  • Affinity diagrams
  • Grounded theory

(:cellnr :) Questionnaires

  • Likert scales
  • How to design Questionnaires
  • Surveys

(:cell :) Field methods

  • Field studies
  • Design ethnography
  • Contextual inquiry

(:cellnr :) Creating and evaluating early designs

  • The role of prototyping
  • Wizard of Oz

(:cell :) Statistical methods

  • Statistical tests - non-parametric tests
  • Statistical tests - CHI-square distributions tests...

(:cellnr :) Modeling and evaluating low-level actions

  • Fitts Law
  • GOMS
  • Keystroke level model

(:cell :) Miscellaneous

  • Logging user performance
  • Instructional video - produce a video that illustrates a technique
  • Are 5 users enough?
  • Ethics

(:tableend :)

to:

Go to this page on The New Web Site

This page has been replace.

Changed lines 32-33 from:

Various topics are listed below, structured as groups. This list is far from complete - see the Main reading list and Optional and supplemental readings for other possible.

to:

Various topics are listed below, structured as groups. This list is far from complete - see the Main reading list, the Optional and supplemental readings and/or peruse the books in my personal library for other possible topics.

Changed lines 28-29 from:

A note on plagiarism. You must be careful to avoid plagiarism when using the above references. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately. Plagiarism - whether intentional or accidental - has severe consequences.

to:

A note on plagiarism. You must avoid plagiarism when using the above resources. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately. Plagiarism - whether intentional or accidental - has severe consequences.

Changed lines 28-29 from:

A note on plagiarism. You must be careful to avoid plagiarism when using the above references. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately. Plagiarism - whether intentional or accidental - has severe consequences.

to:

A note on plagiarism. You must be careful to avoid plagiarism when using the above references. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately. Plagiarism - whether intentional or accidental - has severe consequences.

Added line 20:
Changed lines 13-14 from:
  1. A classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. It must include a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
    • should include all material needed to do the method (instructions, materials, etc.)(time to be determined)
to:
Changed line 18 from:
  • The worked example, showing a simple application of the method
to:
  • A simple worked-through concrete exercise, suitable for teaching, of how to apply the method (should include all material needed to do the method (instructions, materials, etc.)
Changed lines 20-21 from:
to:
  1. A classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem.
Changed lines 13-15 from:
  1. A simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
    • should include all material needed to do the method (instructions, materials, etc.)
  2. A classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (time to be determined)
to:
  1. A classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. It must include a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
    • should include all material needed to do the method (instructions, materials, etc.)(time to be determined)
Changed line 1 from:

(:title CPSC 681 - Topic: Researching and Presenting a Methodology)

to:

(:title CPSC 681 - Topic: Researching and Presenting a Methodology :)

Changed line 1 from:

(:title CPSC 681 - Topic:)

to:

(:title CPSC 681 - Topic: Researching and Presenting a Methodology)

Changed lines 6-7 from:

You will be responsible for researching a particular methodological approach, writing a web-based handout summarizing that approach plus worked example, and presenting your material to the class.

to:

Research a particular methodological topic, present that topic to the class, and produce a web-based handout summarizing that topic (including an example).

Changed lines 6-7 from:

You will be responsible for researching and presenting a particular methodological approach.

to:

You will be responsible for researching a particular methodological approach, writing a web-based handout summarizing that approach plus worked example, and presenting your material to the class.

Changed line 8 from:

Deliverables

to:

Deliverables

Changed lines 6-7 from:

You will be responsible for researching and presenting a particular methodological approach. Deliverables are:

to:

You will be responsible for researching and presenting a particular methodological approach.

Deliverables See schedule for tentative dates. All students will deliver written materials (presentations / handouts) on the same date. The date of the actual presentation will be scheduled by the instructor.

Changed lines 4-5 from:

Worth: 25% of your grade.

to:

Worth: 25% of your grade.

Changed lines 32-78 from:
  1. Interviews
    • Contextual interviews
    • Ethnographic interview
    • Focus groups
  2. Heuristic Inspection
    • Heuristic evaluation (general)
    • Heuristic evaluation (specialized: groupware, ambient displays, etc.)
  3. User/task models and walkthroughs
    • Personas
    • Task centered walkthrough
    • Cognitive walkthrough
  4. Qualitative Analysis
    • Open coding
    • Affinity diagrams
    • Grounded theory
  5. Questionnaires
    • Likert scales
    • How to design Questionnaires
    • Surveys
  6. Field methods
    • Field studies
    • Design ethnography
    • Contextual inquiry
  7. Evaluating simulated systems
    • The role of prototyping
    • Wizard of Oz
  8. Statistical methods
    • Statistical tests - non-parametric tests
    • Statistical tests - CHI-square distributions tests...
  9. Modeling and evaluating low-level actions
    • Fitts Law
    • GOMS
    • Keystroke level model
  10. Miscellaneous
    • Logging user performance
    • Instructional video - produce a video that illustrates a technique
    • Are 5 users enough?
    • Ethics
to:

(:table width=90%:) (:cellnr :) Interviews

  • Contextual interviews
  • Ethnographic interview
  • Focus groups

(:cell :) Heuristic Inspection

  • Heuristic evaluation (general)
  • Heuristic evaluation (specialized: groupware, ambient displays, etc.)

(:cellnr :) User/task models and walkthroughs

  • Personas
  • Task centered walkthrough
  • Cognitive walkthrough

(:cell :) Qualitative Analysis

  • Open coding
  • Affinity diagrams
  • Grounded theory

(:cellnr :) Questionnaires

  • Likert scales
  • How to design Questionnaires
  • Surveys

(:cell :) Field methods

  • Field studies
  • Design ethnography
  • Contextual inquiry

(:cellnr :) Creating and evaluating early designs

  • The role of prototyping
  • Wizard of Oz

(:cell :) Statistical methods

  • Statistical tests - non-parametric tests
  • Statistical tests - CHI-square distributions tests...

(:cellnr :) Modeling and evaluating low-level actions

  • Fitts Law
  • GOMS
  • Keystroke level model

(:cell :) Miscellaneous

  • Logging user performance
  • Instructional video - produce a video that illustrates a technique
  • Are 5 users enough?
  • Ethics

(:tableend :)

Changed lines 8-9 from:
  1. a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
to:
  1. A list of 2 or 3 topics (early in the course) indicating your choice of topic
  2. A simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
Changed lines 11-13 from:
  1. a classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (time to be determined)
  2. a handout in the form of a tutorial that concisely summarizes the methodology and the concrete exercise. The handout should include
    • What it is i.e., an overview of the method, how it works, and who developed it
to:
  1. A classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (time to be determined)
  2. A web-based handout, added to the CPSC 681 student site, in the form of a tutorial that concisely summarizes the methodology and the concrete exercise. The handout should include
    • What it is i.e., an overview of the method, how it works, and (if known)who developed it
Changed line 16 from:
  • The worked example
to:
  • The worked example, showing a simple application of the method
Deleted lines 18-19:

Plagiarism. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately.

Added lines 24-25:

A note on plagiarism. You must be careful to avoid plagiarism when using the above references. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately. Plagiarism - whether intentional or accidental - has severe consequences.

Changed lines 21-22 from:

See the Main reading list and Optional and supplemental readings for resources on evaluation topics. I have a huge number of books in the HCI library. Many of them have chapters on evaluation. Browse these for ideas. I will be happy to point you to some key resources once you have chosen a topic. As well, the ACM Digital Library and the HCI Bibliography include many articles applying evaluation methods. Ask me!

to:

See the Main reading list and Optional and supplemental readings for resources on evaluation topics. I have a huge number of relevant books in my personal library. This includes textbooks with good introductory chapters on evaluation methods. Browse these for ideas. As well, the ACM Digital Library and the HCI Bibliography include many articles applying evaluation methods.

I will be happy to point you to some key resources once you have chosen a topic. Ask me!

Changed lines 20-59 from:

Example topics

I have a huge number of books in the HCI library. Many of them have chapters on evaluation. Browse these for ideas. I will be happy to point you to some key resources once you have chosen a topic. Ask me!

A few possible topics are listed below, but some are better than others. This list is far from complete. See the Main reading list and Optional and supplemental readings for ideas and resources on evaluation topics.

  • Heuristic evaluation
  • Cognitive walkthrough
  • Task centered walkthrough
  • Personas
  • Interviews - contextual interviews
  • Interviews - the ethnographic interview
  • Focus groups
  • Field studies
  • Contextual inquiry
  • Design ethnography
  • Prototyping
  • Questionnaires - Likert scales
  • Questionnaires - how to design them
  • Surveys
  • Open coding
  • Affinity diagrams
  • Grounded theory
  • Statistical tests - non-parametric tests
  • Statistical tests - CHI-square distributions tests...
  • Fitts Law
  • Logging user performance
  • Instructional video - produce a video that illustrates a technique
  • Are 5 users enough?
  • Ethics in evaluation
to:

Resources

See the Main reading list and Optional and supplemental readings for resources on evaluation topics. I have a huge number of books in the HCI library. Many of them have chapters on evaluation. Browse these for ideas. I will be happy to point you to some key resources once you have chosen a topic. As well, the ACM Digital Library and the HCI Bibliography include many articles applying evaluation methods. Ask me!

Example topics

Various topics are listed below, structured as groups. This list is far from complete - see the Main reading list and Optional and supplemental readings for other possible.

While I will ask you to suggest a topic, I will ultimately assign topics so they are balanced across groups. For complex topics or for going into a topic into greater detail, two students may split the topic into two parts.

  1. Interviews
    • Contextual interviews
    • Ethnographic interview
    • Focus groups
  2. Heuristic Inspection
    • Heuristic evaluation (general)
    • Heuristic evaluation (specialized: groupware, ambient displays, etc.)
  3. User/task models and walkthroughs
    • Personas
    • Task centered walkthrough
    • Cognitive walkthrough
  4. Qualitative Analysis
    • Open coding
    • Affinity diagrams
    • Grounded theory
  5. Questionnaires
    • Likert scales
    • How to design Questionnaires
    • Surveys
  6. Field methods
    • Field studies
    • Design ethnography
    • Contextual inquiry
  7. Evaluating simulated systems
    • The role of prototyping
    • Wizard of Oz
  8. Statistical methods
    • Statistical tests - non-parametric tests
    • Statistical tests - CHI-square distributions tests...
  9. Modeling and evaluating low-level actions
    • Fitts Law
    • GOMS
    • Keystroke level model
  10. Miscellaneous
    • Logging user performance
    • Instructional video - produce a video that illustrates a technique
    • Are 5 users enough?
    • Ethics
August 27, 2009, at 05:15 PM by 24.64.89.150 -
Changed lines 18-19 from:

Plagiarism. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use images/examples provided by others, but you must cite them appropriately.

to:

Plagiarism. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use a few images/examples provided by others, but you must cite them appropriately.

August 27, 2009, at 05:15 PM by 24.64.89.150 -
Changed lines 18-19 from:

Plagiarism. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, but you must cite them appropriately.

to:

Plagiarism. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, quote selectively (with citations), and be careful to list your sources. You can selectively use images/examples provided by others, but you must cite them appropriately.

August 27, 2009, at 05:14 PM by 24.64.89.150 -
Changed lines 18-19 from:

Note. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, but you must cite them appropriately. Disregarding of this will result in a 0.

to:

Plagiarism. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, but you must cite them appropriately.

August 27, 2009, at 05:14 PM by 24.64.89.150 -
Changed lines 18-19 from:

Note. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, you must cite them appropriately.

to:

Note. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, but you must cite them appropriately. Disregarding of this will result in a 0.

August 27, 2009, at 05:13 PM by 24.64.89.150 -
Changed lines 4-7 from:

The topic is worth 25% of your grade.

You will be responsible for researching a particular methodological approach. Deliverables are:

to:

Worth: 25% of your grade.

You will be responsible for researching and presenting a particular methodological approach. Deliverables are:

Changed lines 18-19 from:

Note. There are many resouces on these topics available on the web. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, you must cite them appropriately.

to:

Note. There are many resouces on these topics available on the web and in various readings. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, you must cite them appropriately.

August 27, 2009, at 05:11 PM by 24.64.89.150 -
Added lines 46-49:
  • Open coding
  • Affinity diagrams
  • Grounded theory
August 27, 2009, at 05:10 PM by 24.64.89.150 -
Changed lines 24-25 from:

Possible topics are listed below, but some are better than others. This list is far from complete.

to:

A few possible topics are listed below, but some are better than others. This list is far from complete. See the Main reading list and Optional and supplemental readings for ideas and resources on evaluation topics.

August 27, 2009, at 05:08 PM by 24.64.89.150 -
Changed lines 24-25 from:
to:

Possible topics are listed below, but some are better than others. This list is far from complete.

Added lines 32-33:
  • Interviews - contextual interviews
  • Interviews - the ethnographic interview
Added line 35:
Added line 41:
Deleted lines 43-46:
  • Interviews - contextual interviews
  • Interviews - the ethnographic interview
August 27, 2009, at 05:07 PM by 24.64.89.150 -
Changed lines 24-57 from:
  • Ethics
  • Heuristic evaluation
    • Heuristic evaluation of groupware
    • Results synthesis
  • Task analysis
    • cognitive walkthroughs
    • task centered walkthroughs
    • personas
  • Focus groups
  • Field studies
    • contextual inquiry
    • design ethnography
  • Protocol Analysis
  • Prototyping
  • Questionnaires
    • how to design questionnaires
    • how to analyse Likert scales
  • Interviews
    • contextual interviews
    • the ethnographic interview
  • Surveys
  • Statistical tests
    • non-parametric tests
    • CHI-square distributions tests...
  • A Cognitive Modeling Method
    • Fitts Law
    • Keystroke-Level Model
    • GOMS
  • Logging user performance
  • Instructional video
    • produce a video that illustrates a technique
  • Are 5 users enough?

Last updated Fall, 2007

to:
  • Heuristic evaluation
  • Cognitive walkthrough
  • Task centered walkthrough
  • Personas
  • Focus groups
  • Field studies
  • Contextual inquiry
  • Design ethnography
  • Prototyping
  • Questionnaires - Likert scales
  • Questionnaires - how to design them
  • Interviews - contextual interviews
  • Interviews - the ethnographic interview
  • Surveys
  • Statistical tests - non-parametric tests
  • Statistical tests - CHI-square distributions tests...
  • Fitts Law
  • Logging user performance
  • Instructional video - produce a video that illustrates a technique
  • Are 5 users enough?
  • Ethics in evaluation
August 27, 2009, at 05:04 PM by 24.64.89.150 -
Changed line 8 from:
  • a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
to:
  1. a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
Changed lines 10-11 from:
  • a classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (~1 hour)
  • a handout that concisely summarizes the methodology and the concrete exercise. The handout should include
to:
  1. a classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (time to be determined)
  2. a handout in the form of a tutorial that concisely summarizes the methodology and the concrete exercise. The handout should include
Changed lines 22-23 from:

Note: I have a huge number of books in the HCI library. Many of them have chapters on evaluation. Browse these for ideas.

to:

I have a huge number of books in the HCI library. Many of them have chapters on evaluation. Browse these for ideas. I will be happy to point you to some key resources once you have chosen a topic. Ask me!

August 27, 2009, at 05:01 PM by 24.64.89.150 -
Deleted line 1:

-

Deleted line 25:
Deleted line 28:
Deleted line 32:
Deleted line 33:
Deleted line 36:
Deleted line 37:
Deleted line 38:
Deleted line 41:
Deleted line 44:
Deleted line 45:
Deleted line 48:
Deleted line 52:
Deleted line 53:
Deleted line 55:
Added line 1:

(:title CPSC 681 - Topic:)

Deleted lines 4-6:

CPSC 681 - Topic

Changed lines 11-12 from:
  • a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation - should include all material needed to do the method (instructions, materials, etc.)
  • a classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (30-45 minutes)
to:
  • a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation
    • should include all material needed to do the method (instructions, materials, etc.)
  • a classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (~1 hour)
Changed lines 15-20 from:
  • What it is i.e., an overview of the method, how it works, and who developed it
  • When and where it is typically used in the development/evaluation/research cycle
  • Benefits and problems of this method
  • The worked example
  • An annotated bibliography of several key papers / resources that others can use to help them get started
to:
  • What it is i.e., an overview of the method, how it works, and who developed it
  • When and where it is typically used in the development/evaluation/research cycle
  • Benefits and problems of this method
  • The worked example
  • An annotated bibliography of several key papers / resources that others can use to help them get started

Note. There are many resouces on these topics available on the web. However, you must be careful to avoid plagiarism. Use your own words, and be careful to list your sources. You can selectively use images/examples provided by others, you must cite them appropriately.

Added line 23:
Added line 25:
Added line 29:
Added line 34:
Changed lines 36-37 from:
  1. Field studies
to:
  • Field studies
Added line 40:
Added line 42:
Added line 44:
Added line 48:
Added line 52:
Added line 54:
Added line 58:
Added line 63:
Added line 65:
Added line 68:
Changed lines 20-21 from:

Example topics

to:

Example topics

Changed lines 23-29 from:
  1. Ethics
  2. Heuristic evaluation
    • Heuristic evaluation of groupware
    • Results synthesis
  3. Task analysis
    • cognitive walkthroughs
  4. Focus groups
to:
  • Ethics
  • Heuristic evaluation
    • Heuristic evaluation of groupware
    • Results synthesis
  • Task analysis
    • cognitive walkthroughs
    • task centered walkthroughs
    • personas
  • Focus groups
Changed lines 33-56 from:
  • contextual inquiry
  • design ethnography
  1. Protocol Analysis
  2. Prototyping
  3. Questionnaires
    • how to design questionnaires
    • how to analyse Likert scales
  4. Interviews
    • contextual interviews
    • the ethnographic interview
  5. Surveys
  6. Statistical tests
    • non-parametric tests
    • CHI-square distributions tests...
  7. A Cognitive Modeling Method
    • Fitts Law
    • Keystroke-Level Model
    • GOMS
  8. Logging user performance
  9. Instructional video
    • produce a video that illustrates a technique
  10. Are 5 users enough?

Last updated Fall, 2004

to:
  • contextual inquiry
  • design ethnography
  • Protocol Analysis
  • Prototyping
  • Questionnaires
    • how to design questionnaires
    • how to analyse Likert scales
  • Interviews
    • contextual interviews
    • the ethnographic interview
  • Surveys
  • Statistical tests
    • non-parametric tests
    • CHI-square distributions tests...
  • A Cognitive Modeling Method
    • Fitts Law
    • Keystroke-Level Model
    • GOMS
  • Logging user performance
  • Instructional video
    • produce a video that illustrates a technique
  • Are 5 users enough?

Last updated Fall, 2007

Changed line 1 from:
to:

-

Added line 1:
November 28, 2006, at 03:03 PM by 136.159.7.242 -
Added lines 1-3:
November 28, 2006, at 03:02 PM by 136.159.7.242 -
Changed lines 49-50 from:

'- Last updated Fall, 2004-'

to:

Last updated Fall, 2004

November 28, 2006, at 03:01 PM by 136.159.7.242 -
Changed lines 49-50 from:

Last updated Fall, 2004

to:

'- Last updated Fall, 2004-'

November 28, 2006, at 03:01 PM by 136.159.7.242 -
Changed lines 20-50 from:
  1. Heuristic evaluation
    * heuristic evaluation of groupware
  • Results synthesis
  1. Task analysis
    * cognitive walkthroughs
  2. Focus groups
    #Field studies
    * contextual inquiry
  • design ethnography
  1. Protocol Analysis
    #Prototyping
    #Questionnaires
    * how to design questionnaires
  • how to analyse Likert scales
  1. Interviews
    * contextual interviews
  • the ethnographic interview
  1. Surveys
    #Statistical tests
    * non-parametric tests
  • CHI-square distributions tests...
  1. A Cognitive Modeling Method
    * Fitts Law
  • Keystroke-Level Model
  • GOMS
  1. Logging user performance
    #Instructional video
    * produce a video that illustrates a technique
  2. Are 5 users enough?
to:
  1. Heuristic evaluation
    • Heuristic evaluation of groupware
    • Results synthesis
  2. Task analysis
    • cognitive walkthroughs
  3. Focus groups
  4. Field studies
    • contextual inquiry
    • design ethnography
  5. Protocol Analysis
  6. Prototyping
  7. Questionnaires
    • how to design questionnaires
    • how to analyse Likert scales
  8. Interviews
    • contextual interviews
    • the ethnographic interview
  9. Surveys
  10. Statistical tests
    • non-parametric tests
    • CHI-square distributions tests...
  11. A Cognitive Modeling Method
    • Fitts Law
    • Keystroke-Level Model
    • GOMS
  12. Logging user performance
  13. Instructional video
    • produce a video that illustrates a technique
  14. Are 5 users enough?
November 28, 2006, at 02:54 PM by 136.159.7.242 -
Changed line 21 from:
  1. Heuristic evaluation
to:
  1. Heuristic evaluation\\
Changed lines 24-25 from:
  1. Task analysis
to:
  1. Task analysis\\
Changed lines 26-29 from:
  1. Focus groups
  2. Field studies
to:
  1. Focus groups
    #Field studies\\
Changed lines 30-35 from:
  1. Protocol Analysis
  2. Prototyping
  3. Questionnaires
to:
  1. Protocol Analysis
    #Prototyping
    #Questionnaires\\
Changed lines 35-36 from:
  1. Interviews
to:
  1. Interviews\\
Changed lines 38-41 from:
  1. Surveys
  2. Statistical tests
to:
  1. Surveys
    #Statistical tests\\
Changed lines 42-43 from:
  1. A Cognitive Modeling Method
to:
  1. A Cognitive Modeling Method\\
Changed lines 46-49 from:
  1. Logging user performance
  2. Instructional video
to:
  1. Logging user performance
    #Instructional video\\
Changed lines 49-51 from:
  1. Are 5 users enough?
to:
  1. Are 5 users enough?
November 28, 2006, at 02:51 PM by 136.159.7.242 -
Changed lines 19-20 from:
  1. Ethics.
to:
  1. Ethics
Added line 24:
Added line 27:
Added line 29:
Added line 33:
Added line 35:
Added line 37:
Added line 41:
Added line 45:
Added line 47:
Added line 51:
Added line 56:
Added line 58:
Added line 61:
November 28, 2006, at 02:49 PM by 136.159.7.242 -
Added lines 1-50:

CPSC 681 - Topic

The topic is worth 25% of your grade.

You will be responsible for researching a particular methodological approach. Deliverables are:

  • a simple worked-through concrete exercise, suitable for teaching, of how to do the evaluation - should include all material needed to do the method (instructions, materials, etc.)
  • a classroom presentation that introduces the methodology to the class and that has the class perform the above exercise of how the methodology is applied on a particular problem. (30-45 minutes)
  • a handout that concisely summarizes the methodology and the concrete exercise. The handout should include
    • What it is i.e., an overview of the method, how it works, and who developed it
    • When and where it is typically used in the development/evaluation/research cycle
    • Benefits and problems of this method
    • The worked example
    • An annotated bibliography of several key papers / resources that others can use to help them get started

Example topics

Note: I have a huge number of books in the HCI library. Many of them have chapters on evaluation. Browse these for ideas.

  1. Ethics.
  2. Heuristic evaluation
  • heuristic evaluation of groupware
  • Results synthesis
  1. Task analysis
  • cognitive walkthroughs
  1. Focus groups
  2. Field studies
  • contextual inquiry
  • design ethnography
  1. Protocol Analysis
  2. Prototyping
  3. Questionnaires
  • how to design questionnaires
  • how to analyse Likert scales
  1. Interviews
  • contextual interviews
  • the ethnographic interview
  1. Surveys
  2. Statistical tests
  • non-parametric tests
  • CHI-square distributions tests...
  1. A Cognitive Modeling Method
  • Fitts Law
  • Keystroke-Level Model
  • GOMS
  1. Logging user performance
  2. Instructional video
  • produce a video that illustrates a technique
  1. Are 5 users enough?

Last updated Fall, 2004