CPSC 681 - Main Reading List

CPSC681.MainReadingList History

! YOU SHOULD HAVE READ THE ABOVE PAPERS. THE PAPERS BELOW ARE STILL TO BE ASSIGNED

to:

Deleted lines 27-30:

!!!Experimental methodologies#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\* Lecture notes for the talk I give to the class.

# Muller, M. (1991) \\[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

'''Supplemental Readings'''

* Muller, Michael J. \\[[HCIPapers:muller-retrospective-chi92.pdf|'''Retrospective on a year of participatory design using the PICTIVE technique'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 ** Experiences with Pictive and recommendations.

# Dourish, P. (2001) \\'''Where the Action Is. The Foundations of Embodied Interaction.''' MIT Press, Cambridge MMA. ** [[HCIPapers:dourish-wheretheactionis-ch3.pdf|Chapter 3: Social Computing]] p55-97.** Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.

# Landauer, T. (1991) \\[[HCIPapers:landauer-letsgetreal.pdf|'''Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems''',]] In J. Carroll (ed) Designing Interaction, Cambridge University Press.

# Nielsen, J. (1993) \\'''Usability Engineering,''' p273-4, Academic Press.** [[HCIPapers:nielson93-usabilityengch5-usab-heuristics.pdf|Chapter 5: Usability heuristics. p115-163]]** Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.

to:

# Muller, M. (1991) \\[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

Changed lines 14-42 from:

# Nielsen, J. (1994) \\[[HCIPapers:nielsen-enhancing-chi94.pdf| '''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

# Nielsen, J. and R. Mack (eds) ]] \\'''Usability Inspection Methods,''' p25-62, Wiley and Sons. (1994)** [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation.pdf|Chapter 2: Heuristic evaluation. ]] [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation-2pages.pdf| as 2 pages per side]]** A more in depth discussion of how heuristic evaluation works and its reliability

# Lewis, C. and Rieman, J. (1993) \\[[HCIPapers:lewisriemanbook-index.html|'''Task-Centered User Interface Design: A Practical Introduction.''' ]] Available as Shareware. ** The book that started it off. ** Read the chapter '''Getting to Know Users and their Tasks.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

# Nielsen, J. (1993) \\'''Usability Engineering,''' p273-4, Academic Press.** [[HCIPapers:nielson93-usabilityengch4.8-prototyping.pdf|Chapter 4.8 Prototyping. (Extract)]] p93-101. [[HCIPapers:nielson93-usabilityengch4.8-prototyping-2page.pdf|(also as 2 pages / side )]]** Describes different styles of prototypes and how they can be used within scenarios.

# Muller, M. (1991) \\[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

* Landay, James A., and Brad A. Myers \\[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995** Describes a system that lets people sketch and storyboard through a live computer interface.

# ''(optional)'' Ehrlich, K., Butler, M. and Pernce, K. \\[[HCIPapers:ehrlich-usab-testing.pdf|'''Getting the whole team into usability testing.''' ]] IEEE Software, p89-90. (1994)** Tips and reasons for including developers as part of the evaluation team.

# Nielsen, J. (1994) \\[[HCIPapers:nielsen-enhancing-chi94.pdf| '''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

Changed lines 36-38 from:

# ''(optional)'' Kennedy, S. \\[[HCIPapers:kennedy-using-video.pdf|'''Using video in the BNR usability lab'''.]] SIGCHI Bulletin, 21(2), p92-95, ACM Press.(1989)** As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.

to:

# Nielsen, J. and R. Mack (eds) ]] \\'''Usability Inspection Methods,''' p25-62, Wiley and Sons.(1994)** [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation.pdf|Chapter 2: Heuristic evaluation. ]] [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation-2pages.pdf| as 2 pages per side]]** A more in depth discussion of how heuristic evaluation works and its reliability

# ''optional'' Krug, S. \\'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000) Extract: Chapters 9-11.** A simple guide to doing cut-rate usability tests. Written for the lay practitioner.**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']]**[[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']]**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']]

!!!Excercise (to be handed out)

#'''Get real with IBM RealPhone'''** We will perform a usability study on IBM's RealPhone system** [[Attach:RealPhoneAll.pdf|Download the full handout]], which contains:**** the presentation**** evaluator's instructions and tasks**** consent form**** Pre-test, During-test and Post-test questions**** methods for running a basic observational study**** discussion of guidelines for user observation**** IBM Real Phone Instruction Sheet and their test-drive instructions**** Isys' Hall of Shame critique of RealPhone** [[Attach:RealPhone.exe|The system is available here]], as an installable .exe** [[Attach:RealPhone.ppt|The presentation, in powerpoint]]

! YOU SHOULD HAVE READ THE ABOVE PAPERS. THE PAPERS BELOW ARE STILL TO BE ASSIGNED

!!!Experimental methodologies#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\* Lecture notes for the talk I give to the class.

!!!Excercise#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''** We will perform a 'pilot' controlled study on how people perform on different types of keyboards

** [[HCIPapers:nielson93-usabilityengch5-usab-heuristics.pdf|Chapter 5: Usability heuristics. p115-163]]** Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.

to:

** [[HCIPapers:nielson93-usabilityengappendix-travel-weather.pdf|Exercise 8: Heuristic Evaluation of a Paper Mock-Up. ]]** Another example, with answers, of a heuristic evaluation.

Changed lines 46-48 from:

# Nielsen, J. (1994) \\[[HCIPapers:nielsen-enhancing-chi94.pdf| '''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

# Greenberg, S. \\[[http://grouplab.cpsc.ucalgary.ca/papers/2003/03-TaskAnalysis.Chapter/task-analysis.chapter.pdf|'''Working through task-centered system design''']]. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.** A how-to approach to task-centered system design.

Changed lines 58-59 from:

** [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation.pdf|Chapter 2: Heuristic evaluation. ]] [[HCIPapers:nielsen94-inspection-ch2-heuristic-evaluation-2pages.pdf| as 2 pages per side]]** A more in depth discussion of how heuristic evaluation works and its reliability

'''Supplemental Readings'''# Lewis, C. and Rieman, J. (1993) \\[[HCIPapers:lewisriemanbook-index.html|'''Task-Centered User Interface Design: A Practical Introduction.''' ]] Available as Shareware. ** The book that started it off. ** Read the chapter '''Getting to Know Users and their Tasks.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

** [[HCIPapers:nielson93-usabilityengappendix-travel-weather.pdf|Exercise 8: Heuristic Evaluation of a Paper Mock-Up. ]]** Another example, with answers, of a heuristic evaluation.

to:

** [[HCIPapers:nielson93-usabilityengch4.8-prototyping.pdf|Chapter 4.8 Prototyping. (Extract)]] p93-101. [[HCIPapers:nielson93-usabilityengch4.8-prototyping-2page.pdf|(also as 2 pages / side )]]** Describes different styles of prototypes and how they can be used within scenarios.

# Muller, M. (1991) \\[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

# Lewis, C. and Rieman, J. (1993) \\[[HCIPapers:lewisriemanbook-index.html|'''Task-Centered User Interface Design: A Practical Introduction.''' ]] Available as Shareware. ** The book that started it off. ** Read the chapter '''Getting to Know Users and their Tasks.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

# Nielsen, J. (1993) \\'''Usability Engineering,''' p273-4, Academic Press.** [[HCIPapers:nielson93-usabilityengch4.8-prototyping.pdf|Chapter 4.8 Prototyping. (Extract)]] p93-101. [[HCIPapers:nielson93-usabilityengch4.8-prototyping-2page.pdf|(also as 2 pages / side )]]** Describes different styles of prototypes and how they can be used within scenarios.

# Muller, M. (1991) \\[[HCIPapers:muller-pictive-chi91.pdf|'''Pictive: An exploration in participatory design'''.]] In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

#'''Get real with IBM RealPhone'''** We will perform a usability study on IBM's RealPhone system** [[Attach:RealPhoneAll.pdf|Download the full handout]], which contains:**** the presentation**** evaluator's instructions and tasks**** consent form**** Pre-test, During-test and Post-test questions**** methods for running a basic observational study**** discussion of guidelines for user observation**** IBM Real Phone Instruction Sheet and their test-drive instructions**** Isys' Hall of Shame critique of RealPhone** [[Attach:RealPhone.exe|The system is available here]], as an installable .exe** [[Attach:RealPhone.ppt|The presentation, in powerpoint]]

! YOU SHOULD HAVE READ THE ABOVE PAPERS. THE PAPERS BELOW ARE STILL TO BE ASSIGNED

----------------

!!!Experimental methodologies#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\* Lecture notes for the talk I give to the class.

!!!Excercise#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''** We will perform a 'pilot' controlled study on how people perform on different types of keyboards

!! Overview of methodologiesThe following papers introduces (but do not detail) many methodologies. They also discuss and compare methodologies from various perspectives: to influence design, to evaluate products, to encourage end-user feedback, and to compare when and where each is useful. Because you do not yet know the details of these methodologies, the discussions in the papers may be hard to follow at times. Because these papers are just intended to give you a feel for the area, I suggest you give them a quick read now. As the course progresses, you will find that you will be able to go back to them for a more careful read.

#Gould, J.D. (1996)\\[[HCIPapers:gould-howto-2-pageperside.pdf | '''How to design usable systems'''.]] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.** This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

# McGrath, J. \\[[HCIPapers:mcgrath-methodologymatters-bgbg95.pdf |'''Methodology matters: Doing research in the behavioural and social sciences.''']] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996). ** See also a [[HCIPapers:mcgrath-methodology-summary-bgbg95.pdf|student-created summary]] by Stephanie Smale** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.

!!!!Optional Readings # Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.** This essay contrasts the academic vs business approach to product development.

# Greenberg, S. and Witten, I. (1984) \\[[http://grouplab.cpsc.ucalgary.ca/papers/1984/84-MenuComparison.CIPS/menu-comparison.CIPS84.pdf|'''Comparison of menu displays for ordered lists''']]. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in the lectures.

# University of Calgary Research Services: Ethics ** [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]** [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]** [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form** [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out** [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]

#''(optional)'' Rogers, Tim \\[[HCIPapers:/rogers-participantrights.pdf|'''Research Participants' Bill of Rights''']]. '-(Originally mirrored from http://www.psych.ucalgary.ca/research/ethics/participant_rights.html-'.** A concise statement of what participant's should expect as fair treatment

->'-''Additional supplemental readings available in the [[Optional Readings]] sections''-'

# ''(optional)'' Ehrlich, K., Butler, M. and Pernce, K. \\[[HCIPapers:ehrlich-usab-testing.pdf|'''Getting the whole team into usability testing.''' ]] IEEE Software, p89-90. (1994)** Tips and reasons for including developers as part of the evaluation team.

! YOU SHOULD HAVE READ THE ABOVE PAPERS. THE PAPERS BELOW ARE STILL TO BE ASSIGNED

Deleted lines 89-99:

!!!Experimental methodologies#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\* Lecture notes for the talk I give to the class.

!!!Excercise#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''** We will perform a 'pilot' controlled study on how people perform on different types of keyboards

Changed lines 157-174 from:

to:

! YOU SHOULD HAVE READ THE ABOVE PAPERS. THE PAPERS BELOW ARE STILL TO BE ASSIGNED

!!!Experimental methodologies#'''Quantitative methods''' [[Attach:EvalControl.ppt|Powerpoint]] or [[Attach:EvalControl.pdf|Adobe PDF]]\\'''Analysis of Variance''' [[Attach:AnVar.ppt|Powerpoint]] or [[Attach:AnVar.pdf|Adobe PDF]]\\* Lecture notes for the talk I give to the class.

!!!Excercise#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''** We will perform a 'pilot' controlled study on how people perform on different types of keyboards

University of Calgary Research Services: Ethics * [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]* [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]* [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form* [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out* [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]

to:

# University of Calgary Research Services: Ethics ** [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]** [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]** [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form** [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out** [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]

University of Calgary Research Services: Ethics * [[http://www.ucalgary.ca/research/compliance/ethics| University of Calgary’s website for Research Ethics]]* [[http://www.ucalgary.ca/research/compliance/ethics/approval| Do I Need to Apply For Ethics Approval?]]* [[http://www.ucalgary.ca/research/files/research/ethics_info_applicants.doc| Information to help applicants]] to fill out the application form* [[http://www.ucalgary.ca/research/files/research/CFREB%20Application%20Form%20-%20Revised%20March%202007%20%28Final%29.doc|Ethics Application Form]] that you should fill out* [[Attach:ConsentFormTemplate.doc|Example template for a consent form]]

#''(optional)'' Rogers, Tim \\

Changed lines 91-111 from:

** A concise statement of what participant's should expect as fair treatment#Research Services\\[[Attach:UofCEthics.pdf|'''University of Calgary Policy Statement Ethical Conduct for Research Involving Humans''']], Excerpt.** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site ]] for the latest update, but unfortunately this is now under review and doesn't seem to be available.**** Section 1 - verify that your work requires ethics clearance,**** Section 6 - if your application concerns course-based research,**** Section 8 for your procedural responsibilities**** Section 9 for guidelines on balancing risks vs benefits**** Section 10 on how to do informed consent**** Section 11 for guidelines on deception (research involving any deception is usually considered risky)**** Section 12 for guidelines on maintaining privacy and confidentiality

#Research Services \\'''Ethics application'''** Go to the '''[[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]'''. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects. **** '''Ethics Information for U of C Graduate Students''', with pointers to what is required in each faculty and the process.**** '''Information to Help Applicants'''**** '''Ethics review application form'''**** '''Sample consent form'''

to:

** A concise statement of what participant's should expect as fair treatment

# Greenberg, S. and Witten, I. (1984) \\[[http://grouplab.cpsc.ucalgary.ca/papers/1984/84-MenuComparison.CIPS/menu-comparison.CIPS84.pdf|'''Comparison of menu displays for ordered lists''']]. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

!!!Excercise#'''[[Attach:KeyboardsComb.pdf|Mouse-Typing on Phone Pads and Keyboards]]'''** We will perform a 'pilot' controlled study on how people perform on different types of keyboards

# Greenberg, S. and Witten, I. (1984) \\[[http://grouplab.cpsc.ucalgary.ca/papers/1984/84-MenuComparison.CIPS/menu-comparison.CIPS84.pdf|'''Comparison of menu displays for ordered lists''']]. In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in the lectures.

** Go to the [[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.

to:

** Go to the '''[[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]'''. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects.

** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. **** [[http://www.ucalgary.ca/research/compliance/ethics/info/grad/|Ethics Information for U of C Graduate Students]]**** [[http://www.ucalgary.ca/research/files/ethics_info_applicants.doc|Information to Help Applicants]], with pointers to what is required in each faculty and the process.**** [[http://www.ucalgary.ca/research/files/CFREB Application Form - Revised March 2007 (Final).doc|Ethics review application form]]**** [[http://www.ucalgary.ca/research/files/ethics_consent.doc|Sample consent form]]

to:

** Go to the [[http://www.ucalgary.ca/research/compliance/ethics/forms/cfreb/ | CFREB Ethics Board Web Site]]. On it, you will find the following important set of pointers describing what you need to do at the University of Calgary if you are doing research involving human subjects. **** '''Ethics Information for U of C Graduate Students''', with pointers to what is required in each faculty and the process.**** '''Information to Help Applicants'''**** '''Ethics review application form'''**** '''Sample consent form'''

**** [[http://www.ucalgary.ca/research/files/ethics_info_applicants.doc|Information to Help Applicants]]

to:

**** [[http://www.ucalgary.ca/research/compliance/ethics/info/grad/|Ethics Information for U of C Graduate Students]]**** [[http://www.ucalgary.ca/research/files/ethics_info_applicants.doc|Information to Help Applicants]], with pointers to what is required in each faculty and the process.

** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site for the latest update]], but unfortunately this is now under review and doesn't seem to be available.

to:

** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site ]] for the latest update, but unfortunately this is now under review and doesn't seem to be available.

** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[Attach:ExcerptEthical.doc|excerpt from that page]] includes:**** [[Attach:EthicsGuide.doc|Instructions for Ethics Review Applicants]]**** [[Attach:EthicsReview.doc|Ethics review application form]]**** [[Attach:Consent.doc|Sample consent form]]

to:

** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. **** [[http://www.ucalgary.ca/research/files/ethics_info_applicants.doc|Information to Help Applicants]]**** [[http://www.ucalgary.ca/research/files/CFREB%20Application%20Form%20-%20Revised%20March%202007%20(Final).doc|Ethics review application form]]**** [[http://www.ucalgary.ca/research/files/ethics_consent.doc|Sample consent form]]

** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/UofC/research/html/ethics/poli_guide.html|Ethics site for the latest update]]

to:

** This is an extract from an older official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/research/compliance/ethics/|Ethics site for the latest update]], but unfortunately this is now under review and doesn't seem to be available.

**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']**[[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']

to:

**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']]**[[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']]**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']]

'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000) ** Chapters 9-11 are available for download, which provide a simple guide to doing cut-rate usability tests. Written for the lay practitioner.

to:

'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000) Extract: Chapters 9-11.** A simple guide to doing cut-rate usability tests. Written for the lay practitioner.**[[http://sensible.com/Downloads/DMMTchapter09_for_personal_use_only.pdf | '''Chapter 9: Usability testing on 10 cents a day''']**[[http://sensible.com/Downloads/DMMTchapter10_for_personal_use_only.pdf | '''Chapter 10: What to do if you're the facilitator''']**[[http://sensible.com/Downloads/DMMTchapter11_for_personal_use_only.pdf | '''Chapter 11: Can this marriage be saved?''']

# ''optional'' Krug, S. \\'''[[http://www.sensible.com/secondedition/|Don't Make Me Think: A Common Sense Approach to Web Usability'''.]] 1st Edition. Pearson Education, Inc and New riders. (2000) ** Chapters 9-11 are available for download, which provide a simple guide to doing cut-rate usability tests. Written for the lay practitioner.

[[http://grouplab.cpsc.ucalgary.ca/papers/1993/93-Woz.CHI/93-woz.chi.pdf|Prototyping an intelligent agent through Wizard of Oz]]. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.

to:

[[http://grouplab.cpsc.ucalgary.ca/papers/1993/93-Woz.CHI/93-woz.chi.pdf|'''Prototyping an intelligent agent through Wizard of Oz''']]. Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press.

Changed lines 262-263 from:

[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995**** Describes a system that lets people sketch and storyboard through a live computer interface.

to:

[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995** Describes a system that lets people sketch and storyboard through a live computer interface.

* [[Getting to Know Users and their Tasks]]. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.**** Describes task-centered system design and how tasks are used to define walkthroughs.* [[Task-Centered User Interface Design: A Practical Introduction]]. Lewis, C. and Rieman, J. (1993) Available as Shareware.**** The book that started it off. The above reading is in this book

to:

# Lewis, C. and Rieman, J. (1993) \\[[HCIPapers:lewisriemanbook-index.html|Task-Centered User Interface Design: A Practical Introduction. ]] Available as Shareware. ** The book that started it off. ** Read the chapter '''Getting to Know Users and their Tasks.''', which was also published In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.

* [[Retrospective on a year of participatory design using the PICTIVE technique]] Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 **** Experiences with Pictive and recommendations.

* [[Interactive sketching for the early stages of user interface design]]. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995**** Describes a system that lets people sketch and storyboard through a live computer interface.

!!!Field Study Methodologies (tentative)

'''Introduction'''

#[[First Rule of Usability? Don't Listen to Users and Field Studies Done Right: Fast and Observational.]] Jakob Nielsen, Alertbox, August 5, 2001 and January 20, 2002. [[http://www.useit.com/alertbox/20010805.html]] and [[http://www.useit.com/alertbox/20020120.html|20020120.html]]

* Muller, Michael J. \\[[HCIPapers:muller-retrospective-chi92.pdf|'''Retrospective on a year of participatory design using the PICTIVE technique'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 ** Experiences with Pictive and recommendations.

* Landay, James A., and Brad A. Myers \\[[HCIPapers:landay-sketching-chi95.pdf|'''Interactive sketching for the early stages of user interface design'''.]] Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995**** Describes a system that lets people sketch and storyboard through a live computer interface.

#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

'-''Last updated Fall, 2004''-'

to:

# Landauer, T. (1991) \\[[HCIPapers:landauer-letsgetreal.pdf|'''Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems''',]] In J. Carroll (ed) Designing Interaction, Cambridge University Press.

#'''A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)#'''Usability Engineering''', Nielsen, J. (1993) Academic Press.#'''Papers of the remaining readings''' will be made available to you at cost.

* Required:##'''A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)##'''Usability Engineering''', Nielsen, J. (1993) Academic Press.##'''Papers of the remaining readings''' will be made available to you at cost.

#'''[[Enhancing the explanatory power of usability heuristics]]'''. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.

to:

# Nielsen, J. (1994) \\[[HCIPapers:nielsen-enhancing-chi94.pdf| '''Enhancing the explanatory power of usability heuristics'''.]] In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.

# McGrath, J. \\[[HCIPapers:mcgrath-methodologymatters-bgbg95.pdf |'''Methodology matters: Doing research in the behavioural and social sciences.''']] In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. (1996). ** See also a [[HCIPapers:mcgrath-methodology-summary-bgbg95.pdf|student-created summary]] by Stephanie Smale** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.

Changed lines 48-52 from:

#[[Attach:MethodMatters.pdf|Methodology matters: Doing research in the behavioural and social sciences]]. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.** see the summary chart of this paper, produced by Stephanie Smale

#[[Attach:ApplyingBehav.pdf|Applying the Behavioral, Cognitive, and Social Sciences to Products.]] Donald A. Norman (2001) mirrored from [[http://www.jnd.org/dn.mss/BCCSandProducts.html]]

to:

# Norman, D. [[HCIPapers:norman-applying-behavioral2001.pdf|'''Applying the Behavioral, Cognitive, and Social Sciences to Products'''.]] Mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html 2001.

#[[Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

to:

#[[http://pages.cpsc.ucalgary.ca/~saul/hci_educ_papers/index.html|Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[excerpt from that page]] includes:

to:

** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[Attach:ExcerptEthical.doc|excerpt from that page]] includes:

** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[U of C]] [[Ethics site for the latest update]]

to:

** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[http://www.ucalgary.ca|U of C]] [[http://www.ucalgary.ca/UofC/research/html/ethics/poli_guide.html|Ethics site for the latest update]]

#Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

to:

#[[Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems]]. Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

#[[Low vs. high fidelity prototyping debate]]. Rudd, J., Stern, K. and Isensee, S. (1996). Interactions 3(1), p76-85, ACM Press.** When are where you should use low vs. high fidelity prototypes

Changed lines 223-224 from:

4. [[Pictive: An exploration in participatory design]]. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.* A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

to:

#[[Pictive: An exploration in participatory design]]. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press.** A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

* [[Interactive sketching for the early stages of user interface design]]. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995 o Describes a system that lets people sketch and storyboard through a live computer interface.

to:

#[[Composing letters with a simulated listening typewriter]]. Gould, J., Conti, J., and Hovanyecz, T. (1981) Communications of the ACM, 26(4), 295-308. ACM Press.** The first description of the Wizard of Oz prototyping/testing method.

* [[Retrospective on a year of participatory design using the PICTIVE technique]] Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992** Experiences with Pictive and recommendations.

* [[Interactive sketching for the early stages of user interface design]]. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995** Describes a system that lets people sketch and storyboard through a live computer interface.

Ethnography 1. Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.* Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.

#Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97.** Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.

6. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

Last updated Fall, 2004

to:

#Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.

**** 2: Introducing usability testing**** 6: Establishing a usability program in your organization**** 7: Planning a usability test**** 9: Deciding who should be participants**** 11: Selecting and organizing tasks to test**** 12: Creating task scenarios**** 15: Preparing the testing environment**** 18: Caring for the test participants**** 19: Conducting the test**** Appendix A: Setting up a usability laboratory**** All of the above as a single PDF

to:

**** [[2: Introducing usability testing]]**** [[6: Establishing a usability program in your organization]]**** [[7: Planning a usability test]]**** [[9: Deciding who should be participants]]**** [[11: Selecting and organizing tasks to test]]**** [[12: Creating task scenarios]]**** [[15: Preparing the testing environment]]**** [[18: Caring for the test participants]]**** [[19: Conducting the test]]**** [[Appendix A: Setting up a usability laboratory]]**** [[All of the above as a single PDF]]

* [[Getting to Know Users and their Tasks]]. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann. o Describes task-centered system design and how tasks are used to define walkthroughs. * [[Task-Centered User Interface Design: A Practical Introduction]]. Lewis, C. and Rieman, J. (1993) Available as Shareware. o The book that started it off. The above reading is in this book

to:

* [[Getting to Know Users and their Tasks]]. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann.** Describes task-centered system design and how tasks are used to define walkthroughs.* [[Task-Centered User Interface Design: A Practical Introduction]]. Lewis, C. and Rieman, J. (1993) Available as Shareware.** The book that started it off. The above reading is in this book

2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.* A how-to approach to task-centered system design.

to:

#[[Working through task-centered system design]]. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates.** A how-to approach to task-centered system design.

#'''Improving a human-computer dialogue''', Molich, R. and Nielsen, J. (1990) Communications of the ACM 33(3), March, p338-348, ACM Press.** This article lists the heuristics and presents a working example, solutions, and alternatives.

#'''Text-Chapter 5: Usability heuristics'''. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press.** Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.

#'''Enhancing the explanatory power of usability heuristics'''. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158.** This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

Changed lines 174-175 from:

3. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press. * Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.

to:

#'''Chapter 2: Heuristic evaluation'''. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons.** A more in depth discussion of how heuristic evaluation works and its reliability

Changed lines 177-178 from:

4. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158. * This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates. * A how-to approach to task-centered system design.

2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates. * A how-to approach to task-centered system design.

* This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise#Mouse-Typing on Phone Pads and KeyboardsWe will perform a 'pilot' controlled study on how people perform on different types of keyboards

to:

** This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

'''Excercise'''

#'''Mouse-Typing on Phone Pads and Keyboards'''We will perform a 'pilot' controlled study on how people perform on different types of keyboards

#Constructive interaction: A method for studying user-computer-user interaction. O'Malley, C., Draper, S. and Riley, M. (1984) From Proceedings of Interact '84, p1-5.** Describes a method for observing people working together.

Changed lines 129-130 from:

6. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.* As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.

to:

#Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press.** As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.

8. Get real with IBM RealPhone * We will perform a usability study on IBM's RealPhone system * Download the full handout, which contains o the presentation o evaluator's instructions and tasks o consent form o Pre-test, During-test and Post-test questions o methods for running a basic observational study o discussion of guidelines for user observation o IBM Real Phone Instruction Sheet and their test-drive instructions o Isys' Hall of Shame critique of RealPhone * The system is available here, as an installable .exe* The presentation, in powerpoint

to:

#Get real with IBM RealPhone** We will perform a usability study on IBM's RealPhone system** Download the full handout, which contains**** the presentation**** evaluator's instructions and tasks**** consent form**** Pre-test, During-test and Post-test questions**** methods for running a basic observational study**** discussion of guidelines for user observation**** IBM Real Phone Instruction Sheet and their test-drive instructions**** Isys' Hall of Shame critique of RealPhone** The system is available here, as an installable .exe** The presentation, in powerpoint

** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:**** Instructions for Ethics Review Applicants**** Ethics review application form**** Sample consent form'-''Supplemental Readings available in the Optional Readings sections''-'

to:

** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This [[excerpt from that page]] includes:**** [[Instructions for Ethics Review Applicants]]**** [[Ethics review application form]]**** [[Sample consent form]]

'-''Supplemental Readings available in the [[Optional Readings]] sections''-'

#Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update

to:

#Excerpt of [[University of Calgary Policy Statement Ethical Conduct for Research Involving Humans]], Research Services** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the [[U of C]] [[Ethics site for the latest update]]

#A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)#Usability Engineering, Nielsen, J. (1993) Academic Press.#Papers of the remaining readings will be made available to you at cost.

to:

#'''A Practical Guide to Usability Testing'''. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)#'''Usability Engineering''', Nielsen, J. (1993) Academic Press.#'''Papers of the remaining readings''' will be made available to you at cost.

#Overview of methodologies [Powerpoint]\\* also as [Adobe PDF]* Lecture notes for the talk I give to the class.

to:

#Overview of methodologies [Powerpoint]** also as [Adobe PDF]** Lecture notes for the talk I give to the class.

Changed lines 36-37 from:

#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.\\* This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

to:

#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.** This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.\\* This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.* see the summary chart of this paper, produced by Stephanie Smale

to:

#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.** This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.** see the summary chart of this paper, produced by Stephanie Smale

Changed lines 46-49 from:

#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html\\* This essay contrasts the academic vs business approach to product development.

to:

#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html** This essay contrasts the academic vs business approach to product development.

Changed lines 52-54 from:

1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)* A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.

to:

#Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185)** A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.

Changed lines 55-56 from:

2. Research Participants' Bill of Rights by Tim Rogers [also as PDF]* A concise statement of what participant's should expect as fair treatment

to:

#Research Participants' Bill of Rights by Tim Rogers [also as PDF]** A concise statement of what participant's should expect as fair treatment

Changed lines 58-66 from:

3. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services * This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update o Section 1 - verify that your work requires ethics clearance, o Section 6 - if your application concerns course-based research, o Section 8 for your procedural responsibilities o Section 9 for guidelines on balancing risks vs benefits o Section 10 on how to do informed consent o Section 11 for guidelines on deception (research involving any deception is usually considered risky) o Section 12 for guidelines on maintaining privacy and confidentiality

to:

#Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services** This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update**** Section 1 - verify that your work requires ethics clearance,**** Section 6 - if your application concerns course-based research,**** Section 8 for your procedural responsibilities**** Section 9 for guidelines on balancing risks vs benefits**** Section 10 on how to do informed consent**** Section 11 for guidelines on deception (research involving any deception is usually considered risky)**** Section 12 for guidelines on maintaining privacy and confidentiality

Changed lines 68-76 from:

4. Ethics application * A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes: o Instructions for Ethics Review Applicants o Ethics review application form o Sample consent form

Supplemental Readings available in the Optional Readings sections

to:

#Ethics application** A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes:**** Instructions for Ethics Review Applicants**** Ethics review application form**** Sample consent form

'-''Supplemental Readings available in the Optional Readings sections''-'

1. Overview of methodologies [Powerpoint] * also as [Adobe PDF]* Lecture notes for the talk I give to the class.

to:

#Overview of methodologies [Powerpoint]* also as [Adobe PDF]* Lecture notes for the talk I give to the class.

Changed lines 36-37 from:

2. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.* This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

to:

#How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann.* This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

4. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. * This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.* see the summary chart of this paper, produced by Stephanie Smale

to:

#Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann.* This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses.* see the summary chart of this paper, produced by Stephanie Smale

Changed lines 46-49 from:

5. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html* This essay contrasts the academic vs business approach to product development.

to:

#Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html* This essay contrasts the academic vs business approach to product development.

Required 1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999) 2. Usability Engineering, Nielsen, J. (1993) Academic Press. 3. Papers of the remaining readings will be made available to you at cost.

to:

Required:

#A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999)#Usability Engineering, Nielsen, J. (1993) Academic Press.#Papers of the remaining readings will be made available to you at cost.

You should buy these texts. Some of the readings below will be from them.

Required

1. A Practical Guide to Usability Testing. Revised Edition. Dumas, J.S. and Redish, J.C. (1999) 2. Usability Engineering, Nielsen, J. (1993) Academic Press. 3. Papers of the remaining readings will be made available to you at cost.

The following papers introduces (but do not detail) many methodologies. They also discuss and compare methodologies from various perspectives: to influence design, to evaluate products, to encourage end-user feedback, and to compare when and where each is useful. Because you do not yet know the details of these methodologies, the discussions in the papers may be hard to follow at times. Because these papers are just intended to give you a feel for the area, I suggest you give them a quick read now. As the course progresses, you will find that you will be able to go back to them for a more careful read.

1. Overview of methodologies [Powerpoint] * also as [Adobe PDF] * Lecture notes for the talk I give to the class.

2. How to design usable systems. Gould, J.D. (1996) In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p93-121, Morgan-Kaufmann. * This delightful paper, originally written in 1988, presents an overview of many informal methods and how they are applied to the usability design process.

4. Methodology matters: Doing research in the behavioural and social sciences. McGrath, J. (1996). In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p152-169, Morgan-Kaufmann. * This excellent paper discusses and compares fundamental concepts in evaluation methods. While it may be a 'heavy' read. its worth re-reading as the course progresses. * see the summary chart of this paper, produced by Stephanie Smale

5. Applying the Behavioral, Cognitive, and Social Sciences to Products. Donald A. Norman (2001) mirrored from http://www.jnd.org/dn.mss/BCCSandProducts.html * This essay contrasts the academic vs business approach to product development.

Ethics

1. Text-Chapter 6.4: Ethical aspects of tests with human subjects. Nielsen, J. (1993) In Usability Engineering, Academic Press. (Read extract p181-185) * A gentle and pragmatic introduction to ethics in HCI. See also my excerpt from CPSC 481 on Ethics, which summarizes some of Nielson's points.

2. Research Participants' Bill of Rights by Tim Rogers [also as PDF] * A concise statement of what participant's should expect as fair treatment

3. Excerpt of University of Calgary Policy Statement Ethical Conduct for Research Involving Humans, Research Services * This is an extract from the official University of Calgary policy on ethics. You MUST adhere to this policy if you do research at the University. Go to the U of C Ethics site for the latest update o Section 1 - verify that your work requires ethics clearance, o Section 6 - if your application concerns course-based research, o Section 8 for your procedural responsibilities o Section 9 for guidelines on balancing risks vs benefits o Section 10 on how to do informed consent o Section 11 for guidelines on deception (research involving any deception is usually considered risky) o Section 12 for guidelines on maintaining privacy and confidentiality

4. Ethics application * A set of pointers and steps describing what you need to do at the University of Calgary if you are doing research involving human subjects. This excerpt from that page includes: o Instructions for Ethics Review Applicants o Ethics review application form o Sample consent form

Supplemental Readings available in the Optional Readings sectionsUser ObservationExperimental methodologies

1. Quantitative methods [Powerpoint or Adobe PDF] Analysis of Variance [Powerpoint or Adobe PDF] * Lecture notes for the talk I give to the class. 2.

Comparison of menu displays for ordered lists. Greenberg, S. and Witten, I. (1984) In Proc Canadian Information Processing Society National Conference, Calgary, Alberta, May * This paper describes the first experiment I ever did, and is an example of how statistical methods can be interpreted and applied to comparing particular system features. I use this example in my Analysis of Variance talk above.

Excercise

5. Mouse-Typing on Phone Pads and Keyboards We will perform a 'pilot' controlled study on how people perform on different types of keyboards

6. Using video in the BNR usability lab. Kennedy, S. (1989) SIGCHI Bulletin, 21(2), p92-95, ACM Press. * As in constructive interaction, they describe why observing multiple people working together is beneficial. Also describes benefits of videotaping.

8. Get real with IBM RealPhone * We will perform a usability study on IBM's RealPhone system * Download the full handout, which contains o the presentation o evaluator's instructions and tasks o consent form o Pre-test, During-test and Post-test questions o methods for running a basic observational study o discussion of guidelines for user observation o IBM Real Phone Instruction Sheet and their test-drive instructions o Isys' Hall of Shame critique of RealPhone * The system is available here, as an installable .exe * The presentation, in powerpoint

3. Text-Chapter 5: Usability heuristics. Nielsen, J. (1993) In Usability Engineering, p115-163, Academic Press. * Describes the heuristics in detail plus how and why it can be used to evaluate interfaces.

4. Enhancing the explanatory power of usability heuristics. Nielsen, J. (1994) In Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, p152-158. * This article takes usability guidelines developed by different sources and sees which ones contribute most the the explanation of actual usability problems drawn from a database.

5. Chapter 2: Heuristic evaluation. Nielsen, J. (1994) In J. Nielsen and R. Mack (eds) Usability Inspection Methods, p25-62, Wiley and Sons. * A more in depth discussion of how heuristic evaluation works and its reliability

2. Working through task-centered system design. Greenberg, S. in Diaper, D. and Stanton, N. (Eds) The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates. * A how-to approach to task-centered system design.

* Getting to Know Users and their Tasks. Lewis, C. and Rieman, J. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, p122-127, Morgan-Kaufmann. o Describes task-centered system design and how tasks are used to define walkthroughs. * Task-Centered User Interface Design: A Practical Introduction. Lewis, C. and Rieman, J. (1993) Available as Shareware. o The book that started it off. The above reading is in this book

4. Pictive: An exploration in participatory design. Muller, M. (1991) In Proceedings of the ACM Conference on Human Factors in Computing Systems, p225-231, ACM Press. * A method for low fidelity prototype development that builds it on the fly with postit notes and other office supplies

* Prototyping an intelligent agent through Wizard of Oz. Maulsby, D., Greenberg, S. and Mander, R. (1993). Proceedings of the ACM CHI'93 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, p277-284, ACM Press. o Describes a sophisticated Wizard of Oz experiment, plus gives advice on how to apply WOZ. * Retrospective on a year of participatory design using the PICTIVE technique Michael J. Muller Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press June 1992 o Experiences with Pictive and recommendations. * The “Starfire” video prototype project: a case history Bruce Tognazzini Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, April 1994 o Describes a sophisticated video prototyping project.

* Interactive sketching for the early stages of user interface design. James A. Landay, Brad A. Myers Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press. May 1995 o Describes a system that lets people sketch and storyboard through a live computer interface.

1. Chapter 3: Social Computing. In Dourish, P. (2001) Where the Action Is. MIT Press. p55-97. * Dourish introduces anthropology, ethnography and ethnomethodology and how it relates to Social Computing. While the 2nd half of this chapter is more related to the theme of his book, its still worth reading to the end. The book itself is great and is a must read for HCI researchers.

6. Lets Get Real: A Position Paper on the Role of Cognitive Psychology in the Design of Humanly Useful and Usable Systems, Landauer, T. (1991) In J. Carroll (ed) Designing Interaction, Cambridge University Press.