ClassInfo

HCI 460 Usability Evaluation Methods

Winter 2012-2013
Class number: 24751
Section number: 801
Th 5:45PM - 9:00PM
LEWIS 01508 Loop Campus

Summary

This course surveys methods for evaluating user interfaces. For projects, students will perform a heuristic evaluation, a cognitive walkthrough, a usability test and a comparison study. Class meetings will also introduce, discuss and occasionally practice additional methods such as user modeling and questionnaires.

Goals:

  • Selecting an appropriate evaluation method and articulating its advantages and disadvantages
  • Critiquing the validity of usability measures
  • Understanding the role of evaluation in the design process
  • Establishing useful test objectives
  • Preparing reports and presenting results

Projects:

  • Heuristic Evaluation and Cognitive Walkthrough
  • Preparation for Usability Test
  • Usability Test and Results
  • Establishing useful test objectives
  • Comparison Study



Texts

  • Handbook of Usability Testing by Rubin (first edition: ISBN 0-471-59403-2 or second edition: ISBN 0-470-18548-1)
  • Task-Centered User Interface Design: A Practical Introduction by Lewis and Rieman (Online text: http://www.hcibib.org/tcuid/ or http://hcibib.org/tcuid/tcuid.pdf)


Grading

Grade Determination
40% (80 points) 4 Projects (20 points each)
15% (30 points) Midterm
35% (70 points) Final Exam
10% (20 points) Project Contribution

Grading scale:
A 100 - 93%
A- 92 - 90%
B+ 89 - 87%
B- 86 - 83%
B- 82 - 80%
C+ 79 - 77%
C 76 - 73%
C- 72 - 70%
D+ 69 - 67%
D 66 - 60%
F 59 - 0%

Late assignment submission policy:

10% reduction per day late and worth zero points after 3 days



Prerequisites

HCI 440

Elementary statistics (e.g., IT 223 or PSY 240)



Important Notes:

We have an intense, yet reasonable schedule. It is important that each week you keep up with your reading, actively attend or watch the lectures and proactively work with your team. This is a graduate class. I expect each of you to be ready to discuss the required reading during each class period. I believe lecturing for three consecutive hours is cruel and unusual punishment, so I will incorporate discussions and breaks into every lecture. Usability Evaluations Methods is a very interesting subject. There's no reason for our lectures to be boring. I'll try my best to keep things interesting, but keep in mind that you'll enjoy each lecture more if you come prepared.

Office Hours:

Thursday, 5:00 pm - 5:45 pm, Lewis 1508
Also on Skype for distance learning students (cyberboomerang)

Thursday, 9:00 pm - 9:45 pm, Lewis 1508

Our Lectures:

You can download the PowerPoint lectures from D2L in the Documents section. Each lecture focuses on the most important points for the weekly topic(s). Each week I will discuss real world examples related to each topic and encourage you to share your related experiences with the class. The final exams will pull heavily from the material that we cover in lecture, but you will also be tested on information that you will learn from your required readings in the textbook.

Distance Learning students may attend the class real time and ask questions by going to Online Rooms in top navigation of D2L. This is similar to Wimba functionality, in case you are familiar with that application.



Tentative Schedule

Week Day Topic Text Reading Exam or Project Due

1

Jan 10 Course overview, usability principles, heuristic evaluation, cognitive walkthrough Rubin ch. 1, Lewis and Rieman ch. 4 (except 4.2) Pick applications for evaluation

2

Jan 17 Other Walkthroughs Lewis and Rieman ch. 4 (except 4.2), course notes

3

Jan 24 Prep for usability testing and Testing materials Rubin ch. 5-8 Project 1

4

Jan 31 Conducting the usability test Rubin ch. 8-10

5

Feb 7 Pilot testing. In-class meets in CDM 805. No recorded lecture Project 2 & Pilot test

6

Feb 14 Writing Findings and Recommendations Midterm
(in-class for in-class students & DL's will NOT need proctors)

7

Feb 21 Comparison studies and statistical inferencing

8

Feb 28 Subjective measures and User modeling Lewis and Rieman section 4.2 Project 3

9

March 7 KLM lab and user modeling GOMS Exercise (familiarize self with files in Admin)

10

March 14 Presentations, exam review Project 4

11

March 21 Project Contribution,
Final Exam


School policies:

Changes to Syllabus

This syllabus is subject to change as necessary during the quarter. If a change occurs, it will be thoroughly addressed during class, posted under Announcements in D2L and sent via email.

Online Course Evaluations

Evaluations are a way for students to provide valuable feedback regarding their instructor and the course. Detailed feedback will enable the instructor to continuously tailor teaching methods and course content to meet the learning goals of the course and the academic needs of the students. They are a requirement of the course and are key to continue to provide you with the highest quality of teaching. The evaluations are anonymous; the instructor and administration do not track who entered what responses. A program is used to check if the student completed the evaluations, but the evaluation is completely separate from the student’s identity. Since 100% participation is our goal, students are sent periodic reminders over three weeks. Students do not receive reminders once they complete the evaluation. Students complete the evaluation online in CampusConnect.

Academic Integrity and Plagiarism

This course will be subject to the university's academic integrity policy. More information can be found at http://academicintegrity.depaul.edu/ If you have any questions be sure to consult with your professor.

All students are expected to abide by the University's Academic Integrity Policy which prohibits cheating and other misconduct in student coursework. Publicly sharing or posting online any prior or current materials from this course (including exam questions or answers), is considered to be providing unauthorized assistance prohibited by the policy. Both students who share/post and students who access or use such materials are considered to be cheating under the Policy and will be subject to sanctions for violations of Academic Integrity.

Academic Policies

All students are required to manage their class schedules each term in accordance with the deadlines for enrolling and withdrawing as indicated in the University Academic Calendar. Information on enrollment, withdrawal, grading and incompletes can be found at http://www.cdm.depaul.edu/Current%20Students/Pages/PoliciesandProcedures.aspx.

Students with Disabilities

Students who feel they may need an accommodation based on the impact of a disability should contact the instructor privately to discuss their specific needs. All discussions will remain confidential.
To ensure that you receive the most appropriate accommodation based on your needs, contact the instructor as early as possible in the quarter (preferably within the first week of class), and make sure that you have contacted the Center for Students with Disabilities (CSD) at:
Lewis Center 1420, 25 East Jackson Blvd.
Phone number: (312)362-8002
Fax: (312)362-6544
TTY: (773)325.7296