ClassInfo

HCI 460 Usability Evaluation Methods

Spring 2012-2013
Class number: 35432
Section number: 901
Th 5:45PM - 9:00PM
14EAS 00802 Loop Campus

Summary

This course surveys methods for evaluating user interfaces. For projects, students will perform a heuristic evaluation, a cognitive walkthrough, a usability test and a comparison study. Class meetings will also introduce, discuss and occasionally practice additional methods such as user modeling and questionnaires.

Goals:

  • Selecting an appropriate evaluation method and articulating its advantages and disadvantages
  • Critiquing the validity of usability measures
  • Understanding the role of evaluation in the design process
  • Establishing useful test objectives
  • Preparing reports and presenting results

Projects:

  • Heuristic Evaluation and Cognitive Walkthrough
  • Preparation for Usability Test
  • Usability Test and Results
  • Establishing useful test objectives
  • Comparison Study



Texts

  • Handbook of Usability Testing by Rubin (first edition: ISBN 0-471-59403-2 or second edition: ISBN 0-470-18548-1)
  • Task-Centered User Interface Design: A Practical Introduction by Lewis and Rieman (Online text: http://www.hcibib.org/tcuid/ or http://hcibib.org/tcuid/tcuid.pdf)


Grading

Grade Determination
40% (80 points) 4 Projects (20 points each)
15% (30 points) Midterm
35% (70 points) Final Exam
10% (20 points) Project Contribution

Grading scale:
A 100 - 93%
A- 92 - 90%
B+ 89 - 87%
B- 86 - 83%
B- 82 - 80%
C+ 79 - 77%
C 76 - 73%
C- 72 - 70%
D+ 69 - 67%
D 66 - 60%
F 59 - 0%

Generally, any 20 project that closely adheres to its instructions and grading sheet will receive at least 16 (out of 20) points. Projects that are thoughtful, well-edited, systematic and concise will generally receive 18 or 19 points. A truly outstanding report will receive 20 points. Note that a long report is not necessarily a good report!

Late assignment submission policy:

10% reduction per day late and worth zero points after 3 days



Prerequisites

HCI 440

Elementary statistics (e.g., IT 223 or PSY 240)



Important Notes:

We have an intense, yet reasonable schedule. It is important that each week you keep up with your reading, actively attend or watch the lectures and proactively work with your team. This is a graduate class. I expect each of you to be ready to discuss the required reading during each class period. I believe lecturing for three consecutive hours is cruel and unusual punishment, so I will incorporate discussions and breaks into every lecture. Usability Evaluations Methods is a very interesting subject. There's no reason for our lectures to be boring. I'll try my best to keep things interesting, but keep in mind that you'll enjoy each lecture more if you come prepared.

Office Hours:

Thursday, 5:00 pm - 5:45 pm, In our classroom
(Also in D2L's Online Rooms for Distance Learning students)

Thursday, 9:00 pm - 9:45 pm, In our classroom

Our Lectures:

You can download the PowerPoint lectures from D2L in the Documents section. Each lecture focuses on the most important points for the weekly topic(s). Each week I will discuss real world examples related to each topic and encourage you to share your related experiences with the class. The final exams will pull heavily from the material that we cover in lecture, but you will also be tested on information that you will learn from your required readings in the textbook.

Distance Learning students may attend the class real time and ask questions by going to Online Rooms in top navigation of D2L. This is similar to Wimba functionality, in case you are familiar with that application.



Tentative Schedule

Week Day Topic Text Reading Exam or Project Due

1

April 4 Course overview, usability principles, heuristic evaluation, cognitive walkthrough Rubin ch. 1, Lewis and Rieman ch. 4 (except 4.2) Pick applications for evaluation

2

April 11 Other Walkthroughs Lewis and Rieman ch. 4 (except 4.2), course notes

3

April 18 Prep for usability testing and Testing materials Rubin ch. 5-8 Project 1

4

April 25 Conducting the usability test Rubin ch. 8-10

5

May 2 Pilot testing. In-class meets in CDM 805. No recorded lecture Project 2 & Pilot test

6

May 9 Midterm. No recorded lecture Midterm
(in-class for in-class students & DL's will NOT need proctors)

7

May 16 Writing findings & recommendations, comparison studies, statistical inferencing Rubin ch. 12

8

May 23 Subjective measures and User modeling Lewis and Rieman section 4.2 Project 3

9

May 30 KLM and user modeling exercise DL: GOMS exercise. In-class: Will do it in-class. Submit report to Discussion Forum

10

June 6 Presentations, exam review Project 4

11

June 13 Project Contribution,
Final Exam


School policies:

Changes to Syllabus

This syllabus is subject to change as necessary during the quarter. If a change occurs, it will be thoroughly addressed during class, posted under Announcements in D2L and sent via email.

Online Course Evaluations

Evaluations are a way for students to provide valuable feedback regarding their instructor and the course. Detailed feedback will enable the instructor to continuously tailor teaching methods and course content to meet the learning goals of the course and the academic needs of the students. They are a requirement of the course and are key to continue to provide you with the highest quality of teaching. The evaluations are anonymous; the instructor and administration do not track who entered what responses. A program is used to check if the student completed the evaluations, but the evaluation is completely separate from the student’s identity. Since 100% participation is our goal, students are sent periodic reminders over three weeks. Students do not receive reminders once they complete the evaluation. Students complete the evaluation online in CampusConnect.

Academic Integrity and Plagiarism

This course will be subject to the university's academic integrity policy. More information can be found at http://academicintegrity.depaul.edu/ If you have any questions be sure to consult with your professor.

All students are expected to abide by the University's Academic Integrity Policy which prohibits cheating and other misconduct in student coursework. Publicly sharing or posting online any prior or current materials from this course (including exam questions or answers), is considered to be providing unauthorized assistance prohibited by the policy. Both students who share/post and students who access or use such materials are considered to be cheating under the Policy and will be subject to sanctions for violations of Academic Integrity.

Academic Policies

All students are required to manage their class schedules each term in accordance with the deadlines for enrolling and withdrawing as indicated in the University Academic Calendar. Information on enrollment, withdrawal, grading and incompletes can be found at http://www.cdm.depaul.edu/Current%20Students/Pages/PoliciesandProcedures.aspx.

Students with Disabilities

Students who feel they may need an accommodation based on the impact of a disability should contact the instructor privately to discuss their specific needs. All discussions will remain confidential.
To ensure that you receive the most appropriate accommodation based on your needs, contact the instructor as early as possible in the quarter (preferably within the first week of class), and make sure that you have contacted the Center for Students with Disabilities (CSD) at:
Lewis Center 1420, 25 East Jackson Blvd.
Phone number: (312)362-8002
Fax: (312)362-6544
TTY: (773)325.7296