U-M CIS 577 - User Interface Evaluation

Unformatted text preview:

User Interface EvaluationProblems with TestingEvaluation MethodologiesExpert Review FormatsUsability Lab ApproachesSurveysAcceptance TestsEvaluation During Active UseClassical Experimental Psychology MethodologyFactors affecting choice of evaluation methodologyUI Evaluation ProcessUser Interface Evaluation Criteria - 1User Interface Evaluation Criteria - 201/14/19 User Interface EvaluationCIS 577Bruce R. MaximUM-Dearborn01/14/19 Problems with Testing•Can't guarantee perfection •When do stop repairing bugs and ship the prototype? •Testing focuses on normal product use, not extreme01/14/19 Evaluation Methodologies•Expert Review•Usability Laboratory•Surveys•Acceptance Tests•Evaluation During Active Use•Classical Experimental Psychology Methodology01/14/19 Expert Review Formats•Heuristic evaluation •Guideline review •Consistency inspection •Cognitive walkthrough •Formal usability inspection01/14/19 Usability Lab Approaches•Think aloud •Video tape •Field tests •Destructive testing •Competitive usability testing01/14/19 Surveys•Focus on specific UI features •Plan statistical analysis before data collection •Consider on-line surveys to increase response rates •Use semantically anchored Likert type scales01/14/19 Acceptance Tests•Must be based on measurable criteria •Focus on user behavior and task completion01/14/19 Evaluation During Active Use•Interviews •Continuous user performance data logging •On-line or telephone consulting •On-line suggestion box or trouble reports •On-line bulleting board or newsgroup •User newsletter or conferences01/14/19 Classical Experimental Psychology Methodology •These would involve closed laboratory experiments with single control variables and explicit research hypotheses•For example, examining the effect of color choice (forgound/background) on speed of user task completion or error rate01/14/19 Factors affecting choice of evaluation methodology•Stage of design•Novelty of product•Expected number of users•Criticality of interface•Cost of product and budget for testing•Experience of design and evaluation teams01/14/19 UI Evaluation Process1. Preliminary design2. Build first interface prototype3. User evaluates interface4. Evaluation results studied by designer5. Design modifications made6. Build next prototype7. If interface is not complete then go to step 301/14/19 User Interface Evaluation Criteria - 1•Length and complexity of written interface specification–indicate of amount of learning required by system users•Number of user tasks and the average number of actions per task–indicate of interaction time and overall system efficiency01/14/19 User Interface Evaluation Criteria - 2•Number of tasks, actions, and system states in the design model–indicate of the memory load required of system users•Interface style, help facilities, and error handling protocols–indicate of system complexity and likely degree of acceptance by the


View Full Document

U-M CIS 577 - User Interface Evaluation

Download User Interface Evaluation
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view User Interface Evaluation and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view User Interface Evaluation 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?