DOC PREVIEW
UT INF 385P - Some Usability Engineering Methods

This preview shows page 1-2-3-21-22-23-42-43-44 out of 44 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 44 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

Some Usability Engineering MethodsFirst . . .Remember . . .The Methods of Usability Engineering . . .One big problemThree Methods to address costEnd-user TestingEUT - BenefitsEUT - LimitationsEUT -- What to test?Rubin’s 4 TypesSet upWhat materials?Conduct the TestAfter the TestAh, but REMOTEWhat is a Heuristic Evaluation?Problems IdentifiedStrengths of an HEWeaknesses of an HETypical MethodologyHeuristics UsedSeverity Levels UsedSample Summary of ResultsNielsen’s Usability Heuristics Nielsen’s Heuristics (cont’d.)How to . . .Other HeuristicsWelcome . . .Usability WalkthroughsContextKey CharacteristicsPlease note . . .This is a test of the DESIGN!And so . . .The Flow of the DayThe Flow (cont’d.)Yet more flow . . .BenefitsLimitationsAny questions?OK, first task:Which, Why, When?Next WeekR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] Usability Engineering MethodsRandolph BiasWeek 7R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] . . .• Let’s talk about your projects.R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] . . . Our approach, within usability engineering of web sites and other user interfaces, is:• Empirical• Iterative• User-Centered DesignR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] Methods of Usability Engineering . . .• Are employed in order to enable you to bring user data (empiricism) to bear on the emerging product design.• You (the usability engineer) become an advocate for the user, in the product development process.R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] big problem•CostR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] Methods to address cost• Remote End-user testing (lab testing) • Heuristic Evaluations• Usability WalkthroughsToday let’s talk about WHY and WHEN we employ one method or another, and HOW to carry them out.R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] Testing• Also called “lab testing”• Can be done on paper-and-pencil design, prototype, early code, existing productR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] - Benefits• Gather performance and satisfaction data– Performance data: time on task, error rates, # calls to the help desk, # references to the documentation, . . . .– Satisfaction data: End-of-test questionnaire• Can be find-and-fix or benchmarking• Ensure coverage of certain parts of the UI -- good controlR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] - Limitations• Artificial situation• Successful test doesn’t “prove” the product works• Need representative users!• Ease of learning vs. ease of use• Hard to test longitudinallyR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] -- What to test?• Can rarely cover all the UI.• I like to test:– critical tasks– frequent tasks– nettlesome tasksR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected]’s 4 Types• Exploratory (working on the “skeleton”)• Assessment test (working on the “meat and flesh” of the UI)• Validation test (does it meet the objectives?)• Comparison test (compare two competing designs)– Rubin, J. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. Wiley: New York, NY, 1994.R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] up• Create environment (ambient setting, HW, SW)• Identify participants• Establish test roles (test monitor/administrator, data logger, timer, video operator, product experts (SMEs), other observers)• Create test plan• Prepare observers• Prepare test materialsR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] materials?• Instructions•NDA• Permission to videotape• Test scenarios• Questionnaire(s)R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] the Test• Welcome the test participant• Communicate that this is not a test of THEM, and they can leave any time• The scenarios should match the real world setting• Ask the test participants to “think aloud” to better understand intent• Offer post-test questionnaire, and debriefR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] the Test• Quick data to product team• Assign severities and build recommendations• Build archival report• Serve as change agents!R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected], but REMOTE• Saves tons of travel money• Allows you to get otherwise hard-to-get test participants.• Allows them to be in their own environments.• Might allow product designers/developers to watch from their own office.• But . . . lose some fidelity of the test environment (video?)• Some added set-up cost (time)R. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] is a Heuristic Evaluation?Evaluators systematically inspect the application interface to check for compliance with recognized usability guidelines (heuristics). (Thus, an INSPECTION method.)- Identifies major and minor usability problems- Conducted by three to five experienced usability engineers (or one!)- Problems are reported along with the heuristic it violatesR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] IdentifiedThe probability of one evaluator finding . . .– A major usability problem - 42% * – A minor usability problem - 32%More evaluators = more problems identified*from www.useit.comR. G. Bias | School of Information | SZB 562B | Phone: 512 471 7046 | [email protected] of an HE-Done by people experienced in usability not just “dumb” users-Can


View Full Document

UT INF 385P - Some Usability Engineering Methods

Download Some Usability Engineering Methods
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Some Usability Engineering Methods and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Some Usability Engineering Methods 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?