Questions?• Project #4•HW #7– Extended by one week;– HW #8 cancelled;ExampleInterviews•Method– Pick the right population• Individual or group discussion– Be prepared• Plan a set of central questions– Probe more deeply on interesting issues as they arise• Focus on goals not technology• Find the root of the problem• Pros and cons– Very good at directing next design phase• Provide many constructive suggestions– Subjective• Do not ask leading questions– Time consumingQuestionnaires and surveys I•Method– Pick the population• Demographics and sample size– Between 50 and 1000 subject– Establish the purpose of the questionnaire• What information is sought?• How would you analyze the results?– Establish the means of deliver/collection• On-line• Direct interaction with users– Walking in the street– Post-user testing• Surface mail– including a pre-addressed reply envelope gives far better responseQuestionnaires and surveys II•Method– Design the questionnaire• Don’t forget to debug it!– Deliver– Collect and analyze the data– Establish the main findingsClosed questions• Supply possible answersCharacters on the computer screen are:hard to read easy to read1 2 3 4 5– Easy to analyze– Make it more difficult for respondentsStyle of closed question: ScalarCharacters on the computer screen are:hard to read easy to read1 2 3 4 5– Be sure to pick odd numbers of choice• Often between 5 and 7Style of closed question: Multi-choiceWhich types of software have you used? (tick all that apply)O word processorO data baseO spreadsheetO compiler– Can be exclusive on inclusive– Be sure to be specificDo you use computers at work: O often O sometimes O rarelyvsDo you use computers at work:O more than 4 hrs O between 1 and 4 hrs O less that 1 hrsStyle of closed question: Ranked choiceRank the usefulness of these methods of issuing a command(1 most useful, 2 next most useful..., 0 if not used)__2__ command line__1__ menu selection__3__ control key accelerator– Helpful to understand users preferenceOpen ended questions• The user answers in his/her own wordsCan you suggest any improvements to the interfaces?– Good for general information– Difficult to analyze• Need for a coder– Can complement closed questionsQuestionnaires and surveys• Pros and cons– Preparation is expensive• Need to design and debug the questionnaire– Can reach a large population• But often a low return rate– As good as the questions asked– Data collection can be tedious• Use automatic forms for large volumeQualitative approaches outcome• High level effects– Task flow problems– Task description problems– Contextual findings• Conflict with social pattern,…• Two hands needed but only one available• Pros and Cons– Apply to a real situation • Good external validity– Difficult to generalize• Poor control of independent variables– Often subjective dataPSP Questionnaire• Population?• Distribution?• Your main survey goal?– At most 10
View Full Document
Unlocking...