Unformatted text preview:

CONDUCTING SURVEYSConstruct diagram: TheoryConstruct diagram: MeasuresConstruct diagram: Survey instrumentsConstruct diagram: AnalysisValidationIRB approvalPre-testing instrumentsDillman’s methodData coding and entryAnalysisCommon trapsQUESTIONS ?S N R EUniversity of MichiganCONDUCTING SURVEYSNRE 7012Construct diagram: TheoryConcern forRiver QualityWillingnessto join riverclean-up daysDependent VariablesIndependent VariablesCONSTRUCTSTheory levelNRE 7013Construct diagram: MeasuresConcern forRiver QualityItems assessingtypes of concernWillingnessto join riverclean-up daysItems measuringwillingness to joinNumber of timesattending clean-upDependent VariablesIndependent VariablesCONSTRUCTSTheory levelMEASURESEmpirical levelNRE 7014Construct diagram: Survey instrumentsConcern forRiver QualityItems assessingtypes of concernWillingnessto join riverclean-up daysItems measuringwillingness to joinNumber of timesattending clean-upDependent VariablesIndependent VariablesCONSTRUCTSTheory levelMEASURESEmpirical levelSURVEY INSTRUMENT, INTERVIEW PROTOCOL, OBSERVATION PLAN, ETC.NRE 7015Construct diagram: AnalysisConcern forRiver QualityItems assessingtypes of concernWillingnessto join riverclean-up daysItems measuringwillingness to joinNumber of timesattending clean-upDependent VariablesIndependent VariablesCONSTRUCTSTheory levelMEASURESEmpirical levelConstruct validationStatistics: Accounting for varianceTheoryStatistics: Data reductionNRE 7016Validation•CONSTRUCT VALIDITY – Establishing that your instrument measures what you claim it measures.•INTERNAL VALIDITY – the extent to which a study establishes that a variable has actually caused the effect reported.•EXTERNAL VALIDITY – the degree to which findings can be generalized from the specific sample or site to some target population or location.NRE 641 – Fall termNRE 7017IRB approvalwww.irb.research.umich.eduNRE 7018Pre-testing instruments•FormalFormal–Sample from populationSample from population–Analyze data for mean, variance, relationshipsAnalyze data for mean, variance, relationships•InformalInformal–Opportunistic sampleOpportunistic sample–Test order of questions, their wordingTest order of questions, their wording–Test length of instrumentTest length of instrument–Rarely do data analysisRarely do data analysisALWAYS PRE-TEST INSTRUMENTSNRE 7019Dillman’s methodDillman's method is generally regarding as the standard for mail survey's in the social sciences. •PRE-NOTIFICATION (by letter or postcard) –Notification that the survey is coming; statement about the purpose of the survey–Emphasize importance of participation.•FIRST SURVEY MAILING (one week later, includes cover letter)–This is a useful study, and you are important to its success.–Promise of confidentiality.–Thank you for filling out the survey.–Consider giving a deadline and offering a copy of the results.–Consider personalization.–Return envelope (self-addressed and stamped).•REMINDER (one week after first survey mailing by letter or postcard)–Tie with previous letter (We recently sent you a survey…).–Thank you if they have already filled out the survey.–Re-emphasize the why recipient is important.–Another questionnaire is coming if first was lost or provide a way to get a replacement.•SECOND SURVEY MAILING (two weeks after reminder) –Send only to non-respondents.–Include all previous items (this study is important, etc.).–We understand you are busy…•FINAL CONTACT–Thank you if you have already returned the survey, Last chance to participate in this important project.–Dillman recommends sending this certified mail, very expensive. –Other options include a third mailing of the survey, a postcard, or telephone calls.•HINTS–Do mailings early in the week – Dillman recommends Tuesday.–Avoid mailings over holidays.–It is very time consuming, especially with paper surveys, so plan ahead.–With paper surveys it is very expensive.NRE 70110Data coding and entry•Create coding sheet from blank survey Create coding sheet from blank survey instrument, interview protocol, etc.instrument, interview protocol, etc.•Enter data directly into SPSS, SAS, etc.Enter data directly into SPSS, SAS, etc.•Use descriptive statistics to check & fix dataUse descriptive statistics to check & fix data•Use Word file for open ended questionsUse Word file for open ended questionsNRE 70111AnalysisQUALITATIVE ANALYSIS–Read and extract meaning, and/or–Code into pre-determined categories, and/or–Content analysisQUANTITATIVE ANALYSIS•Initial descriptive statistics•Data reduction – create categories–Cluster analysis–Factor analysis–Multi-dimensional scaling, etc.•Investigate categories–Descriptive statistics–Cross-tabs using background variables•Accounting for variance–ANOVA–Regression–Structural equation modelingGenerate a reportGenerate a write-up andINCLUDE PARTS IN THESISGenerate a write-up andINCLUDE PARTS IN THESISGenerate a write-up andMAY INCLUDE PARTS IN THESISNRE 70112Common traps•Not having a constructs & measures diagramNot having a constructs & measures diagram•Ignoring internal, external and construct validityIgnoring internal, external and construct validity•Focusing on instrument format instead of Focusing on instrument format instead of contentcontent•Ignoring instrument format altogetherIgnoring instrument format altogether•Underestimating difficulty of getting sample Underestimating difficulty of getting sample mailing addresses, telephone numbers, etc.mailing addresses, telephone numbers, etc.•Getting greedy – collecting too much dataGetting greedy – collecting too much data•Not getting help (e.g., CSCAR, ICPSR, SRC)Not getting help (e.g., CSCAR, ICPSR, SRC)www.snre.umich.edu/nre701QUESTIONS


View Full Document

U-M NRE 701 - Lecture Note

Documents in this Course
Thesis

Thesis

17 pages

Load more
Download Lecture Note
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Lecture Note and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Lecture Note 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?