OutlineDefinitionsSlide 3Why Evaluate - the Academic listWhy Evaluate- "The Real List"Purposes of ResearchResearch Purposes - IIWays of Knowing or Establishing belief or truthScienceScientific ManagementProcess -- StepsTypes of Evaluation by Program StageTypes - By ApproachTypes- by methodEvaluation CriteriaProcess EvaluationTypes by program area/subareaTypes of ResearchExamples of Evaluation StudiesOutline•Definitions of Research/Evaluation•Purposes of Evaluation / Research•Science and Scientific Management•Research/Evaluation as Process•Types of Research / EvaluationDefinitions•Evaluation = Process of judging the merit or worth of something•Research – application of scientific methods to answer questions–controlled inquiry directed at increasing knowledge/establishing truth•Evaluation Research - combine the twoResearch EvaluationEvaluation ResearchWhy Evaluate - the Academic list•To assess merits of alternative programs•To discover whether & how well objectives are being fulfilled•To determine the reasons for successes & failures.•To uncover the principles underlying a successful program.•To refine, revise, update or track a programWhy Evaluate- "The Real List"1. Because we are required to2. To make better decisions.3. To learn from experience4. To justify programs5. To kill programsPurposes of Research•Answer management questions - applied research•For sake of knowing - pure or basic research•Answer research questions - methodological•Develop/test management alternatives - developmental research•Assess worth or merit of programs - evaluation researchResearch Purposes - II•Exploratory•Descriptive•Explanatory•PredictiveWays of Knowing or Establishing belief or truth•Tradition•Authority•Repetition/Tenacity•ScienceScience•Body of Knowledge•systematic•abstract•general•parsimonious•Method of Inquiry•logical–induction–deduction•self-corrective•empiricalScientific Management•Application of scientific principles to management and decision making–systematic information gathering–empirical, objective, self-correctiveProcess -- StepsResearch•define problem•objectives/hypotheses•literature review•research methods•gather data/analysis•conclusionsEvaluation•describe program•evaluation criteria•program scoping•evaluation methods•gather data/analysis•conclusionsTypes of Evaluationby Program Stage•formative (conceptualization/design)]•process (implementation)•summative (outcomes, impacts, efficiency)Types - By Approach•Standards–norm-based–criterion-referenced•Goals and objectives•Impacts or effectsTypes- by method•Qualitative - quantitative•Secondary data - Primary•Survey - Experiment•Internal vs external•Who - Peers, participants, superiors, subordinates, scientistsEvaluation Criteria•Effort - qnty and qlty of inputs•Performance - qnty and qlty of outputs•Adequacy - meet needs?•Efficiency - benefits/costs•Equity - distributional issues, fairnessProcess Evaluation•Identifies how and why program works–attributes –recipients–conditions–effects•single or multiple•intended or side effects•timing & duration, long/short term•cognitive, affective or behavioralTypes by program area/subarea•Emphasis: Parks, Tourism, Interp, Program Mgmt, Commercial Rec, ...•Program : lands, facilities, personnel, budget, marketing, PR, maintenance, design, policies, plansTypes of Research•Basic - Applied•Exploratory, Descriptive, Explanatory, Predictive•In-house / out- house•by discipline - sociological, psych, economics•by topic - boating, wilderness, legal, tourism, ...•by method - survey, expmt, ...Examples of Evaluation Studies•Community needs assessment•Feasibility study, SWOT analysis•Program Audits, Market audit•Cost/benefit anaysis•Impact assessment•PPBS, MBO, GPRA, CAPRA, LAC, ... •Peer review •Importance-performance
View Full Document