Eval Models - correct answer Attainment: standard; program objs/goals
Decision Making: provide context, input, processes, products to make decisions.
... [Show More]
Goal-Free: Search for all outcomes (+ & -)
Systems Analysis: cost benefits/cost effectiveness analysis to quantify effects/efficiency of program
Utilization Focused: w/ a specific pop
Reliability vs Validity - correct answer Reliability: consistency, dependability, stability of the measurement process
Validity: degree to which a test/assessment measures what it is intended to measure.
Types of Evaluation - correct answer (eval planning occurs during program planning - before implementation)
Formative Eval: Looks at ongoing process of eval from planning through implementation (eg - pilot test)
Process Eval: Combination of measures that occurs as a program is implemented to assure/improve quality of performance/delivery - reach and response
Summative Eval: Measures/judgements enable investigator to draw conclusions from impact and outcome evals
Impact Eval: Immediate/observable
Outcome Eval: Ultimate goal, product, policy. Often measured in terms of health status, morbidity, mortality
Logic Model - correct answer -purpose is to depict sequence of events that identifies program resources, matches them to needs, activates the service process, completes the service process and measures results
-Rational flow of addressing a problem and applying a process, while maintaining focus on purpose (positive change)
-Inputs-Processes-Outputs-Outcomes
Randomized Control Trials
Cohort Studies
Case/Control Comparison Studies - correct answer RCT: participants randomly placed in control receiving experiment or not receiving it
Cohort Study: Longitudinal study of cohort
Case/Control Comparison: compare pop w/ dz (case) w/ pop w/out dz (control)
Provide higher level of confidence about validity
Cross-Sectional
Observational
Anecdotal - correct answer Cross-Sectional AKA Transverse/Prevalence Study (least rigorous - non experimental design): observational study analyzing data from pop @ specific point in time
Anecdotal: collection of case studies
These studies may be more feasible - provide less expensive yet useful info
CDC Six Step Framework - correct answer 1. Engage SHs 2. Describe Program 3. Focus Eval Design 4. Gather Creditable Data 5. Justify Conclusions 6. Ensure use & share lessons learned
Standards in Evaluation - correct answer Utility
Feasibility
Propriety
Accuracy
Experimental Designs
(consists of some form of controlled trial) - correct answer Randomized Trial: all participants have equal chance of being allocated to each group
Quasi-Randomized: Allocate participation based on scheme - assigned number (even/odd)
Non-Randomized AKA Quasi-Experimental: do not use random allocation - assigned arbitrarily
In absence of experiment - might use cohort, case/control, cross sectional or ecological approach
Descriptive vs Analytic - correct answer Descriptive Studies: (Cross Sectional) - describe the occurrence of dz in terms of person, place, and time using prevalence data
Analytic Designs: (Cohort/Case-Control) - Explains etiology & causal associations aimed to estimate the strength of relationship btw exposure & outcome
Descriptive Study Designs - correct answer describes, exploratory, profiles characteristics of group, focuses on what, assumes no hypothesis, requires no comparison group
Analytical Study Designs - correct answer Explains, explanatory, analyzes why group has characteristics, focuses on why, assumes hypotheses, requires comparison group
Research Plan - correct answer findings can be generalized (unlike eval)
For quant research, must calculate same size adequate to detect statistical significance - must account for attrition (10%). Conduct small pilot prior to large scale to uncover challenges.
Conduct Search of Related Lit - correct answer Systematic Review: review published qual reviews to identify gaps [Show Less]