Combining Qualitative and Quantitative Methods in the Evaluation of Health Prevention Programs Targeting Hard-to-Reach Populations
Violeta Domínguez American Evaluation Association November 10, 2007 Baltimore, MD
EVALUATION, RESEARCH AND DEVELOPMENT UNIT Funded by the Arizona Department of Health Services
What Were the Services To Be Evaluated?
State Tobacco Control Program
Cessation Services
Quitline
Pharmacotherapy (NRT)
Community Classes
Proactive Referral Fax
Healthcare Provider Training and Certification
EVALUATION, RESEARCH AND DEVELOPMENT UNIT
The Evaluation: Levels of Analysis and Methods
Level National Medicaid State Medicaid Program Data
Coverage for some medication; and some counseling*
Method Survey
? Quantitative Approach
(Mail-out Survey)
1
Community Clinics
2
3
4
5
6
7
? ? ?
Managed Care Organizations
Healthcare Providers Clients
*”If medically necessary” and among pregnant women
Qualitative Approach
(Face-to-face Semistructured Interviews)
EVALUATION, RESEARCH AND DEVELOPMENT UNIT
Illustration: NRT Availability and Demand
Level State Medicaid Program Finding interest in partnering Method
Quantitative Approach
(Mail-out Survey)
very limited coverage; 1 2 3 4 5 6 7 Managed Care Organizations interest in partnering Healthcare Providers interest in prescribing perception of ineffectiveness; no interest in trying
Qualitative Approach
(Face-to-face Semi-structured Interviews)
Clients
EVALUATION, RESEARCH AND DEVELOPMENT UNIT
The Emerging Picture
Level State Medicaid Program Finding Direction
overall agreement
emphasis on awareness of available services emphasis on strategies for collaboration emphasis on awareness of available services strategies to address negative perceptions
interest in partnering
very limited coverage; Managed Care Organizations interest in partnering 1 2 3 4 5 6 7
Healthcare Providers
interest in prescribing
Clients
perception of ineffectiveness; no interest in trying
EVALUATION, RESEARCH AND DEVELOPMENT UNIT
Directions Taken As a Result of the Evaluation
Utilize existing outreach educational mechanisms at state Medicaid program
Brief messages in quarterly newsletter to healthcare providers and clients
Presentations at state Medicaid quarterly contractor meeting with affiliated Managed Care Organizations
Medical Directors and Maternal Child Health Care representatives
Quitline’s Outreach Referral Coordinator’s presentations at community clinics
Information about Proactive Referral Fax and services in general
EVALUATION, RESEARCH AND DEVELOPMENT UNIT