Causal Effect of Managed Care on Health Care Quality: Evidence from Cancer Screening Guideline Discontinuities
Srikanth Kadiyala* Grant Miller** Harvard University
Funding: *Sloan Foundation, **NIH
Dr. Sandy MacColl [one of the founders of GHC] wrote that he and his colleagues sought a “system of family care…directed towards a goal of good care, health maintenance and preventive services”
Crowley,To serve the greatest number: A History of the GHC of Puget Sound
Managed Care
• Held Great Promise for Quality Improvements
– Lower Cost – Appropriate Use of Medical Care
• Conventional View is that it has Failed • We Contend Jury is Still Out
Previous Research
• Randomized Control Trial
– Rand HI experiment (late 1970s)
• Cross-Sectional Studies
– Selection problem since assignment to insurance type is NOT random – Control for observables – Findings Equivocal
New Empirical Strategy
Discontinuity design using age-specific preventive service guidelines
– Within plan comparisons of preventive service use across guideline thresholds difference out selection effects – Guidelines are “bright lines”-No discrete increase in cancer risk at these ages
Cancer Screenings Recommendations
• U.S Preventive Task Force (USPSTF) and American Cancer Society (ACS)
– Colorectal Cancer
• USPSTF & ACS – Both recommend screening for individuals age 40+ • No recommendation on screening technology
– Breast Cancer
• ACS-Recommended mammography for women ages 40+ since early 1980s • USPSTF-Recently switched to 40+, previously 50+ • Thus we look for changes over both the 40 and 50 year thresholds
– Prostate Cancer
• USPSTF-Does not recommend PSA • ACS-Physicians should offer PSA
• Screening is Recommended for these diseases ONLY for asymptomatic people above a certain age • IOM/ Quality Chasm report: Cancer Screenings UNDERUSED
Natural Experiment Framework
Managed Care Preguideline Post Guideline 49 FFS Preguideline Post Guideline
49
A
B
E
F
50
C
D
50
G
H
Difference-In-Difference-In-Difference = [ (D-B)-(C-A) ] – [(H-F)-(G-E)]
Regression Discontinuity
Managed Care Post Guideline 49 49 FFS Post Guideline
B
50 50
F H
D
•Diff.-In-Diff.=[(D-B)] – [(H-F)] -This assumes that [(G-E)-(C-A)] is zero, which is a plausible assumption
Data
• National Health Interview Survey(NHIS):
• National Sample of Individuals • Breast Cancer (N=6807,Years 1998-2000) • Colorectal Cancer (N=3426,Year 2000) • Prostate Cancer(N=1543,Year 2000) • Insurance Plan Types • Group/Staff Models, IPA, POS, PPO, Fee-ForService(FFS) • Rich Set of Covariates – Income, Education, Race, Region, Marital Status
• Also MarketScan Data 1997-2001(these results not reported)
Colorectal Cancer: Any Screening in Last Year by Plan and Age
40 35 30 25 20 15 10 5 0 45-47 48-49 50-51 52-54 All Group/Staff IPA FFS
NHIS Data-Year 2000
Breast Cancer: Mammogram Use in Last Year by Plan and Age
50 45 40 35 30 25 20 15 10 5 0 35-37 38-39 40-41 42-44
All Group/Staff IPA FFS
NHIS Data: 1998-2000
Breast Cancer: Mammogram Use in Last Year by Plan and Age
60 50 40 30 20 10 0 45-47 48-49 50-51 52-54 All Group/Staff IPA FFS
NHIS Data: 1998-2000
Prostate Cancer PSA Test Use in Last Year by Plan and Age 45
40 35 30 25 20 15 10 5 0 45-47 48-49 50-51 52-54
All Group/Staff IPA FFS
NHIS DATA: Year 2000
Regression Discontinuity Estimate using Colorectal Cancer: Means by Plan and Age Group Plan Ages45-49 Ages50-54 Diff.-In-Diff . Relative to FFS GHMO 2.3% 36% [+33.7%] - [12.9%] = +20.8% (N=171) (.017) (.07) IHMO (N=1369) 12% (.014) 21% (.018) [+9%] – [+12.9%] = - 3.9%
PPO (N=745)
FFS (N=619) POS (N=520)
11% (.018)
8.8% (.017) 13.6% (.029)
22% (.022)
21.7% (.027) 17% (.027)
[+11%] – [+12.9] = -1.9%
+12.9% [+3.4%] – [+12.9] = +9.5%
Regression Estimates of Screening Use
Plan
GHMO IHMO
Colorectal
-.092(.027) -.008(.021)
Mam.(35-44)
-.086(.042) -.055(.021)
Mam.(45-54) PSA
.05(.05) .069(.026) -.079(.07) -.054(.036)
PPO
POS
-.021(.023)
.001(.032)
-.06 (.024)
-.039(.027) .124(.065) .087(.026) .103(.03) .078(.037) 6807
.034(.030)
.017(.034) -.012(.07) -.014(.03) .001(.036) .025(.045) 5629
-.01(.044)
-.038(.047) .07(.11) -.007(.048) .075(.065) -.011(.07) 1543
GHMO*AGRP .24(.075) IHMO*AGRP PPO*AGRP POS*AGRP N .022(.029) .035(.033) -.032(.04) 3426
Standard Errors in parantheses. Bold indicates point estimate is significant at the 5% level. Italics means significant at the 10% level. Regression models adjust for age,sex,race, education, income,marital status, region and time where appropriate.
Results from Cross-Section Regressions
Plan GHMO IHMO PPO POS N Colorectal .019 (.04) .003 (.02) -.005 (.02) -.012 (.027) 3426 Mam (35-44) -.02 (.036) -.009 (.02) -.006 (.02) .003 (.02) 6807
Standard Errors in parantheses. Bold indicates point estimate is significant at the 5% level. Regression models adjust for age,sex,race, education, income,marital status, region and time where appropriate.
Interpretation of Results
• Change in Use across Age thresholds generally larger in Managed Care Plans
– Large statistically significant differences for Colorectal and Breast Cancer screenings – No Statistically Significant differences for Prostate Cancer Screening – Strongest Results for the Group/Staff Managed Care Models
Supply or Demand
• Survey data indicates individuals don’t know the right age cutoffs • We know whether people were offered screening services in the 2000 NHIS data
– Using the same framework as above we find large statistically significant changes in Offer rates across the relevant age thresholds
• This indicates that supply side responses drive changes in use over the age thresholds.
Future Work
• How does Managed Care do it?
– Plan Characteristics
• Health Effects • Other treatments with Age Thresholds
– Ex. Cholesterol Screening
sammyc2007 4/14/2008 |
24 |
0 |
0 |
educational
sammyc2007 4/11/2008 |
13 |
0 |
0 |
educational
sammyc2007 4/12/2008 |
20 |
0 |
0 |
educational
sammyc2007 3/24/2008 |
296 |
29 |
0 |
educational
sammyc2007 4/11/2008 |
53 |
1 |
0 |
educational
sammyc2007 3/24/2008 |
379 |
22 |
0 |
educational
sammyc2007 4/11/2008 |
19 |
0 |
0 |
educational
sammyc2007 4/11/2008 |
16 |
0 |
0 |
educational
sammyc2007 4/15/2008 |
18 |
0 |
0 |
educational
sammyc2007 4/9/2008 |
21 |
0 |
0 |
educational
sammyc2007 4/11/2008 |
17 |
0 |
0 |
educational
sammyc2007 4/11/2008 |
17 |
0 |
0 |
educational
sammyc2007 4/11/2008 |
14 |
0 |
0 |
educational
sammyc2007 6/13/2008 |
180 |
4 |
0 |
legal
sammyc2007 6/13/2008 |
166 |
0 |
0 |
legal
sammyc2007 6/13/2008 |
213 |
4 |
0 |
legal
sammyc2007 6/13/2008 |
200 |
2 |
0 |
legal
sammyc2007 6/13/2008 |
352 |
2 |
0 |
legal
sammyc2007 6/13/2008 |
272 |
0 |
0 |
legal
sammyc2007 6/13/2008 |
184 |
0 |
0 |
legal
sammyc2007 6/13/2008 |
151 |
0 |
0 |
legal
sammyc2007 6/13/2008 |
272 |
0 |
0 |
legal
sammyc2007 6/13/2008 |
221 |
0 |
0 |
legal