1How to understand and use National Ambulatory Medical Care Survey (NAMCS) and National Hospital Ambulatory Medical Care Survey (NHAMCS) data for clinical researchYuwei Zhu10-29-2004Dept of Biostatistics2OverviewI. Survey Background II. Survey Methodology III. Technical ConsiderationsIV. Getting the Data –Using Raw Data FilesV. ExampleVI. Data Analysis –SAS, STATA, SUDAANVII. Other Public Domain Data3Performed by:Centers for Disease Control and Prevention (CDC)National Center for Health Statistics, Division of Health Care Statistics, and National Health Care SurveyNAMCS and NHAMCS4National Ambulatory Medical Care Survey (NAMCS) HistorySurvey began in 1973 Annual data collection through 1981Conducted in 1985 Annual began again in 1989 5NAMCSClassified by the American Medical Association and the American Osteopathic Association as delivering “office-based, patient care” Healthcare providers within private, non–hospital-based clinics and health maintenance organizations (HMOs) are within the scope of the survey6NAMCSPatient visits made to the offices of non–federally employed physicians –Excluding:AnesthesiologyRadiologyPathology7In-Scope NAMCS locationsFreestanding clinicFederally qualified health centerNeighborhood and mental health centersNon-federal government clinicFamily planning clinicHMOFaculty practice planPrivate solo or group practice8Out-of-Scope NAMCS locationsHospital EDs and OPDsAmbulatory surgicenterInstitutional setting (schools, prisons)Industrial outpatient facilityFederal Government operated clinicLaser vision surgery9NAMCSNAMCS uses a multistage probability sample design to obtain –Primary sampling units (PSUs)–Physician practices within the PSUs–Patient visits within physician practices 10Sample design -NAMCS112 PSUs (counties)–Counties–Groups of counties–County equivalents (such as parishes or independent cities)–Towns–TownshipsNonfederally employed, office-based physicians stratified by specialty, 3,000 physiciansAbout 30 visits per doctor over a randomly selected 1-week period, 25,000 visits11National Hospital Ambulatory Medical Care Survey (NHAMCS) HistorySurvey began in 1992 Annual data collection12National sample of visits to the EDs and outpatient departments of noninstitutional general and short-stay hospitals in the United StatesExcluded hospitals:–Federal–Military–Veterans AdministrationNHAMCS13NHAMCSThis survey uses a 4-stage probability design with samples–geographically defined areas–hospitals within these areas–clinics within the hospital–patient visits within clinics.The first stage is similar to NAMCS14Sample design -NHAMCS112 PSUs (counties)Panel of 600 non-Federal, general or short stay hospitalsClinics (OPDs) and emergency service areas (EDs), 400 EDs and 250 OPDsAbout 200 visits per OPD, 100 per ED over random 4-week period,37,000 ED and 35,000 OPD visits15NHAMCS ScopeOPD was intended to be parallel to the NAMCS in the hospital settingGeneral medicine, surgery, pediatrics, ob/gyn, substance abuse, and “other” clinics are in-scopeAncillary services are out of scope16Data ItemsPatient characteristics –Age, sex, race, ethnicityVisit characteristics–Source of payment, continuity of care, reason for visit, diagnosis, treatmentProvider characteristics–Physician specialty, hospital ownership…Drug characteristics added in 1980–Class, composition, control status, etc.17Repeating fields (from text entries)Up to 3 fields each…–Reason for visit –Physician’s diagnosis–Cause of injuryDiagnostic services (6 fields)Surgical procedures (2 fields)Medications (6 fields)–Drug ingredients (5 fields)–Therapeutic class (3 fields –2002 on)18Coding Systems UsedReason for Visit Classification (NCHS)ICD-9-CM for diagnoses, causes of injury and proceduresDrug Classification System (NCHS)National Drug Code Directory19Drug Data in NAMCS/NHAMCSWhat is a “Drug Mention” ?Any of up to 6 medications that were ordered, supplied, administered, or continued during the visit. Respondents are asked to report trade names or generic names only (not dosage, administration, or regimen). 20Drug CharacteristicsGeneric Name (for single ingredient drugs)Prescription StatusComposition StatusControlled Substance StatusUp to 3 NDC Therapeutic Classes (4-digit)Up to 5 Ingredients (for multiple ingredient drugs)21Some User ConsiderationsNAMCS/NHAMCS sample visits, not patientsNo estimates of incidence or prevalenceNo state-level estimatesNot sampled by setting or by non-physician providersMay capture different types of care for solo vs. group practice physicians22Data usesUnderstand health care practiceExamine the quality of careTrack certain conditionsFind health disparitiesMeasure Healthy People 2010 objectivesServe as benchmark for states23Data usersOver 100 journal publications in last 2 yearsMedical associationsGovernment agenciesHealth services researchersUniversity and medical schoolsBroadcast and print media24Sample WeightEach NAMCS record contains a single weight, which we call Patient Visit WeightSame is true for OPD records and ED recordsThis weight is used for both visits and drug mentions25Reliability of EstimatesEstimates should be based on at least 30 sample records ANDEstimates with a relative standard error (standard error divided by the estimate) greater than 30 percent are considered unreliable by NCHS standardsBoth conditions should be met to obtain reliable estimates26How Good are the Estimates?Depends on what you are looking at. In general, OPD estimates tend to be somewhat less reliable than NAMCS and ED. Since 1999, Advance Data reports include standard errors in every table so it is easy to compute confidence intervals around the estimates.27Sampling ErrorNAMCS and NHAMCS are not simple random samplesClustering effects of visits within the physician’s practice, physician practices within PSUs, clinics within hospitalsMust use some method to calculate standard errors for frequencies, percents, and rates28Ways to Improve Reliability of EstimatesCombine NAMCS, ED and OPD data to produce ambulatory care visit estimatesCombine multiple years of dataAggregate categories of interest into broader groups.29NAMCS vs. NHAMCSConsider what types of settings are best for a particular analysis–Persons of color are more likely to visit OPD's and ED's than physician offices–Persons in some age groups make disproportionately larger shares of visits to ED's than offices and OPD's30File StructureDownload data and layout from websitehttp://www.cdc.gov/nchs/about/major/ahcd/ahcd1.htmFlat ASCII files for each setting and yearNAMCS: 1973-2002NHAMCS: 1992-200231Trend considerationsVariables routinely rotate on and off surveyBe careful about trending diagnosis prior to 1979 because of ICDA (based on ICD-8)Even after 1980-be careful about changes in ICD-9-CMNumber of medications varies over years1980-81 –8 medications1985, 1989-94 –5 medications1995-2002 –6 medications2003+ –8 medicationsDiagnostic & therapeutic checkboxes varyUse spreadsheet for significance of trends 32Example Hypothesis --Educational Efforts Targeted at Judicious Antibiotic Use Will Reduce Prescription Rates in all Treatment Settings33Study DesignRetrospective collection of data from–NAMCS –NHAMCS1994-2000 study yearsAntibiotic prescribing patterns and diagnosesChildren <5 years of ageClinic type --PediatricPhysician type –Pediatrician or Family Medicine34Data StratificationRace –White, Black and otherTime period –94 & 95, 96 & 97, 98 & 00Antibiotics –Penicillin's, Cephalosporins, Erythromycin/lincosamide/macrolides,Tetracyclines, Chloramphenicol derivatives, Aminoglycosides, Sulfonamides and trimethoprim, Miscellaneous antibacterial agents, and Quinolone/derivativesDiagnoses --Otitis media, Sinusitis, Pharyngitis,Bronchitis,Upper respiratory tract infection (URI)35Overall Antibiotic Rates in Children <5 Based on Source of Care05001000150020001994199519961997199819992000YearsRates per 1000 childrenHospital-based ED Office-based 36Total CareYearsWhite BlackRate Ratio95% CI Visit rates per 1000 children aged <5 years1994-1995415031021.341.22, 1.47*1996-1997452943201.051.02, 1.08*1998-2000420443020.980.70, 1.34370%20%40%60%80%100%1994-19951996-19981999-20001994-19951996-19981999-2000Years% Distribution health care visit siteHospital-based ED Office-based White childrenBlack Children38Total CareYearsWhite BlackRate Ratio95% CI Antibiotic prescription rates per 1000 children aged <5 years1994-199514949981.501.48, 1.51*1996-1997142113201.080.96, 1.221998-2000111810741.040.86, 1.2439Total CareYearsWhite BlackRate Ratio95% CI Otitis media rates per 1000 children aged <5 years1994-19958165201.571.46, 1.69*1996-19977797391.061.04, 1.07*1998-20006306031.050.69, 1.5840ResultsDecline in antibiotic prescribing in children <5 years; most notable in office-based and emergency department settings Penicillin's were common antibiotics usedMost common diagnosis in all three settings was otitis mediaNatasha B. Halasa, Marie R. Griffin, Yuwei Zhu, and Kathryn M. Edwards. Difference in antibiotic prescribing patterns for children aged less than five years in the three major outpatient settings, Journal of Pediatrics. 2004; 144:200-20541Code to create design variables: survey years 2001 & earlier CPSUM=PSUM;CSTRATM = STRATM;IF CPSUM IN(1, 2, 3, 4) THEN DO;CPSUM = PROVIDER +100000;CSTRATM = (STRATM*100000) +(1000*(MOD(YEAR,100))) + (SUBFILE*100) + PROSTRAT;END;ELSE CSTRATM = (STRATM*100000);42proccrosstabdata=test1 design=WOR filetype=sas;Nest stratm psum subfile prostrat year provider dept su clinic/missunit;Totcnt poppsum _zero_ _zero_ _zero_ popprovm _zero_ popsum _zero_ popvism;Weight patwt;Tables sex*ager;run;SUDAAN version 8.0.2 example43proccrosstabdata=test1 filetype=sas;Nest stratm psum ;Weight patwt;Tables sex*ager;run;SUDAAN version 8.0.2 example44Use http://***/test1svyset [pweight=patwt], strata(cstratm) psu(cpsum)svytab sex agersvymean ageSTATA version 8. example45procsurveyfreqdata=test1;tables sex*ager;strata cstratm;cluster cpsum;weight patwt;run;SAS version 9.1 example46Some considerations: SUDAAN vs. SAS Proc SurveymeansSUDAANPROC Surveymeans•design variables=cstratm, cpsum (1-stage design)•design variables=cstratm, cpsum (1-stage design)•nest=cstratm, cpsum•strata cstratm •cluster cpsum•Sort by design variables•Sort not needed•Weight data: Patwt•Weight data: Patwt•Subgroup=identify categorical variables•Class=identify categorical variables•Tables=analysis variables•Var=analysis variables47If nothing else, remember…The Public Use Data File Documentation is YOUR FRIEND!Each booklet includes:–A description of the survey–Record format–Marginal data (summaries)–Various definitions–Reason for Visit classification codes–Medication & generic names–Therapeutic classes48Other Public Domain Data CDC WONDER --http://wonder.cdc.gov/National Center for Health Statistics --http://www.cdc.gov/nchs/National Health and Nutrition Examination Survey (NHANES) --http://www.cdc.gov/nchs/nhanes.htmNational Health Interview Survey (NHIS) --http://www.cdc.gov/nchs/nhis.htmNational Survey of Family Growth (NSFG) --http://www.cdc.gov/nchs/nsfg.htmCensus --http://www.census.gov/49Other Public Domain Data (cont.)Dept. of Health, TN http://hitspot.state.tn.us/hitspot/hit/main/SPOT/frames/SPOT/index.htm 50Thanks Natasha HalashaSusan Schappert -National Center for Health StatisticsLinda McCaig & David Woodwell -National Center for Health Statistics51Questions?