Attrition Bias

If you are evaluating the treatment effect of a policy or medical intervention, does it matter if some of your subjects leave the sample? In many cases, the answer is ‘yes’. The Problem As outlined in Grasdal (2001), the effect of the treatment is simply: Δ = E(Y|X, T=1) − E(Y|X, T=0) However, in some…

MEPS vs. NHEA

Many researchers use household data sources to examine a variety of hypothesis.  The use of household data has many benefits including allowing for more detailed socioeconomic information (e.g., education, income) beyond what is contained in administrative claims files.  One drawback of household data is that extrapolations made from household survey data may not match national…

Kappa Statistic

Many research studies aim to figure out if a physicians did a good job.  Many studies use administrative claims data to evaluate performance.  Other times, researchers use medical record review. One problem with medical record review is that oftentimes experts will come up with differing opinions from reviewing the same medical record.  Thus, researchers often…

Biases

All economists are familiar with the problem of selection bias.  In non-randomized samples, patients may choose to be in either the treatment or control group based on factors which are also related to the outcome of interest.  Even if researchers can design a study that fully controls for selection bias, robust studies must also account…

Quantile Regressions

Understanding quantiles is fairly intuitive. A physician would rank in the τth quantile of in terms of quality of care if he performs better than the proportion τ of the reference group of physicians and worse than the proportion (1–τ). For physicians at the median, half of physicians will perform worse than this doctor and…

Testing precision and accuracy

How does one determine if a test is accuracy?  What does accuracy mean? One measure of test precision it is the positive predictive value, or the share of positive test results which are actually positive.  Alternatively, the negative predictive value determines the share of negative test results which are true (rather than false) negatives.  Better positive and…

Determining Population Size

How do ecologists determine the size of a population?    One method is the mark and recapture (a.k.a. capture/recapture method).  This method relies on having two separate trials to capture (either physically or in data) members of certain population and determines the population size based on the proportion of specimens who are captured in both…