Observational and clinical trial findings on the comparative effectiveness of diabetes drugs showed agreement.

OBJECTIVES: This study compares an observational study of diabetes treatment effectiveness to randomized controlled trials to assess their convergent validity.

STUDY DESIGN AND SETTING: Multivariate models were developed using observational data to describe change in hemoglobin A1c (HbA1c; % unit) and weight (kilograms) after addition of a second-line oral diabetes drug to metformin monotherapy. Randomized trials of these scenarios were systematically identified. The models were used to simulate each trial, and simulated and actual results were compared by linear regression and meta-analysis.

RESULTS: Thirty-two randomized trials of second-line diabetes oral therapy were identified. For all outcomes and drugs studied, simulation and actual results correlated (P < 0.001). There were no statistically significant differences between meta-analyzed randomized and simulated results for effect on HbA1c. For effect on weight, results were qualitatively comparable, but for sulfonylureas, the simulated weight gain was nominally greater than seen in the randomized controlled trials.

CONCLUSION: An observational study of diabetes drug effectiveness showed convergent validity with randomized data. This supports cautious use of the observational research to draw conclusions about drug effectiveness in populations not studied in clinical trials. This approach may be useful in other situations where observational and randomized data need integration.