W A R Zwaans1,2,3, J A de Bruijn4, J P Dieleman5, E W Steyerberg6, M R M Scheltinga4,7, R M H Roumen4,7. 1. Department of General Surgery, Máxima Medical Centre, De Run 4600, P.O. Box 7777, 5500 MB, Veldhoven, Eindhoven, The Netherlands. willemzwaans@gmail.com. 2. SolviMáx Center of Excellence for Abdominal Wall and Groin Pain, Eindhoven, The Netherlands. willemzwaans@gmail.com. 3. NUTRIM School of Nutrition and Translational Research in Metabolism, Maastricht University Medical Centre+, Maastricht, The Netherlands. willemzwaans@gmail.com. 4. Department of General Surgery, Máxima Medical Centre, De Run 4600, P.O. Box 7777, 5500 MB, Veldhoven, Eindhoven, The Netherlands. 5. Máxima Medical Centre Academy, Máxima Medical Centre, Veldhoven, The Netherlands. 6. Department of Public Health, Erasmus Medical Center, Rotterdam, The Netherlands. 7. SolviMáx Center of Excellence for Abdominal Wall and Groin Pain, Eindhoven, The Netherlands.
Abstract
PURPOSE: To determine whether levels of pre-operative pain as recalled by a patient in the post-operative phase are possibly overestimated or underestimated compared to prospectively scored pain levels. If so, a subsequent misclassification may induce recall bias that may lead to an erroneous effect outcome. METHODS: Data of seven retrospective cohort studies on surgery for chronic abdominal wall and groin pain using three different pain scores were systematically analyzed. First, it was assessed whether retrospectively acquired pre-operative pain levels, as scored by the patient in the post-operative phase, differed from prospectively obtained pre-operative pain scores. Second, it was determined if errors associated with retrospectively obtained pain scores potentially lead to a misclassification of treatment outcome. Third, a meta-analysis established whether recall misclassifications, if present, affected overall study conclusions. RESULTS: Pain data of 313 patients undergoing remedial surgery were evaluated. The overall prevalence of misclassification due to a recall error was 13.7%. Patients not benefitting from surgery ('failures') judged their pre-operative pain level as more severe than it actually was. In contrast, patients who were pain free after remedial surgery ('successes') underestimated pre-operative pain scores. Recall misclassifications were significantly more present in failures than in successful patients (odds ratio 2.4 [95% CI 1.2-4.8]). CONCLUSION: One in seven patients undergoing remedial groin surgery is misclassified on the basis of retrospectively obtained pre-operative pain scores (success instead of failure, or vice versa). Misclassifications are relatively more present in failures after surgery. Therefore, the effect size of a therapy erroneously depends on its success rate.
PURPOSE: To determine whether levels of pre-operative pain as recalled by a patient in the post-operative phase are possibly overestimated or underestimated compared to prospectively scored pain levels. If so, a subsequent misclassification may induce recall bias that may lead to an erroneous effect outcome. METHODS: Data of seven retrospective cohort studies on surgery for chronic abdominal wall and groin pain using three different pain scores were systematically analyzed. First, it was assessed whether retrospectively acquired pre-operative pain levels, as scored by the patient in the post-operative phase, differed from prospectively obtained pre-operative pain scores. Second, it was determined if errors associated with retrospectively obtained pain scores potentially lead to a misclassification of treatment outcome. Third, a meta-analysis established whether recall misclassifications, if present, affected overall study conclusions. RESULTS: Pain data of 313 patients undergoing remedial surgery were evaluated. The overall prevalence of misclassification due to a recall error was 13.7%. Patients not benefitting from surgery ('failures') judged their pre-operative pain level as more severe than it actually was. In contrast, patients who were pain free after remedial surgery ('successes') underestimated pre-operative pain scores. Recall misclassifications were significantly more present in failures than in successful patients (odds ratio 2.4 [95% CI 1.2-4.8]). CONCLUSION: One in seven patients undergoing remedial groin surgery is misclassified on the basis of retrospectively obtained pre-operative pain scores (success instead of failure, or vice versa). Misclassifications are relatively more present in failures after surgery. Therefore, the effect size of a therapy erroneously depends on its success rate.