Cynthia Khanji1,2,3, Céline Bareil4, Eveline Hudon1,5, Johanne Goudreau1,6, Fabie Duhamel1,6, Marie-Thérèse Lussier1,5, Sylvie Perreault2,7, Gilles Lalonde8, Alain Turcotte9, Djamal Berbiche1,3, Élisabeth Martin1,3, Lise Lévesque1,3, Marie-Mireille Gagnon1,3, Lyne Lalonde1,2,3,10. 1. Primary Care Research Team, Centre de santé et de services sociaux de Laval, 1755 René-Laennec, Laval (Quebec), Canada H7M3L9. 2. Faculty of pharmacy, University of Montreal, 6128 City-Center Branch, Montreal (Quebec), Canada H3C3J7. 3. University of Montreal Hospital Research Centre (CRCHUM), 850 Saint-Denis Street, Montreal (Quebec), Canada H2X0A9. 4. HEC Montréal, University of Montreal, 6128 City-Center Branch, Montreal (Quebec), CanadaH3C3J7. 5. Faculty of medicine, University of Montreal, 6128 City-Center Branch, Montreal (Quebec), Canada H3C3J7. 6. Faculty of nursing, University of Montreal, 6128 City-Center Branch, Montreal (Quebec), Canada H3C3J7. 7. Sanofi Aventis Endowment Chair in Drug Utilization, 2905 Louis-R. Renaud Place, Laval (Quebec), Canada H7V0A3. 8. Médi-Centre Chomedey, 610 Curé-Labelle Boulevard, Laval (Quebec), CanadaH7V2T7. 9. Department of Professional Services, Centre de santé et de services sociaux du Lac-des-Deux-Montagnes, 9100 Dumouchel Street, Mirabel (Quebec), CanadaJ7N5A1. 10. Sanofi Aventis Endowment Chair in Ambulatory Pharmaceutical Care, 2905 Louis-R. Renaud Place, Laval (Quebec), Canada H7V0A3.
Abstract
OBJECTIVE: To assess a selection of psychometric properties of the TRANSIT indicators. DESIGN: Using medical records, indicators were documented retrospectively during the 14 months preceding the end of the TRANSIT study. SETTING: Primary care in Quebec, Canada. PARTICIPANTS: Indicators were documented in a random subsample (n = 123 patients) of the TRANSIT study population (n = 759). INTERVENTIONS: For every patient, the mean compliance to all indicators of a category (subscale score) and to the complete set of indicators (overall scale score) were established. To evaluate test-retest and inter-rater reliabilities, indicators were applied twice, two months apart, by the same evaluator and independently by different evaluators, respectively. To evaluate convergent validity, correlations between TRANSIT indicators, Burge et al. indicators and Institut national d'excellence en santé et en services sociaux (INESSS) indicators were examined. MAIN OUTCOME MEASURES: Test-retest reliability, inter-rater reliability, and convergent validity. RESULTS: Test-retest reliability, as measured by intraclass correlation coefficients (ICCs) was equal to 0.99 (0.99-0.99) for the overall scale score while inter-rater reliability was equal to 0.95 (0.93-0.97) for the overall scale score. Convergent validity, as measured by Pearson's correlation coefficients, was equal to 0.77 (P < 0.001) for the overall scale score when the TRANSIT indicators were compared to Burge et al. indicators and to 0.82 (P < 0.001) for the overall scale score when the TRANSIT indicators were compared to INESSS indicators. CONCLUSIONS: Reliability was excellent except for eleven indicators while convergent validity was strong except for domains related to the management of CVD risk factors.
OBJECTIVE: To assess a selection of psychometric properties of the TRANSIT indicators. DESIGN: Using medical records, indicators were documented retrospectively during the 14 months preceding the end of the TRANSIT study. SETTING: Primary care in Quebec, Canada. PARTICIPANTS: Indicators were documented in a random subsample (n = 123 patients) of the TRANSIT study population (n = 759). INTERVENTIONS: For every patient, the mean compliance to all indicators of a category (subscale score) and to the complete set of indicators (overall scale score) were established. To evaluate test-retest and inter-rater reliabilities, indicators were applied twice, two months apart, by the same evaluator and independently by different evaluators, respectively. To evaluate convergent validity, correlations between TRANSIT indicators, Burge et al. indicators and Institut national d'excellence en santé et en services sociaux (INESSS) indicators were examined. MAIN OUTCOME MEASURES: Test-retest reliability, inter-rater reliability, and convergent validity. RESULTS: Test-retest reliability, as measured by intraclass correlation coefficients (ICCs) was equal to 0.99 (0.99-0.99) for the overall scale score while inter-rater reliability was equal to 0.95 (0.93-0.97) for the overall scale score. Convergent validity, as measured by Pearson's correlation coefficients, was equal to 0.77 (P < 0.001) for the overall scale score when the TRANSIT indicators were compared to Burge et al. indicators and to 0.82 (P < 0.001) for the overall scale score when the TRANSIT indicators were compared to INESSS indicators. CONCLUSIONS: Reliability was excellent except for eleven indicators while convergent validity was strong except for domains related to the management of CVD risk factors.