| Literature DB >> 35652032 |
Camila Oda Yamazato1, Gustavo Ribeiro2, Fabio Chaud de Paula3, Ramon Oliveira Soares3, Paulo Santa Cruz4, Michel Kanas4.
Abstract
Objective The present study aims to determine the intra- and inter-rater reliability and reproducibility of the Roussouly classification for lumbar lordosis types. Methods A database of 104 panoramic, lateral radiographs of the spine of male individuals aged between 18 and 40 years old was used. Six examiners with different expertise levels measured spinopelvic angles and classified lordosis types according to the Roussouly classification using the Surgimap software (Nemaris Inc., New York, NY, USA). After a 1-month interval, the measurements were repeated, and the intra- and inter-rater agreement were calculated using the Fleiss Kappa test. Results The study revealed positive evidence regarding the reproducibility of the Roussouly classification, with reasonable to virtually perfect (0.307-0.827) intra-rater agreement, and moderate (0.43) to reasonable (0.369) inter-rater agreement according to the Fleiss kappa test. The most experienced examiners showed greater inter-rater agreement, ranging from substantial (0.619) to moderate (0.439). Conclusion The Roussouly classification demonstrated good reliability and reproducibility, with intra- and inter-rater agreements at least reasonable, and reaching substantial to virtually perfect levels in some situations. Evaluators with highest expertise levels showed greater intra and inter-rater agreement. Sociedade Brasileira de Ortopedia e Traumatologia. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commecial purposes, or adapted, remixed, transformed or built upon. ( https://creativecommons.org/licenses/by-nc-nd/4.0/ ).Entities:
Keywords: lordosis/classification; postural balance; spinal curvatures
Year: 2021 PMID: 35652032 PMCID: PMC9142261 DOI: 10.1055/s-0041-1729581
Source DB: PubMed Journal: Rev Bras Ortop (Sao Paulo) ISSN: 0102-3616
Fig. 1Example of spinopelvic angles and vertical sagittal axis measurement using the Surgimap software.
Fig. 2Lumbar lordosis classification according to Roussouly et al. Type 1: The sacral tilt (ST) is < 35°, and the apex of lumbar lordosis is located at the center of the L5 vertebral body. Type 2: The ST is < 35°, and the apex of lumbar lordosis is located at the base of the L4 vertebral body. Type 3: The ST ranges from 35° to 45°. Type 4: The ST is > 45°. (adapted from Roussouly et al. 15 ).
Kappa coefficient classification according to Landis et al. 17
| Kappa coefficient | Strength of agreement |
|---|---|
| < 0.00 | Poor |
| 0.00–0.20 | Weak |
| 0.21–0.40 | Reasonable |
| 0.41–0.60 | Moderate |
| 0.61–0.80 | Substantial |
| 0.81–1.00 | Virtually perfect |
Frequency distribution of the Roussouly classification
| Measurement | Evaluator | Lumbar lordosis type according to the Roussouly classification | |||
|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | ||
| Measurement 1 | A1 | 9 (9%) | 11 (11%) | 59 (57%) | 25 (24%) |
| A2 | 7 (7%) | 12 (12%) | 57 (55%) | 28 (27%) | |
| B1 | 14 (13%) | 10 (10%) | 23 (22%) | 57 (55%) | |
| B2 | 8 (8%) | 8 (8%) | 57 (55%) | 31 (30%) | |
| C1 | 7 (7%) | 8 (8%) | 58 (56%) | 31 (30%) | |
| C2 | 7 (7%) | 10 (10%) | 59 (57%) | 28 (27%) | |
| Measurement 2 | A1 | 6 (6%) | 9 (9%) | 64 (62%) | 25 (24%) |
| A2 | 10 (10%) | 9 (9%) | 57 (55%) | 28 (27%) | |
| B1 | 19 (18%) | 8 (8%) | 30 (29%) | 47 (45%) | |
| B2 | 10 (10%) | 5 (5%) | 57 (55%) | 32 (31%) | |
| C1 | 3 (3%) | 8 (8%) | 61 (59%) | 32 (31%) | |
| C2 | 6 (6%) | 14 (13%) | 62 (60%) | 22 (21%) | |
Evaluators according to expertise: A, spine surgeons; B, spine surgery residents; C, orthopedics and traumatology residents.
Fig. 3Fleiss kappa coefficient for intra-rater agreement.
Fleiss kappa coefficients from Figure 1 with confidence intervals and p-values
| Evaluator | Fleiss kappa coefficients | 95%CI |
|
|---|---|---|---|
| A1 | 0.601 | (0.462–0.740) | < 0.001* |
| A2 | 0.827 | (0.738–0.915) | < 0.001* |
| B1 | 0.307 | (0.163–0.452) | < 0.001* |
| B2 | 0.710 | (0.586–0.833) | < 0.001* |
| C1 | 0.580 | (0.440–0.720) | < 0.001* |
| C2 | 0.557 | (0.407–0.708) | < 0.001* |
Abbreviation: CI, confidence interval.
Agreement was significant in all cases at a 5% significance levels ( p < 0.001).
Fleiss kappa test for inter-rater agreement
| Evaluator | Fleiss kappa coefficients | 95%CI |
|
|---|---|---|---|
| Measurement 1 | 0.430 | (0.344–0.516) | < 0.001 |
| Measurement 2 | 0.369 | (0.288–0.451) | < 0.001 |
Fleiss kappa test for inter-rater agreement (peer to peer)
| Measurement | Evaluator | A1 | A2 | B1 | B2 | C1 | C2 |
|---|---|---|---|---|---|---|---|
| Measurement 1 | A1 | 1.000 | |||||
| A2 | 0.619 | 1.000 | |||||
| B1 | 0.192 | 0.261 | 1.000 | ||||
| B2 | 0.488 | 0.412 | 0.236 | 1.000 | |||
| C1 | 0.565 | 0.583 | 0.218 | 0.434 | 1.000 | ||
| C2 | 0.597 | 0.584 | 0.196 | 0.516 | 0.496 | 1.000 | |
| Measurement 2 | A1 | 1.000 | |||||
| A2 | 0.439 | 1.000 | |||||
| B1 | 0.222 | 0.138 | 1.000 | ||||
| B2 | 0.483 | 0.458 | 0.283 | 1.000 | |||
| C1 | 0.515 | 0.539 | 0.168 | 0.449 | 1.000 | ||
| C2 | 0.440 | 0.404 | 0.166 | 0.496 | 0.325 | 1.000 |
Fig. 1Exemplo de aferição dos ângulos espinopélvicos e eixo vertical sagital (EVS), com o uso do software Surgimap.
Fig. 2Classificação dos tipos de lordose lombar de acordo com Roussouly et al. Tipo 1 : A inclinação sacral (IS) é < 35°, o ápice da lordose lombar está localizado no centro do corpo vertebral L5. Tipo 2 : A IS é < 35°, o ápice da lordose lombar está localizado na base do corpo vertebral L4. Tipo 3: A IS é entre 35° e 45°. Tipo 4: A IS é > 45°. (Adaptado de Roussouly et al. 15 )
Classificação do coeficiente Kappa de acordo com Landis et al. 17
| Kappa | Força de concordância |
|---|---|
| < 0,00 | Pobre |
| 0,00–0,20 | Fraca |
| 0,21–0,40 | Razoável |
| 0,41–0,60 | Moderada |
| 0,61–0,80 | Substancial |
| 0,81–1,00 | Quase perfeita |
Distribuição de frequências da classificação de Roussouly
| Aferição | Avaliador | Tipo de lordose lombar segundo a Classificação de Roussouly | |||
|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | ||
| Aferição 1 | A1 | 9 (9%) | 11 (11%) | 59 (57%) | 25 (24%) |
| A2 | 7 (7%) | 12 (12%) | 57 (55%) | 28 (27%) | |
| B1 | 14 (13%) | 10 (10%) | 23 (22%) | 57 (55%) | |
| B2 | 8 (8%) | 8 (8%) | 57 (55%) | 31 (30%) | |
| C1 | 7 (7%) | 8 (8%) | 58 (56%) | 31 (30%) | |
| C2 | 7 (7%) | 10 (10%) | 59 (57%) | 28 (27%) | |
| Aferição 2 | A1 | 6 (6%) | 9 (9%) | 64 (62%) | 25 (24%) |
| A2 | 10 (10%) | 9 (9%) | 57 (55%) | 28 (27%) | |
| B1 | 19 (18%) | 8 (8%) | 30 (29%) | 47 (45%) | |
| B2 | 10 (10%) | 5 (5%) | 57 (55%) | 32 (31%) | |
| C1 | 3 (3%) | 8 (8%) | 61 (59%) | 32 (31%) | |
| C2 | 6 (6%) | 14 (13%) | 62 (60%) | 22 (21%) | |
Avaliadores segundo a experiência: A, Cirurgiões de Coluna; B, Residentes em Cirurgia da Coluna; C, Residentes em Ortopedia e Traumatologia.
Fig. 3Coeficiente Kappa de Fleiss para a concordância intra-avaliador.
Coeficientes Kappa de Fleiss dispostos na Figura 1 , com intervalos de confiança e valores p dos testes aplicados
| Avaliador | Kappa de Fleiss | IC95% |
|
|---|---|---|---|
| A1 | 0,601 | (0,462–0,740) | < 0,001* |
| A2 | 0,827 | (0,738–0,915) | < 0,001* |
| B1 | 0,307 | (0,163–0,452) | < 0,001* |
| B2 | 0,710 | (0,586–0,833) | < 0,001* |
| C1 | 0,580 | (0,440–0,720) | < 0,001* |
| C2 | 0,557 | (0,407–0,708) | < 0,001* |
Abreviação: IC, intervalo de confiança.
Nota-se que, em todos os casos, a concordância obtida se mostrou significativa, ao nível de 5% de significância ( p < 0,001).
Teste Kappa de Fleiss para a concordância interavaliador
| Avaliador | Kappa de Fleiss | IC95% |
|
|---|---|---|---|
| Aferição 1 | 0,430 | (0,344–0,516) | < 0,001 |
| Aferição 2 | 0,369 | (0,288–0,451) | < 0,001 |
Teste Kappa de Fleiss para a concordância interavaliador (par a par)
| Medição | Avaliador | A1 | A2 | B1 | B2 | C1 | C2 |
|---|---|---|---|---|---|---|---|
| Aferição 1 | A1 | 1,000 | |||||
| A2 | 0,619 | 1,000 | |||||
| B1 | 0,192 | 0,261 | 1,000 | ||||
| B2 | 0,488 | 0,412 | 0,236 | 1,000 | |||
| C1 | 0,565 | 0,583 | 0,218 | 0,434 | 1,000 | ||
| C2 | 0,597 | 0,584 | 0,196 | 0,516 | 0,496 | 1,000 | |
| Aferição 2 | A1 | 1,000 | |||||
| A2 | 0,439 | 1,000 | |||||
| B1 | 0,222 | 0,138 | 1,000 | ||||
| B2 | 0,483 | 0,458 | 0,283 | 1,000 | |||
| C1 | 0,515 | 0,539 | 0,168 | 0,449 | 1,000 | ||
| C2 | 0,440 | 0,404 | 0,166 | 0,496 | 0,325 | 1,000 |