Reliability analysis of radiographic methods for determination of posterolateral lumbossacral fusion.

OBJECTIVE: To analyze intra and interobserver agreement of two radiographic methods for evaluation of posterolateral lumbar arthrodesis.
METHODS: Twenty patients undergoing instrumented posterolateral fusion were evaluated by anteroposterior and dynamic lateral radiographs in maximal flexion and extension. The images were evaluated initially by 6 orthopedic surgeons, and after 8 weeks, reassessed by 4 of them, totaling 400 radiographic measurements. Intra and interobserver reliability were analyzed using the Kappa coefficient and Landis and Koch criteria.
RESULTS: Intra and interobserver agreement regarding anteroposterior radiographs were, respectively, 76 and 63%. On lateral views, these values were 78 and 84%, respectively. However, the Kappa analysis showed poor intra and interobserver agreement in most cases, regardless of the radiographic method used.
CONCLUSION: There was poor intra and interobserver agreement in the evaluation of lumbosacral fusion by plain film in anteroposterior and dynamic lateral views, with no statistical superiority between the methods.

INTRODUCTION

Intervertebral fusion is the treatment of choice for symptomatic lumbar instabilities. In most cases, its results are related to the quality of the fusion,( which makes the imaging method evaluation relevant.

Although surgical exploration is the gold standard for intervertebral fusion determination,( the method is no long used routinely, as it is considered too invasive. On the other hand, validity of simple radiography in determining the rate of fusion has been questioned, due to weak interobserver agreement( and moderate degree of accuracy (60 and 70%) in determining intervertebral fusion.( Even so, radiography is the method most often used for this purpose, due to its availability and low cost.(

There are different radiographic methods described for the analysis of lumbosacral fusion, such as static anteroposterior, oblique, or dynamic lateral views, in flexion and extension. Each technique has specific characteristics, such as the number of exposures to ionizing radiation, which denotes their safety and costs. Patients submitted to spinal arthrodesis are evaluated by means of radiographs at each clinical visit. For this reason, the number of exposures to ionizing radiation and their diagnostic effectiveness should be optimized.

Computed tomography (CT) is another method described for evaluation of lumbosacral fusion. In the literature, there are few case-control tomographic studies aiming to determine the quality of the intersomatic (anterior) lumbar fusion.(

Currently there is no consensus on the best radiographic method of lumbosacral posterolateral fusion. This observation motivated the present study.

OBJECTIVE

To analyze the intra and interobserver agreement of two radiographic methods used to evaluate lumbar arthrodesis, by means of static anteroposterior and dynamic lateral radiographies in flexion and extension.

METHODS

The present study was approved by the Research Ethics Committee of the Santa Casa da Misericórdia de Santos (52/10). All the patients accepted to participate and signed the Informed Consent Form (ICF). A cross-sectional study was carried out with 20 patients, 15 of them male. Patients were submitted to instrumented posterolateral lumbar arthrodesis with pedicular screws, operated on between September 2007 and October 2009. Age varied between 43 and 84 years, with a mean of 53.2 years. The minimal postoperative follow-up time was 24 months, with a mean of 32.3 months. The number of anatomical segments operated on varied between 1 and 4, located between L2 and S1.

The inclusion criteria considered patients with degenerative diseases of the spine and mechanical instability; with neural decompression and posterolateral fusion with pedicular screws. Excluded were patients with antecedents of surgery in the lumbar region; metabolic bone disease confirmed by laboratory tests and/or image tests; use of bone substitutes or expanders, and infection at the surgical site with need for surgical cleaning.

In all cases, digital radiographs were obtained of the lumbosacral spine in static anteroposterior views (with 25°caudal inclination of X-ray tube) and in the dynamic lateral views, in maximal flexion and extension. Lateral radiographs were performed with the patient in orthostatic position, with the help of a radiology technician at the time of the test. Radiographic measurements were made by six orthopedic surgeons – three experienced spinal surgeons, two spinal surgery fellows and one orthopedics and traumatology fellow. The cases were initially evaluated by all the examiners. After 8 weeks, radiographic analyses were repeated by 4 examiners, since 2 of the observers were not available for the study. In this way, a total of 400 radiographic measurements were made, and considered for statistical analysis.

The assessment of fusion from the anteroposterior view followed the criteria proposed by Christensen et al.,( that considered fusion positive in the presence of a bone bridge uniting the two adjacent transverse processes, uni- or bilaterally (Figure 1). In cases where overlapping of metal rods precluded an appropriate analysis, the fusion was considered doubtful (Figure 2). Pseudoarthrosis was considered as the absence of a bone bridge between the transverse processes bilaterally (Figure 3).

Figure 1

Anteroposterior radiography of the lumbosacral spine showing complete posterolateral fusion

Figure 2

Anteroposterior radiography of the lumbosacral spine displaying doubtful posterolateral fusion, due to the presence of metal stems superimposed on the intertransverse space

Figure 3

Anteroposterior radiography of the lumbosacral spine, in which pseudoarthrosis is considered due to the presence of osteolysis around screws of S1 (shown by the arrows)

On the sagittal plane, the criteria of Larsen et al. were used,( which consist of the measurement of Cobb's angle between the terminal vertebrae of the fusion. The angles were traced on dynamic radiographies, in maximal flexion and extension of the trunk. Next, the angle difference was calculated between the two measurements. An angle difference ≥5° was considered pseudoarthrosis. The authors also determined lack of fusion the presence of osteolysis greater than 2mm around the pedicular screws, and the breakage or release of the metal implants.

The statistics were performed with the software Statistical Package for the Social Sciences (SPSS, SPSS Inc., Chicago, IL, United States), version 17.0. The descriptive analysis is shown in percentage of agreement among observers and intraobserver. Reliability analysis was carried out using Kappa coefficient, with values of −1 to 1, where those near “one” are considered in greater agreement. The result analysis, after the Kappa coefficient calculation, was interpreted according to criteria proposed by Landis and Koch.(

RESULTS

Anteroposterior radiograph

The interobserver reproducibility (Table 1) was evaluated comparing the first reading of each observer, paired two by two, in order to cover all the possible combinations analyzed by the Kappa coefficient. In this analysis, the mean percentage of agreement was 76% (standard deviation of 7.8).

Table 1

Results of interobserver reliability for anteroposterior radiographs

Observers	Agreement (%)	Kappa	Reliability level
Observer 1×2	82	0.32	Reasonable
Observer 1×3	77	0.24	Reasonable
Observer 1×4	86	0.32	Reasonable
Observer 1×5	86	0.50	Moderate
Observer 1×6	68	0.12	Poor
Observer 2×3	77	0.29	Reasonable
Observer 2×4	78	0.33	Reasonable
Observer 2×5	77	0.36	Reasonable
Observer 2×6	84	0.36	Reasonable
Observer 3×4	64	0.10	Poor
Observer 3×5	74	0.21	Reasonable
Observer 3×6	72	0.18	Poor
Observer 4×5	64	0.07	Poor
Observer 4×6	86	0.34	Reasonable
Observer 5×6	64	0.07	Poor

Mean percentage of agreement: 76% (standard deviation 7.8).

The intraobserver reproducibility (Table 2) study using the Kappa coefficient showed a mean percentage of agreement of 63% (standard deviation of 10).

Table 2

Intraobserver reliability analysis results for anteroposterior radiographies

Observers	Agreement (%)	Kappa	Reliability level
Observer 3	55	0.06	Poor
Observer 4	70	0.26	Reasonable
Observer 5	73	0.19	Poor
Observer 6	53	0.09	Poor

Mean percentage of agreement: 63% (standard deviation of 10).

Evaluation of dynamic lateral radiographies

The study of interobserver reproducibility (Table 3) was conducted by comparing the first reading of each observer, paired two by two, in order to cover all the combinations possible analyzed by Kappa's coefficient. The mean percentage of agreement was 78% (standard deviation of 9.1).

Table 3

Interobserver reliability analysis results for dynamic lateral incidences

Observers	Agreement (%)	Kappa	Reliability level
Observer 1×2	66	0.01	Poor
Observer 1×3	84	-0.08	Poor
Observer 1×4	86	0.18	Poor
Observer 1×5	89	0.39	Reasonable
Observer 1×6	82	0.26	Reasonable
Observer 2×4	84	0.27	Reasonable
Observer 2×5	77	0.35	Reasonable
Observer 2×6	70	0.18	Poor
Observer 3×2	64	0.01	Poor
Observer 3×4	61	0.02	Poor
Observer 3×5	82	0.10	Poor
Observer 3×6	89	0.38	Reasonable
Observer 4×5	86	0.50	Moderate
Observer 4×6	80	0.21	Reasonable
Observer 5×6	75	0.12	Poor

Mean percentage of agreement: 78% (standard deviation of 9.1).

The interobserver reliability study (Table 4), performed with four observers (Kappa coefficient) showed a mean percentage of agreement of 84% (standard deviation of 10).

Table 4

Intraobserver reliability analysis results for dynamic lateral views

Observers	Agreement (%)	Kappa	Reliability level
Observer 3	95	0.73	Substantial
Observer 4	82	0.41	Moderate
Observer 5	82	0.23	Reasonable
Observer 6	75	0.20	Reasonable

Mean percentage of agreement: 84% (standard deviation of 10).

DISCUSSION

Intervertebral fusion is a common procedure to treat mechanical instabilities of the spine. There are several operative techniques for that purpose and for all, a solid fusion among the adjacent vertebrae represents a primary outcome, so that improves clinical results.( Posterolateral arthrodesis is a relatively low-cost method (when compared to other instrumented techniques) and simple for spinal surgeons to perform. The technique is popular among orthopedic surgeons and neurosurgeons, and for these reasons, was chosen for analysis in the present study.

There is no consensus on the best radiographic way to evaluate the quality of lumbar vertebral fusion. Imaging methods include radiography and tomography, but the final diagnosis is confirmed by surgical inspection.( Blumenthal et al.( assessed 49 patients with lumbar fusion and compared the radiographic results with those obtained surgically. The authors observed a clinical-radiographic correlation in merely 59% of cases. However, for obvious reasons, operative exploration is reserved for those patients with unsatisfactory clinical results and high radiographic suspicion of fusion failure. For the rest, the need for adequate evaluation by imaging studies is imperative. Currently, there is no scientific evidence of a lumbar fusion diagnostic method superior to the others.

In this study, for the analysis of lumbar fusion two radiographic methods were compared. The first, proposed by Christensen et al.,( is based on a “quadrant” classification system, in which each intertransverse space is subdivided into units to be applied separately. Fusion is considered as the presence of a bone bridge uniting the transverse processes bilaterally or unilaterally at each anatomic level. In the original article, the authors describe inter- and intraobserver agreement of 86 and 93%, respectively. The present study revealed values of 76 and 63%, respectively, and inter- and intraobserver agreement was considered weak for most of the cases studied. One possible explanation for this may consist in the fact of no bowel preparation having been made before the radiographic study, a fact that may have contributed towards worsening of image quality, leading to interpretation error. For outpatient reevaluation of lumbar fusions, however, the use of simple radiographs with no bowel preparation is a common practice among spinal surgeons.

A study by means of dynamic lateral radiographs, in maximal flexion and extension, was also performed. It is believed that there should be minimal movement between the two adequately fused vertebrae.( Larsen et al. demonstrated the existence of residual mobility after lumbar fusion – evaluated by dynamic radiographs –and that these could vary according to the type of fusion performed (posterolateral, intersomatic, or anterior).(

In this study, we used the criteria proposed by the referred authors who proposed pseudoarthrosis as the presence of an angle difference ≥5° among the instrumented vertebrae views on the dynamic lateral radiographs. With this method, as an example of what was cited above, poor or weak intra- and interobserver agreement was observed for most of the cases studied. In the results found, no influence was noted of time of professional experience of the observing doctors.

Rodrigues et al.( demonstrated that the presence of lumbar pseudoarthrosis did not promote worse clinical results than those observed in patients with complete fusion. These findings are similar to those described by Kant et al.,( that suggested that the concern with the quality of fusion is more relevant only in those patients with an unfavorable clinical result and chronic lumbar pain.

The minimal radiographic study of the spine should include two orthogonal views.( Besides these, additional views, oblique( or dynamic, may offer more information as to presence of fusion mass. This, however, increases exposure to ionizing radiation as well as financial costs. It is estimated that each simple X-ray of the lumbar spine furnished approximately 1.5mSv of radioactive load to the patient.( This quantity is equivalent to about 75 simple chest X-rays, which would have an approximate radiation load of about 0.02mSv. In this way, patients evaluated by simple X-rays by Christensen's method received about 1.5mSv per test, while dynamic radiography (two radiographic views) offered an exposure of 3mSv (equivalent to 150 simple chest X-rays). As to dynamic lateral radiographies in flexion and extension, the rationale of the method is questioned. In the present study, no additional information was observed as to intervertebral fusion when compared to the anteroposterior view (a single radiographic exposure).

The use of CT in the evaluation of lumbosacral fusion is described in the literature. The method is frequently used to verify intersomatic (interbody) fusion. In the present study, patients were submitted exclusively to posterolateral fusion, with no addition of intersomatic grafts.

Currently, the tomographic studies available are of the case-control or case series types. Rothman et al. recommended the use of CT to evaluate anterior fusion of the spine.( Other authors also demonstrated superiority of CT relative to dynamic radiographs for the determination of intersomatic lumbosacral fusion. ( However, these findings diverge from the results by Fogel et al., who demonstrated the tomographic study is unnecessary in cases with signs of pseudoarthrosis on plain X-ray films.( Although not the objective of this study, it is believed that CT might be considered an additional method for determining the existence of lumbosacral fusion mass, especially in patients that present with unsatisfactory surgical results and with a suspicion of consolidation failure.

CONCLUSION

A weak intra-and interobserver agreement in lumbosacral fusion by means of plain-film radiography was noted, in anteroposterior and dynamic lateral views, with no statistical superiority between the studies.