D F Russell1, A H Deakin, Q A Fogg, F Picard. 1. Golden Jubilee National Hospital, OrthopaedicDepartment, Agamemnon Street, Clydebank, WestDunbartonshire G81 4DY, and Faculty of Biomedicaland Life Sciences, Thomson Building, University Avenue, GlasgowG12 8QQ, UK.
Abstract
OBJECTIVES: We performed in vitro validation of a non-invasive skin-mounted system that could allow quantification of anteroposterior (AP) laxity in the outpatient setting. METHODS: A total of 12 cadaveric lower limbs were tested with a commercial image-free navigation system using trackers secured by bone screws. We then tested a non-invasive fabric-strap system. The lower limb was secured at 10° intervals from 0° to 60° of knee flexion and 100 N of force was applied perpendicular to the tibia. Acceptable coefficient of repeatability (CR) and limits of agreement (LOA) of 3 mm were set based on diagnostic criteria for anterior cruciate ligament (ACL) insufficiency. RESULTS: Reliability and precision within the individual invasive and non-invasive systems was acceptable throughout the range of flexion tested (intra-class correlation coefficient 0.88, CR 1.6 mm). Agreement between the two systems was acceptable measuring AP laxity between full extension and 40° knee flexion (LOA 2.9 mm). Beyond 40° of flexion, agreement between the systems was unacceptable (LOA > 3 mm). CONCLUSIONS: These results indicate that from full knee extension to 40° flexion, non-invasive navigation-based quantification of AP tibial translation is as accurate as the standard validated commercial system, particularly in the clinically and functionally important range of 20° to 30° knee flexion. This could be useful in diagnosis and post-operative evaluation of ACL pathology. Cite this article: Bone Joint Res 2013;2:233-7.
OBJECTIVES: We performed in vitro validation of a non-invasive skin-mounted system that could allow quantification of anteroposterior (AP) laxity in the outpatient setting. METHODS: A total of 12 cadaveric lower limbs were tested with a commercial image-free navigation system using trackers secured by bone screws. We then tested a non-invasive fabric-strap system. The lower limb was secured at 10° intervals from 0° to 60° of knee flexion and 100 N of force was applied perpendicular to the tibia. Acceptable coefficient of repeatability (CR) and limits of agreement (LOA) of 3 mm were set based on diagnostic criteria for anterior cruciate ligament (ACL) insufficiency. RESULTS: Reliability and precision within the individual invasive and non-invasive systems was acceptable throughout the range of flexion tested (intra-class correlation coefficient 0.88, CR 1.6 mm). Agreement between the two systems was acceptable measuring AP laxity between full extension and 40° knee flexion (LOA 2.9 mm). Beyond 40° of flexion, agreement between the systems was unacceptable (LOA > 3 mm). CONCLUSIONS: These results indicate that from full knee extension to 40° flexion, non-invasive navigation-based quantification of AP tibial translation is as accurate as the standard validated commercial system, particularly in the clinically and functionally important range of 20° to 30° knee flexion. This could be useful in diagnosis and post-operative evaluation of ACL pathology. Cite this article: Bone Joint Res 2013;2:233-7.
Non-invasive adaptation of computer navigation technology is
as reliable, precise and accurate as a commercially available, image-free,
invasive navigation system
Key messages
From extension to 40° of knee flexion the non-invasive method
is as reliable, precise and accurate as the commercial invasive
systemBeyond 40° knee flexion, reliability and accuracy are unacceptable
Strengths and limitations
This is the first validation of a non-invasive adaptation of navigation-based
technology that uses similar frames of reference to those used intra-operatively
in measuring anteroposterior tibial translationThese data provide a foundation and rationale for further in
vivo analysisA limitation of this study is the use of cadaveric material,
which was mandatory given the nature of the invasive comparison.
Further in vivo validation must now be performed
before the device is used in in vivo research or
clinical practice
Introduction
Evaluation of anterior cruciate ligament integrity in the clinical
setting relies predominantly on establishing anteroposterior (AP)
laxity by manual testing. The Lachman test has been shown to be
highly sensitive in the diagnosis of cruciate deficiency,[1-5] but in terms of evaluating cruciate
ligament reconstruction, the test remains examiner-dependent and
subjective. The reliability of non-invasive methods that objectively
evaluate AP translation is reported as inconsistent in the literature.[5-15]Image-free navigation has been thoroughly validated and is used
by many surgeons to provide intra-operative assessment of AP tibial
laxity.[16-19] The role of this
technology is limited to the operative setting due to the requirement
for invasive optical tracker placement. A non-invasive adaptation
of this technology using software algorithms identical to those
used in a commercially available image-free navigation system has
been validated to quantify lower limb mechanical and coronal knee
laxity in early flexion.[20,21] Using the same
fabric strap method, a pilot study on six embalmed cadaveric lower
limbs gave acceptable reliability, precision and agreement with
a conventional image-free navigation system measuring AP translation
in early flexion.[22]The primary aim of this study was to compare a non-invasive system
with a validated and commonly used intra-operative computer navigation
system in terms of reliability and repeatability of AP translation
measurement and agreement with the invasive system. The secondary
aim was to observe the effect of knee flexion on measurement reliability,
precision and agreement between the two systems.
Materials and Methods
A single investigator (DFR) carried out all testing. A total of
12 lower limbs were used from eight cadavers (five female and three
male, mean age 80.5 years (65 to 91)). The image-free OrthoPilot
navigation system was used with passive optical trackers (B. Braun
Aesculap, Tuttlingen, Germany). The optical camera was positioned
2 m from the specimen. Experimental software allowed registration
of the centres of the hip, knee and ankle following a series of
prescribed lower limb movements and localisation of key bony landmarks.
The registration algorithms in this software are identical to validated,
commercially available software used in computer-assisted surgery.Two separate methods of tracker fixation were used: standard
bone screws with tracker mounts, and a fabric strap used to secure
a baseplate. The fabric strap and baseplate used in this study had
been validated.[20] In order
to allow attachment of a transducer to the anterior tibia to allow
application of a moment perpendicular to the coronal plane of the
tibia, a screw with eyelet was inserted into the tibial tuberosity.
A 3 cm incision was made over the proximal anterior femur down to
bone and all soft tissues were cleared from the anterior femoral
cortex. Both cortices were drilled and a screw with an eyelet inserted
perpendicular to the long axis of the femur. This screw was used
to suspend the thigh above the laboratory table, thus minimising
soft-tissue artefacts from the work-surface. In order to create
a foot support, a loop of cord from a second laboratory stand was
secured proximal to the metatarsal heads; this maintained the angle
of flexion of the knee. In order to limit knee extension during testing,
four separate bungee cords were attached to two screws inserted
into the medial and lateral distal tibial cortices. These cords
were secured to the laboratory table. Various lengths were available
and changed to adapt to various positions of knee flexion, keeping
the bungee cords as tight as possible according to position of the
foot throughout range of knee flexion. The pull of the bungee cord
was counteracted by the foot support, resulting in no flexion or
extension of the knee joint during AP tibial stress testing.The limbs were put through 24 full cycles of flexion and extension
and ten applications of 100 N anterior force applied via the tibial
tuberosity screw before testing in order to minimise systematic
error due to progression of tissue elasticity. The experiments were
carried out over 12 days, during which the temperature of the laboratory was
controlled and constant. The specimens were not refrigerated between
experiments.AP tibial translation was recorded by the system following force
application at intervals of 10° from extension to 60° of knee flexion.
This procedure was performed twice using optical trackers mounted
invasively using bone screws, and twice using the non-invasive fabric
strap method. A force transducer was secured to the tibial tuberosity
eyelet screw and a linear force applied in an anterior direction
perpendicular to the long axis of the tibia until a force of 100
N had been reached. The value of 100 N was selected considering
various methodologies used in previous in vitro and in
vivo testing of AP laxity of the knee joint.[6,7,10,23,24] The software automatically recorded
maximum displacement in millimetres. The investigator did not watch
the computer monitor during testing – however, true blinding to
results throughout the entire experiment was not possible due to
single investigator setup and potential contamination issues while handling
fresh cadaveric material. Only the foot pedal could be accessed
during testing and the screen could not be repeatedly obscured between
tests.
Statistical analysis
Statistical testing was applied to measurements taken from each
interval of 10° flexion separately to allow analysis of the effect
of knee flexion angle on reliability, repeatability and agreement.
Reliability within each method of tracker fixation used in measuring
AP tibial translation was analysed by calculating the intraclass
correlation coefficients (ICCs).[25] A coefficient
of ≥ 0.75 demonstrates very good reliability.[26,27] The calculation of ICC was performed
using IBM SPSS v17.0 software (IBM Corp., Armonk, New York). Coefficient
of repeatability (CR) was calculated to demonstrate repeatability
between test–retest measurements within each method of tracker fixation.[28] The CR defines
the interval within which 95% of test–retest differences lie (i.e.
within 2 sds of the test–retest differences.[28] A limit of 3 mm
was chosen for the repeatability of measurements when considering
each system separately, and as a limit for agreement margin between
the systems. This value was chosen based on diagnostic criteria
for dichotomous testing between
‘normal’ and ‘injured’ knees when testing for ACL insufficiency using other
measurement devices.[29] A
CR ≤ 3 mm denotes that 95% of all measurements are within a range
of ±1.5 mm. Bland–Altman plots were generated as a visual representation
of the limits of agreement. 95% limits of agreement (LOA) were determined
using the corrected standard deviation of the differences (sdc)[28] to allow for repeated
measurements. Mean difference between the system measurements ±1.96 sdc reflects
the limits of agreement between the two systems. Acceptable limits of
agreement were once again set at 3 mm. CR and LOA calculations were
performed using Microsoft Excel (Microsoft Corp., Redmond, Washington).
Results
The mean fixed flexion for the 12 specimens was 6.8° (0° to 15°).Figure 1 demonstrates the mean CR at each flexion interval throughout
the range of flexion tested in this experiment (12.8° to 60°). Bland–Altman
plots demonstrated no systematic error plotting screw fixation versus fabric
strap fixation (Fig. 2). Figure 3 displays LOA at each 10° interval of knee flexion between measurements taken using
invasive versus non-invasive tracker mounting.Graph of the coefficient of repeatability
(CR) for the invasive and non-invasive methods of measuring anteroposterior
tibial translation, showing that both are acceptable (within the
limit of 3 mm) throughout knee flexion.Bland–Altman plot of the mean difference
between anteroposterior (AP) measurements with trackers secured
using bone screws (invasive) and fabric strapping (non-invasive)
against the mean measurements of AP translation taken with the knee
in full extension.Graph showing the limits of agreement
(LOA) calculated from measurements taken using both methods of tracker
fixation at each interval of 10° flexion. The limit for acceptable
LOA is marked by the horizontal line at 3 mm, which is exceeded
at flexion > 40°.It was noted during the experiment that despite obvious subjective
AP movement of the tibia, the system measured ‘0 mm’ AP displacement.
This occurred at higher angles of flexion only, during one test
at 50° flexion and during six tests at 60° flexion using the invasive
and non-invasive methods.
Discussion
From extension to 40° knee flexion, both devices displayed similarly
good reliability and precision. In this range, agreement between
the devices is also acceptable. The angle of knee flexion does not
affect precision, but it does affect accuracy of the non-invasive
method in flexion > 40°. The validity of this non-invasive device
has been demonstrated in the in vitro setting as
it has demonstrated acceptable reliability, precision and accuracy
between extension and 40°. Additional in vivo work
should be carried out to further validate the device, as this range
of knee flexion permits important tests of knee laxity such as the
Lachman test,[1] and
is a useful range for demonstrating dynamic weight-bearing stability
in early flexion such as squatting, ascending or descending a step
when patients with ACL insufficiency often report feelings of ‘giving
way’.[30,31]Limitations of this experiment include use of cadaveric tissue,
which lacks muscle tone and has different tissue properties to the in
vivo setting. The invasive nature of the validation methodology
used in this experiment mandated the use of cadaveric limbs. However,
it is now important to study the effect on the non-invasive system of
artefacts from live soft tissue in a range of live subjects. The
experiment set-up involving limb suspension and securing knee flexion
angle will alter kinematics of the lower limb to some degree. However,
this set-up provided consistent testing conditions in terms of joint
positioning, removing variables that may have obscured testing of
precision and accuracy. These limitations are characteristic to in
vitro validation of clinical devices[32] and such experimental
work is very important before progressing to reliability testing in
vivo, in which the comparison of kinematic measurement
is either not attempted or involves consequential intervention such
as invasive placement of markers or ionising radiation. Based on
the results of this study, in vivo validation should
now be carried out. A limitation common to all image-free navigation
systems is a decrease in accuracy beyond 50° of knee flexion, which
is well documented in the literature.[33-35] This
is due to the femoral frame being defined by the transepicondylar
axis (TEA), the landmarks for which are acquired at registration.
The TEA collected at registration is not accurate enough to compensate
for the marked displacement of the femoral and tibial axes during
high knee flexion.[33-35] This phenomenon
was observed at higher flexion angles in this study. The limitation
beyond 50° of knee flexion is important to note when using image-free navigation
in any setting.From extension to 40° flexion, the results of reliability, precision
and accuracy are favourable for the non-invasive method of tracker
fixation compared with arthrometric devices. Generally these devices
provide a reliability (ICC) of 0.6.[11,12] Concerns
have been raised over accuracy of the most popular clinical devices,
such as the KT-1000 (MEDmetric Corporation, San Diego, California).[7,8,10,36]AP rather than rotatory laxity is the most reliable kinematic
indicator of cruciate ligament integrity. Increases in anterior
translation of between 2 mm and 14.4 mm following sectioning of
the ACL have been reported using various methods of force application
and measurement.[37-40] Isberg et al[37] compared normal
knees with those with ACL rupture in 22 patients using radiostereometric
analysis, and found a mean difference in anterior translation of
7.4 mm (2.2 to 17.4). Sectioning of the ACL has been shown in biomechanical
studies to increase internal rotation by only 2° to 4° with the
knee in early flexion (i.e., 20° to 30°).[41-46] The
posterior cruciate ligament is even less involved in rotatory stability,
only demonstrating significant effect at 90° of knee flexion.[47,48] Furthermore, reconstruction of the
ACL may not restore rotational kinematics.[49] Non-invasive devices assessing tibial
rotation with an aim of detecting cruciate ligament pathology or
dysfunction would have to be very sensitive compared with those
detecting AP instability. The reliability of current devices used
to quantify rotational laxity is relatively low and such devices
are not routinely used in clinical practice, with the vast majority
still in pre-clinical development.[50] The pivot shift phenomenon has been mapped
and characterised using invasive navigation-based technology, allowing
comparison of ACL reconstruction techniques.[51-55] However,
a non-invasive adaptation of this has not yet tested in the clinical
setting. Until more sensitive means of analysing tibial rotation
are available, it may be more useful to detect AP instability for diagnosis
of cruciate pathology and evaluation of surgical reconstruction.Should the non-invasive method of tracker fixation method prove
valid in vivo, it would provide a useful adjunct
to clinical examination aiding diagnosis of cruciate pathology.
A method of quantifying the forces applied during examination would
increase knowledge of ‘normal’ laxity, allow standardisation of
examination technique and permit comparison of surgical results between
practitioners.
Conclusion
In the in vitro setting, the non-invasive method
of tracker fixation proved as reliable and precise as the invasive
method in measuring AP tibial translation, and demonstrated acceptable
agreement within a diagnostically applicable range from full knee
extension to 40° knee flexion.The authors would like to thank the technical and administrative
staff at the Laboratory of Human Anatomy, University of Glasgow.
They would also like to thank Mr P. Cleary and Mr I. Freer for the
excellent support provided in supplying equipment to facilitate
this study.
Authors: S Zaffagnini; F Urrizola; C Signorelli; A Grassi; T Roberti Di Sarsina; G A Lucidi; G M Marcheggiani Muccioli; T Bonanzinga; M Marcacci Journal: Knee Surg Sports Traumatol Arthrosc Date: 2016-10-15 Impact factor: 4.342