Celia Martín Vicario1, Florian Kordon1,2,3, Felix Denzinger1,3, Jan Siad El Barbari4, Maxim Privalov4, Jochen Franke4, Sarina Thomas5, Lisa Kausch5, Andreas Maier1, Holger Kunze1,3. 1. Friedrich-Alexander-Universität Erlangen-Nürnberg, Pattern Recognition Lab, Erlangen, Germany. 2. Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen Graduate School in Advanced Optical Technologies, Erlangen, Germany. 3. Siemens Healthcare GmbH, Forchheim, Germany. 4. BG Trauma Center Ludwigshafen, Department for Trauma and Orthopaedic Surgery, Ludwigshafen, Germany. 5. German Cancer Research Center, Division of Medical Image Computing, Heidelberg, Germany.
Abstract
Purpose: To assess the result in orthopedic trauma surgery, usually three-dimensional volume data of the treated region is acquired. With mobile C-arm systems, these acquisitions can be performed intraoperatively, reducing the number of required revision surgeries. However, the acquired volumes are typically not aligned to the anatomical regions. Thus, the multiplanar reconstructed (MPR) planes need to be adjusted manually during the review of the volume. To speed up and ease the workflow, an automatic parameterization of these planes is needed. Approach: We present a detailed study of multitask learning (MTL) regression networks to estimate the parameters of the MPR planes. First, various mathematical descriptions for rotation, including Euler angle, quaternion, and matrix representation, are revised. Then, two different MTL network architectures based on the PoseNet are compared with a single task learning network. Results: Using a matrix description rather than the Euler angle description, the accuracy of the regressed normals improves from 7.7 deg to 7.3 deg in the mean value for single anatomies. The multihead approach improves the regression of the plane position from 7.4 to 6.1 mm, whereas the orientation does not benefit from this approach. Thus, the achieved accuracy meets the reported interrater variance in similarly complex body regions of up to 6.3 deg for the normals and up to 9.3 mm for the plane position. Conclusions: The use of a multihead approach with shared features leads to more accurate plane regression compared with the use of individual networks for each task. It also improves the angle estimation for the ankle region. The reported results are in the same range as manual plane adjustments. The use of a combined network with shared parameters requires less memory, which is a great benefit for the implementation of an application for the surgical environment.
Purpose: To assess the result in orthopedic trauma surgery, usually three-dimensional volume data of the treated region is acquired. With mobile C-arm systems, these acquisitions can be performed intraoperatively, reducing the number of required revision surgeries. However, the acquired volumes are typically not aligned to the anatomical regions. Thus, the multiplanar reconstructed (MPR) planes need to be adjusted manually during the review of the volume. To speed up and ease the workflow, an automatic parameterization of these planes is needed. Approach: We present a detailed study of multitask learning (MTL) regression networks to estimate the parameters of the MPR planes. First, various mathematical descriptions for rotation, including Euler angle, quaternion, and matrix representation, are revised. Then, two different MTL network architectures based on the PoseNet are compared with a single task learning network. Results: Using a matrix description rather than the Euler angle description, the accuracy of the regressed normals improves from 7.7 deg to 7.3 deg in the mean value for single anatomies. The multihead approach improves the regression of the plane position from 7.4 to 6.1 mm, whereas the orientation does not benefit from this approach. Thus, the achieved accuracy meets the reported interrater variance in similarly complex body regions of up to 6.3 deg for the normals and up to 9.3 mm for the plane position. Conclusions: The use of a multihead approach with shared features leads to more accurate plane regression compared with the use of individual networks for each task. It also improves the angle estimation for the ankle region. The reported results are in the same range as manual plane adjustments. The use of a combined network with shared parameters requires less memory, which is a great benefit for the implementation of an application for the surgical environment.
Authors: Celia Martín Vicario; Florian Kordon; Felix Denzinger; Jan Siad El Barbari; Maxim Privalov; Jochen Franke; Sarina Thomas; Lisa Kausch; Andreas Maier; Holger Kunze Journal: J Med Imaging (Bellingham) Date: 2022-05-09
Authors: Jochen Franke; Klaus Wendl; Arnold J Suda; Thomas Giese; Paul Alfred Grützner; Jan von Recum Journal: J Bone Joint Surg Am Date: 2014-05-07 Impact factor: 5.284
Authors: Jochen Franke; Jan von Recum; Arnold J Suda; Paul Alfred Grützner; Klaus Wendl Journal: J Bone Joint Surg Am Date: 2012-08-01 Impact factor: 5.284
Authors: Lisa Kausch; Sarina Thomas; Holger Kunze; Maxim Privalov; Sven Vetter; Jochen Franke; Andreas H Mahnken; Lena Maier-Hein; Klaus Maier-Hein Journal: Int J Comput Assist Radiol Surg Date: 2020-06-12 Impact factor: 2.924
Authors: Celia Martín Vicario; Florian Kordon; Felix Denzinger; Jan Siad El Barbari; Maxim Privalov; Jochen Franke; Sarina Thomas; Lisa Kausch; Andreas Maier; Holger Kunze Journal: J Med Imaging (Bellingham) Date: 2022-05-09