| Literature DB >> 32741090 |
Jeffrey Barber1,2, Johnson Yuen3,4,5, Michael Jameson6,4,5, Laurel Schmidt3, Jonathan Sykes1,2, Alison Gray6,4,5, Nicholas Hardcastle7,8, Callie Choong6, Joel Poder3,8, Amy Walker6,4,5, Adam Yeo7,9, Ben Archibald-Heeren10, Kristie Harrison11, Annette Haworth2, David Thwaites1,2.
Abstract
Image registration is a process that underlies many new techniques in radiation oncology - from multimodal imaging and contour propagation in treatment planning to dose accumulation throughout treatment. Deformable image registration (DIR) is a subset of image registration subject to high levels of complexity in process and validation. A need for local guidance to assist in high-quality utilisation and best practice was identified within the Australian community, leading to collaborative activity and workshops. This report communicates the current limitations and best practice advice from early adopters to help guide those implementing DIR in the clinic at this early stage. They are based on the state of image registration applications in radiotherapy in Australia and New Zealand (ANZ), and consensus discussions made at the 'Deforming to Best Practice' workshops in 2018. The current status of clinical application use cases is presented, including multimodal imaging, automatic segmentation, adaptive radiotherapy, retreatment, dose accumulation and response assessment, along with uptake, accuracy and limitations. Key areas of concern and preliminary suggestions for commissioning, quality assurance, education and training, and the use of automation are also reported. Many questions remain, and the radiotherapy community will benefit from continued research in this area. However, DIR is available to clinics and this report is intended to aid departments using or about to use DIR tools now.Entities:
Mesh:
Year: 2020 PMID: 32741090 PMCID: PMC7754021 DOI: 10.1002/jmrs.417
Source DB: PubMed Journal: J Med Radiat Sci ISSN: 2051-3895
Figure 1The typical image registration process, where a moving or deforming image is transformed to match a reference image. The same process is used for rigid and deformable registration; however, different similarity metrics, optimisation and transformation algorithms are used.
Figure 2An example patient process map, indicating the imaging data that can be acquired at each phase of treatment, and below, the image registration‐related tasks (both deformable and rigid) are indicated across the time period and types of images they may occur.
Figure 3Development process of the advice in this report.
Definitions and acronyms used in this report, following the AAPM TG‐132 report.
| Term | Definition |
|---|---|
| Image registration (IR) | The process to generate a transform to convert one image to another image. Registration involves minimising the difference between moving and fixed images, using a similarity metric, to find a satisfactory solution. May also refer to the transform itself. |
| Rigid image registration (RIR) | A registration using a single 3D or 6D vector applied to the whole image. This may be manually performed by a user or an automatic process using an iterative optimisation process. |
| Deformable image registration (DIR) | A registration where the transform can vary across the image (i.e. a non‐rigid mapping of voxels). Transforms may be free form (spline‐based), flow‐based (e.g. demons), piecewise or finite‐element models. |
| Deformation vector field (DVF) | A transform describing the vector needed for each voxel to generate a warped image. Can be visualised as an overlaid grid, arrow vector field or colour map. |
| Warped image | The result of applying a DIR to the moving image. It is now a derived image and should be considered synthetic or a secondary source. |
| Fusion | The viewing of two images overlaid with a registration applied. |
| pCT | Radiotherapy simulation or planning CT. |
| rCT | A rescan CT or additional planning CT acquired during treatment. |
General technical considerations when performing DIR.
| Determining the bounding box or Region of Interest (ROI) for registration |
|
For the initial RIR, be careful not to include/clip high‐contrast structures that move relative to the target soft tissue structures within a rectangular ROI as these will bias the registration, for example pubis when registering prostate. Individual ROIs should be defined appropriately for each registration application, based on the clinical goal of the registration. If bounding boxes are used for DIR, the box should include enough contrast and, if possible, should encompass entire organs that may deform, to avoid discontinuity at borders. If a good result cannot be obtained for the full registration ROI, try using sequentially smaller regions to progressively tune the result. Watch out for discontinuity between regions. |
| Initial RIR is critical for effective DIR |
|
Ensure the RIR is accounting for systematic variation between images (provides a global/coarse fit in the region of interest), so that the DIR can focus on deformation alone. In images with large variations, the RIR should be optimised to provide the strongest registration at areas of greatest clinical importance. Potentially, multiple registrations are needed to focus on separate areas across the image. |
| Contrast within the ROI |
|
Regions of low contrast provide little intensity variation ‘features’ for algorithms to compute the deformation and thus may give incorrect or non‐physical results when using DIR. This is of importance when deforming PET or dose images according to the registration between two CT images. Use thresholds and window/level settings to improve contrast where possible. |
| Understand the limitations of RIR and DIR |
|
Image registration is a mathematical tool, with limited or no biological information involved in the process. There are limitations in compensating for large changes in pose, expansions and contractions, and differential movement of tissues with varying biomechanical properties and attachment. Recognise when RIR/DIR is appropriate, and consider viewing images side by side if neither RIR/DIR provide accuracy required. Communicate and document the accuracy or uncertainty level which represents a recommendation for end use; include residual errors or uncertainties for downstream processes. Limitations may be due to software, the images used, operator experience or the task itself. |
| Iterative deformation can improve accuracy |
|
Where available, tools that allow refinement of deformations can be used to iteratively improve DIR and correct poorly performing areas, for example focus structures and anchor points. |
General process and workflow considerations when performing DIR.
| Review registrations |
|
The amount of QA should reflect the risk of the task. This may indicate that multiple QA tools are used to assess the registrations, preferably by multiple staff. Reviews of registration should contain both quantitative and qualitative assessments of the performance of the similarity term and the transform term (feasibility of deformation vectors). Consider using the RIR if the DIR does not improve the accuracy level significantly. Ultimate approval lies with the radiation oncologist, taking into account the clinical scenario. |
| Registration naming and storage conventions |
|
RIR and DIR should be saved and accessible with naming that conveys date and purpose of IR. Use comment fields to record information that may change downstream (dates, users, etc.). Keep records indicating how a structure has been derived, resampled and finalised from DIR. Clarity and consistency in naming increase the safety of using DIR. |
| Consider reproducibility of registrations |
|
Where user‐dependent interactions are required, protocols should be employed to ensure consistency. For example: when utilising tools that are user‐dependent (such as local registration lock points or contours), the process may not be repeatable, or the method may not be evident at a future date. |
| Acquire all images in similar position where possible |
|
Discussions with radiology and nuclear medicine staff can lead to standard procedures for better diagnostic scans that more closely match RT planning scans – optimised acquisition parameters, creating flat couch areas, etc.; ‘low‐tech’ solutions like using MR‐safe and small‐bore compatible radiotherapy immobilisation equipment during MR or PET imaging to replicate treatment positions, and RT attendance for imaging, can result in more accurate imaging tasks downstream. |
Summary of key considerations for DIR between various image modalities used in radiotherapy.
| Image modalities | Key Considerations | Ref |
|---|---|---|
|
CT‐pCT registration | No specific considerations extending Table | |
| CBCT‐pCT registration |
Limitations of CBCT (FOV, HU accuracy, length limits) should be evaluated when estimating dose calculated on CBCT. Consider using tissue, air and bone overrides. |
|
| MR‐pCT registration |
MR‐pCT DIR should not be used routinely with the current tools available, unless multiple users have evaluated results on both technical and clinical grounds. |
|
| PET‐pCT registration |
Validate the consistent frame of reference between the PET and its attenuation correction CT before coupling other registrations. PET‐pCT DIR should only be performed using the intermediate registration between the attenuation correction CT and pCT. |
|
Summary of key considerations for clinical application use cases of DIR
| Clinical Application | Key considerations | Ref |
|---|---|---|
|
Contour propagation between pCT and rCT | Any structure derived from another should not be propagated, but instead re‐created from the corrected propagated anatomical structures (e.g. margin expansions and Boolean products). |
|
|
Propagation of rigid/deformed isodose contours (e.g. for retreatments) are to be assessed for accuracy level achieved, as they cannot be corrected with subsequent editing. All deformably propagated structures should be reviewed and any errors corrected/assessed prior to further use |
| |
|
Atlas Segmentation | Dice similarity coefficient should be used in combination with other metrics such as volume, location and surface measures. |
|
| The clinical impact of automatically generated contours should be evaluated through determination of the dosimetric differences when using automatic versus manual segmentation for each department. |
| |
| Use pre‐ and post‐processing steps to save time (e.g. build atlases with smoothed and cleaned contours; atlas contours contain every third slice then interpolate as a final step). |
| |
| Adaptive Radiotherapy | Offline adaptation is feasible with current tools but resource‐intensive. Each department needs to assess their capacity to implement. |
|
| Online adaptation tools may be available, but workflows and expertise are not necessarily developed yet. More development is needed. |
| |
| Replanning | DIR can increase efficiency of replanning workflows for contouring. Automated workflows reduce manual steps and may reduce errors. The same careful review as manual replanning is required. |
|
| Retreatment | The best estimate of previous dose depends on the scenario and available tools. Uncertainties of warping previous dose should be weighed against gains from providing a spatially correlated indication of past treatment. | |
| Dose Accumulation | Current tools and workflows for dose accumulation are not ready for routine clinical application, and the value gained from dose accumulation is not yet proven. Use should be evaluated as suitable by multiple users on both technical and clinical grounds. |
|
| Brachytherapy | Many challenges exist in brachytherapy DIR, and it should not be used in routine clinical application yet. Use should be evaluated as suitable by multiple users on both technical and clinical grounds. |
|
| Response Assessment | Large potential for quantitative response assessment and combination with functional or radiomic information. Scope for significant research. |
|
Suggested patient‐specific QA tasks by clinical DIR application. This is an example list, and each case may have its own requirements. Replanning, retreatment and adaptive processes may include multiple of the below applications
| Clinical Application | QA tasks |
|---|---|
| Multimodal image registration for contouring as input to a treatment plan |
IR Request from RO specifying series and regions of interest, purpose of registration Visual inspection of registration by RT and/or ROMP Visual inspection of DVF to comprehend deformation by RT and/or ROMP Check registration appropriate for each series in image set if propagating across multiple series New data sets resampled and named according to department rules Report to RO the IR performed, limitations and accuracy for desired purpose per request |
| Anatomical contour propagation pCT/rCT |
Visual inspection of registration by RT and/or ROMP Review and editing of contours by RO |
|
Dose‐derived contour propagation pCT/rCT (e.g. isodoses) |
IR Request and Report forms Visual inspection of registration results by experienced ROMP Report accuracy attained following a system based on commissioning results and TG‐132 accuracy levels. An example method to quantify accuracy is the mean and maximum from a structure DVF cumulative histogram. |
| Atlas Segmentation |
Visual inspection of result, editing and post‐processing by atlas user Review and editing of contours by RO |
| Dose warping |
IR Request and Report forms Visual inspection of DVF by ROMP Quantitative metrics such as DVF histogram, Jacobian maps, inverse consistency and harmonic energy New data sets resampled and named according to department rules Independent check of correct data sets and processes used |
| Dose Accumulation |
IR Request and Report forms Visual inspection of DVF by ROMP Quantitative metrics such as DVF histogram, Jacobian maps, inverse consistency and harmonic energy (59) New data sets resampled and named according to department rules Independent check of correct data sets and processes used, and correct weighting applied to each input dose |