1. Background
With increasing innovation in imaging technologies such as computed tomography (CT), there is a growing need for performance validation (1). Basic phantoms have been established for the measurement of low- and high-contrast resolution, impulse response and CT calibration; some are shipped with CT scanners for routine testing and image quality calibration. More complex phantoms that simulate internal structures of the human torso including attenuation and shapes of various tissues are already commercially available; however, manufacturing complexities are generally reflected in prohibitive costs. Additionally, commercial phantoms do not always comply with specific requirements of a particular study regarding lesion shape, size, attenuation, number or location. In such cases a specific phantom must be commissioned.
2. Objectives
The aim of the present work was 1) to compare various phantom designs found by literature search and 2) to design, construct and validate a specific phantom for CT colonography (CTC) with multiple intermediate polyps that would be suitable for comparison of diagnostic performance of low-dose CTC among different scanners.
3. Materials and Methods
Initially we tested several materials (polyurethane resin, silicone, modeling clay, polyvinylchloride, polypropylene, silicone pipes, plexiglass and ex-vivo colon) for their suitability in constructing a colonic wall.
In materials classified as rigid pipes, we attempted to create a bend to simulate colonic anatomy. In general, there are three options to create bends: 1) heat shaping, 2) connecting a prefabricated elbow and 3) connecting two pipes with oblique ends. For heat shaping, the tube must be filled with loose material such as fine sand and the selected segment heated and carefully bent to avoid casing defects. Bends more than 60 degree are difficult to make. Conversely, a commercially available prefabricated elbow can be fixed to the end of pipe, thus achieving a bend of a defined shape without the risk of damaging the casing. The last option, fixing two ends of straight pipe together, results in a sharp bend. Finally, we chose polypropylene pipe with internal diameters of 50 mm and 30 mm. A 80° bend was created by heat shaping the 30 mm pipe and a 105° bend with an elbow in the 50 mm pipe. Haustral folds were created by heat shaping in both pipes. The final length of each pipe was 52 cm.
To simulate polyps, a material with suitable attenuation (density) corresponding to soft tissue (30 - 80 HU) that sticks firmly to the casing was required (2).
From the materials tested we chose silicone sealant as it has appropriate attenuation, can be processed easily and has satisfactory adherence. We attached 39 sessile polyps with a target size of 6-10 mm and two flat lesions onto the internal wall of the two pipes. Nine of the polyps were attached to a fold.
To ensure maximal reproducibility of intraluminal content, we simulated tagged stool by mixing iodine contrast material (Iomeron 350, Mallinckrodt Deutschland, Hennef, Germany) with canned baby food at a ratio of 1:40.
The pipes were placed in a 30 cm wide barrel and secured in place so that they would not float. The barrel was filled with water, closed by a water-tight lid and placed in a plastic container to prevent any damage to the scanner in case of leakage. The phantom was then scanned on a 256-slice scanner (Brilliance iCT 256; Philips Healthcare, Best, The Netherlands) with a standard abdominal protocol (peak voltage, 120kV; tube current-time product, 120mAs,; rotation time, 0.75s; pitch, 0.60; collimation, 128×0.625 mm, no modulation) and the images were reconstructed in thin 0.9 mm sections. The images were reviewed on an advanced workstation (Philips Intellispace Portal, Philips Healthcare, Best, The Netherlands) using a dedicated CTC package with computer aided diagnosis (CAD). The size and density of each simulated polyp in the phantom was measured by a reader blinded to distribution of polyps and compared with 39 intermediate sessile polyps found in patients referred for CTC (14 males, 25 females, mean age 65 ± 12 years). This group was used only for validation of density and size of simulated polyps and measurement of water-equivalent diameter (WED) in the pelvis.
A literature search of PubMed was conducted using keywords arranged in the following phrase “((virtual colonoscopy) or colonography) and CT) and phantom)”.
Statistical analyses were performed in GraphPad Prism (Graphpad Software, Inc., San Diego, CA, USA). The size and density of polyps were compared using t-test. A P value below 0.05 was considered significant.
4. Results
We constructed and validated a reproducible phantom for CTC using materials with similar attenuation to human colon (Figure 1). The average diameter of sessile polyps was 8.6 ± 0. 9 mm vs. 8.5 ± 1.2 mm (P = 0.75) in the phantom vs. patients and their attenuation was 53 ± 24 HU vs. 52 ± 15 HU (P = 0.69). All polyps except one flat lesion were detected by CAD (Figure 2-4). The average WED measured in pelvis in patients was 28.7 cm (ranged 24.7 to 36.2 mm) and the WED of the barrel was 29.1 cm (when the empty “colon” was inserted) or 29.6 cm (with tagged stool).
Virtual endoscopic (A,C) and fillet view (B,D) of the colonic phantom show several sessile polyps (arrowheads) and a flat lesion (arrow). Correct density of polyps is confirmed by translucency rendering (C) that shows red color, which represents soft tissue (so called “hot lesion”). Polyp candidates found by computer aided detection are marked blue (D).
The literature search yielded 74 results, 68 in English, from which 51 dealt with specific phantoms for CTC with simulated colonic lesions. Because several phantoms were used repeatedly and phantom designs were reused with slight modifications, only basic designs have been summarized in Table 1.
Phantom Design, Casing | Polyps | Insufflation | Reproducibility | Advantages | Disadvantages |
---|---|---|---|---|---|
Simulation | |||||
Digital synthesis from CTC data (3) | Digital synthesis | - | - | Polyps of any size, shape and density, genuine colon anatomy | Requires special software, cannot be used for low-dose testing |
Ex vivo | |||||
Porcine colon (4) | Wax | Yes | Poor | Readily available, polyps in different shapes can be easily created | Needs insufflation, deteriorates rapidly, low density of wax polyps (-16 HU) |
Porcine colon (5-7) | Puckering the mucosa with securing suture | Yes | Poor | Readily available, appropriate density of polyps | Needs insufflation, deteriorates rapidly, draping of adjacent mucosa |
Colonic polyposis colectomy specimen (8) | Natural | Yes | Poor | Colon with natural polyps | Size of polyps cannot be controlled, deteriorates rapidly, very limited availability |
Flexible materials | |||||
Latex balloon (9) | Ham (meat) | Yes | Poor | Easy construction | Poor reproducibility, needs insufflation |
Stereolithography (silicone) (10) | Silicone | Yes | Average | Genuine anatomy of the colon with large and small structures | Soft-walled model, needs insufflation |
Thermoreversible flexible plastic material (Dubliplast) (11, 12) | Thermoreversible flexible plastic material (Dubliplast) | No | Excellent | Molding of various shapes including haustral folds and polyps, correct attenuation (45 HU) | Elastic material needs supporting structure, straight without bends |
Silastic (silicone rubber) (13, 14) | Unknown material, low density on image | No | Excellent | Reproducible | High density of the wall (200 HU), low density of polyps, needs supporting structure |
Rigid tubing | |||||
Plexiglass (15, 16) | Plexiglass | No | Excellent | Several diameters of tubes | No bends ± haustral folds, high density (150HU), thick wall (2, 8, and 11 mm) |
Acrylic tube (17, 18) | Acrylic, plasticine | No | Excellent | Three diameters of tubes | No bends or haustral folds, thick wall (5 mm) |
Glass (borosilicate) (19, 20) | Solid water, epoxy resin | No | Excellent | Excellent reproducibility, various shapes of the colon and polyps in different shapes can be easily created | Thick dense wall of the colon, fragile material, polyps made of solid water have low density |
Commissioned, undisclosed material (21) | Undisclosed material with density of 10 HU | No | Excellent | Reproducible | No polyps on haustral folds, minimum polyp size 8 mm, low density of walls and polyps |
PVC pipe (22) | Glass beads | No | Excellent | Reproducible | High density of the wall |
Corrugated plastic tubing (23, 24) | Wood | No | Excellent | Easy construction | Corrugation is too fine to mimic haustral folds, low density of polyps (-370 HU) and tubing |
PP pipe (this study) | Silicone | No | Excellent | Reproducible, soft-tissue attenuation, easy shaping of polyps | Opaque |
Comparison of Colonic Phantoms for CT Colonography Previously Reported in the Literature
5. Discussion
In this study, we constructed and validated colonic phantom with intermediate polyps needed for testing the diagnostic performance of various CT scanners in low-dose CTC.
The current literature holds that there is a six-level hierarchy to test the efficacy of diagnostic imaging tests beginning with technical performance, diagnostic performance, contribution to clinical diagnosis, improvement in treatment and outcome of patients and finally societal value at the very top (1). The technical performance of an imaging test can be measured directly. Image quality at different dose levels can be compared among different CT scanners using basic phantom modules for the assessment of low-contrast and high-contrast resolution, spatial resolution or by its evaluation by independent observers (25, 26). However, to test the diagnostic performance, i.e. how the method can detect a disease, a reference standard with known performance is needed. This can be performed on phantoms with simulated disease (polyp, mass, pulmonary nodule), animals with induced disease or human subjects with a disease established by a superior method. Even though testing diagnostic performance on patients has the greatest validity, it can hardly be used for comparison of different CT scanners, because the patient would have to be scanned several times. Practical applications of a dedicated CT colonography phantom include: 1. optimization of acquisition protocol (tube voltage, tube current, slice thickness and radiation dose in general) and the reconstruction technique (filtered back projection vs. iterative reconstruction techniques), 2. optimization of stool tagging and electronic cleansing (including dual energy), 3. optimization and benchmarking of CAD, 4. interscanner comparison of image quality and diagnostic performance vs. radiation dose.
Several designs of colonic phantoms reported in literature are summarized in Table 1. The most popular phantoms, those used repeatedly or by several research groups included ex vivo porcine colon or colonic polyposis colectomy specimen, glass, plexiglass and plastic tube phantoms. Ex vivo colon is available from abattoir, it provides genuine anatomic detail and attenuation and colonic lesions can be easily created by ligation of the mucosa. But it needs inflation that results in shape variability and deteriorates rapidly. Therefore, it cannot be used for interscanner comparison that would require absolutely constant shape, position and distension, which has been shown to affect polyp detectability (27). Glass and plexiglass have high attenuation (~150 HU) and a thick wall, but they are transparent, maintain their shape and do not require inflation. Plastic tube phantoms come in different shapes and are made of different materials. Commercially available corrugated Polyvinylchloride (PVC) tubing contains only small indentations that allow easy bending without compromising the flow, therefore its resemblance of haustral folds is very limited. Ordinary running pipes are usually made of PVC or polypropylene and their attenuation varies according to processing and additives. They maintain their shape when submerged and bends can be formed by heat molding or connecting a shoulder. If the phantom is straight, distribution of lesions in different planes can be achieved by repositioning with repeated scanning. Flexible plastic materials that can be easily shaped by casting need supporting structure, so that they do not collapse when submerged.
From the presented colonic models, it is important to show that neither of them had soft-tissue attenuation of the colonic wall and polyps and high reproducibility at the same time. In our phantom, we used two different internal diameters representing a colonic segment with excellent and poor (but still evaluable) distension. Creating bends in a colonic phantom is necessary for distribution of polyps in all three dimensions in one scan. It also results in variation of the amount of water-equivalent attenuation in different parts of the phantom as encountered in patients. The average WED measured in patients was nearly identical to the WED of the phantom. However, bony structures in the pelvis contribute to image deterioration more than the equivalent amount of water.
Attenuation of colonic polyps is of importance. Polyps with lower density are more prone to disappear in the electronic noise in low-dose studies, especially if the reader prefers increasing the endoluminal rendering threshold (attenuation value above which voxels appear as colonic wall instead of intraluminal air), whereas polyps with too high density may escape CAD detection (25, 28).
The likelihood of a polyp to harbor malignancy depends on its size (29). It is unlikely for a diminutive polyp (< 6 mm) to contain high grade dysplasia and such polyps do not need to be reported (30-32). Therefore, phantoms for CTC are designed with polyps from 6 mm in diameter and upwards. Intermediate polys (6 - 10 mm) constitute a benchmark for CTC for polyp detection and their discrimination from stool residue. Flat lesions that escape detection more often than sessile polyps are less frequent and they pose a challenge even to CAD and therefore only two of them were included in the phantom. The number of polyps was chosen to be reasonable for reporting and with regard to statistics and memory washout so that locations of the polyps would be difficult to remember. In the process of evaluating studies, care should be taken to minimize recall bias by making sufficiently long intervals between reading sessions.
The phantom presented in this paper was validated with unenhanced CTC in patients with intermediate polyps. The phantom can be scanned empty or with simulated stool with tagging so as to reflect standard preparation protocols. To compare polyp detection among different scanners, the same mixture must always be used. This can be achieved using standard compounds (such as magnesium aluminum silicate or canned food for babies) mixed with tagging agents such as iodine contrast material or barium in constant proportion (14). However, reproducible distribution of simulated stool residue across the phantom cannot be guaranteed (Figure 4).
Scanner settings affect image quality, especially in low-dose acquisitions. Although a slice thickness of 2.5 mm is the recommended maximum, thinner slices are commonly used for a more accurate depiction of internal structure of a polyp candidate (28, 33).
Although polyp detection and polyp conspicuity are important, this can be to a great extent assisted by CAD (34). However, what shows expertise in CTC is the ability and confidence in discriminating between true polyps and polyp mimics such as stool residue and folds (35).
This study had several limitations. The attenuation of the phantom wall could not be reliably measured due to partial volume averaging. Therefore, its density was compared to the density of simulated polyps. Another limitation is that in real conditions the attenuation of body is inhomogeneous, especially in regions with bony structures such as spine and pelvis, constituting a limit for low dose imaging (25, 28).
In conclusion, we designed and verified a CT colonography phantom with 39 intermediate polyps and two flat lesions of soft tissue attenuation. Furthermore, we discussed limitations of previously reported models for reproducibility, attenuation, durability and other properties needed to ensure their correctness when comparing performance of different CT scanners.