Volume 9 Supplement 1
A hierarchical method based on active shape models and directed Hough transform for segmentation of noisy biomedical images; application in segmentation of pelvic X-ray images
© Smith et al; licensee BioMed Central Ltd. 2009
Published: 3 November 2009
Traumatic pelvic injuries are often associated with severe, life-threatening hemorrhage, and immediate medical treatment is therefore vital. However, patient prognosis depends heavily on the type, location and severity of the bone fracture, and the complexity of the pelvic structure presents diagnostic challenges. Automated fracture detection from initial patient X-ray images can assist physicians in rapid diagnosis and treatment, and a first and crucial step of such a method is to segment key bone structures within the pelvis; these structures can then be analyzed for specific fracture characteristics. Active Shape Model has been applied for this task in other bone structures but requires manual initialization by the user. This paper describes a algorithm for automatic initialization and segmentation of key pelvic structures - the iliac crests, pelvic ring, left and right pubis and femurs - using a hierarchical approach that combines directed Hough transform and Active Shape Models.
Performance of the automated algorithm is compared with results obtained via manual initialization. An error measures is calculated based on the shapes detected with each method and the gold standard shapes. ANOVA results on these error measures show that the automated algorithm performs at least as well as the manual method. Visual inspection by two radiologists and one trauma surgeon also indicates generally accurate performance.
The hierarchical algorithm described in this paper automatically detects and segments key structures from pelvic X-rays. Unlike various other x-ray segmentation methods, it does not require manual initialization or input. Moreover, it handles the inconsistencies between x-ray images in a clinical environment and performs successfully in the presence of fracture. This method and the segmentation results provide a valuable base for future work in fracture detection.
Prompt and appropriate treatment of pelvic injury is vital to patient survival. Pelvic fractures are among the most life-threatening injuries that can be suffered by a major trauma patient. They are strongly associated with impact injuries, particularly moving vehicle accidents. One six-year case study of 119 male pelvic trauma patients at a large level 1 trauma center found that 42.8% of fractures were caused by motor vehicle collisions (MVC) . Other mechanisms causing pelvic disruption include falls from a height (30%) and crush injury under heavy weights (10%) . Fractures can also cause laceration of the surrounding soft tissue and neural and vascular structures, and involve neighboring structures such as the urogenital system, leading to very complex injuries and a high mortality rate. Pelvic injuries caused by high-energy impacts that destroy the integrity of the pelvic ring are associated with a mortality rate of between 5 and 20% , and many of those who survive suffer permanent disability. Acetabular fractures, although not as potentially life threatening, are also associated with significant morbidity .
In polytraumatized patients, the ATLS Guidelines recommed pelvic x-ray imaging as a vital first diagnostic step . The process is fast, cheap, and causes relatively little disturbance to the injured patient. The resulting x-ray image can quickly reveal the extent of damage to the bone structure of the pelvis, such as fracture, pelvic ring disruption, and widening of the pubic bone gap. However, the structure of the pelvis is complex, and fractures may be hard to recognize on low resolution x-rays; discussion with physicians suggested uncertainty even among medical professionals. This suggests that a system capable of quickly identifying pelvic fracture would prove valuable in a trauma center environment. Since fracture location has considerable impact on both severity and treatment of the injury, as well as the appearance of the fracture in a radiograph image, the first step in constructing such a system is to correctly segment the pelvis into distinct regions. This paper focuses on detection of the left and right iliac crests, the pelvic ring, the left and right femurs and the left and right pubis. By isolating and separating these three structures within x-ray images, we build a valuable base for future automatic fracture identification. More importantly, our algorithm is entirely automated, unlike other x-ray segmentation methods which require the user to manually initialization detection for each structure.
Multiple previous studies have focused on the segmentation of MRI and CT images, including those of the pelvic and abdominal areas [5, 6]. However, compared to other radiological imaging modalities, segmentation of x-rays has not been as widely researched. This may be due to the additional complexities involved in radiograph imaging. Different tissues may have similar absorption rates, leading to blurred edges and a lack of detail . Delineating bone matter from soft tissue can also be challenging due to low contrast, particularly when multiple bones overlap. This is especially problematic in pelvic radiographs, as the femurs overlap with the main structure of the pelvis . Pelvic x-rays are prone to another specific complication: the prescence of gas inside the colon, which causes dark shadows to appear over the iliac fossa. 
One early attempt at radiograph segmentation by Manos  employed region growing and merging according to size, similarity, and connectivity. The generated regions were then labeled according to their grey level information. This approach was limited, however, as it considered neither spatial information nor existing knowledge of anatomy. Other early studies considered the problem of identifying lung regions in chest radiographs. Vittitoe  applied Markov random field models, while Duryea  and Pietka  used rule-based heuristics. The same problem was addressed by McNitt-Gray , instead using a classifier approach; each pixel was placed into one of several anatomic classes according to various locally calculated features.
More recent efforts have focused on the use of deformable models, due to their ability to segment complex structures and account for real-world variability in shape and appearance. A learning-based model approach can incorporate prior knowledge of the problem, and learn the variation from a set of annotated training examples. Two specific learning-based algorithms, Active Shape Model (ASM) and Active Appearance Model (AAM), have proven successful in segmenting CT, MRI, and x-ray images [15–17]. Boukala  successfully applied the ASM algorithm to pelvic x-rays; however, individual structures were not segmented, and the focus was on pathological deformities in hip replacement patients, rather than pelvic fractures sustained in traumatic injury.
The data was provided by Carolinas Healthcare System (CHS), and consisted of 20 pelvic fracture patients and 52 x-ray images (pre- and post-surgery). The full dataset, including post-operative patients, was used to calculate a probability distribution for femoral shaft and head size, as described later in the paper. The dataset was then filtered to include only those x-rays taken upon the patient's initial arrival at the hospital, prior to surgery and internal fixation, to be used for training the segmentation algorithm. This set contained 25 images. All x-rays were resized to a standard width of 1000 pixels, though image height varied across the set. Due to the significant differences in pelvic anatomy between male and female patients, we chose to focus on male patients. The user of the final system would therefore specify the patient's gender before segmentation can be performed; however, this information is readily available and should not complicate the process in a trauma center environment. The training set consisted of 5 patients (7 images), and the test set contained 15 patients (18 images). We anticpated that our algorithm can handle female patients using simple changes to initialization that account for the anatomical differences.
Detection of femoral shafts
where ρ is the normal distance from the origin to the line, and θ is the angle between the normal and the x-axis.
where d j is the distance between the inner contours of the left and right femoral shafts. The shaft pair with the highest value of p j represents the final detected shaft position.
Detection of femoral heads
The approximate positions of the femoral heads are now known, and used to initialize the active shape algorithm for detection of the combined femur structure.
General active shape model algorithm
where P contains the t eigenvectors of the covariance matrix, and b is a t-dimensional vector which defines the parameters for the deformable model. A limit is placed on the possible change in b, to ensure that the generated shape is similar to the shapes in the training set.
The pixel with the lowest value of f(g s ) is the new "best" position for the model point; this is repeated for each point. The shape parameters b are then updated to fit these new positions. The algorithm halts when an iteration results in no significant changes in b.
ASM for femur, pelvic ring and pubis detection
Identifying the femurs in turn allows for correct initialization of the ASM shape for the pelvic ring; across all training images, it was found that the femoral heads and pelvic ring are typically <100 pixels apart horizontally. The uppermost landmark on the ASM model for each femoral head was selected as a ring reference point, and a horizontal search for the largest intensity gradient value was perfomed across a +100 pixel range from this point. A sudden change in grayscale intensity corresponds to the inside edge of the pelvic ring; the pixel with the largest value is recorded as a pelvic ring initialization point. After this is repeated for both femurs, the two initialization points are used in initializing the ASM shape for pelvic ring detection. Note that prior detection of the femurs is vital; the pelvic ring alone cannot be used as a reference structure for segmentation, as its horizontal and vertical position in the x-ray image is unknown. In the training phase, 30 landmarks are used to describe the pelvic ring; as with the femur model shape, these are a mixture of structural and auxiliary points. In this case, only 10 pixels either side of the profile point are searched, to prevent the shape from aligning to the internal gaps in the pubic bones beneath the pelvic ring. Shape parameter change is again limited to 4σ.
The ASM detected position of the pelvic ring is then used to initialize ASM for detection of the left and right pubis, via the use of control points along the base of the ring. In this case, 23 landmark points describe the outer edge of the pubis bone, and 8 landmarks describe the inner edge. Shape parameter change is limited to 3σ and 15 pixels are searched either side of each profile point.
Since speed is important in a medical trauma environment, our approach employs a multi-resolution version of the ASM algorithm. Each training and test image is decomposed into multiple lower resolution images, each a smoothed and subsampled version of the last; these correspond to levels of a Gaussian pyramid. The search for the desired shape begins at the highest level: the lowest resolution image. When the ASM algorithm converges at a specific level - i.e. there is no significant change in the model points - the next highest resolution image is used. In this way, the location of the identified shape is refined over progessively higher resolutions. The original image is considered only at the final stage of the process, when only slight changes are expected in the model point positions. The algorithm in this paper uses 3 levels for detection of the pelvic ring, as its simple shape remains intact at the lowest image resolution. When using ASM to detect the femurs and pubis, it was found that the model shapes suffered considerable distortion at low resolutions, and therefore 2 levels were used. For detection of the iliac crests, only one level was used.
Detection of iliac crests
The left and right iliac crests are typically circular, and directed Hough transform can therefore be used to detect their approximate location. However, depending on the patient pose angle, one crest may appear hooked, rather than circular. Analysis of the dataset revealed that at least one the crests was always detected. This is intuitive from knowledge of pelvic structure; within the expected range of patient rotation angles, at no point would both crests become distorted. Analysis also supported the assumption of approximate symmetry about the pelvic ring. Therefore, the position of the detected crest can be used to determine the position of the undetected crest. Once directed Hough transform has determined the approximate location of an iliac crest, the ASM starting shape is initialized using a specific reference point on the Hough transform circle, as well as knowledge of the pelvic ring position. The iliac crest shape is described by 22 points, shape parameter change is limited to 5σ, and 35 pixels are searched either side of each profile point. As with all selected ASM parameters, these values were determined empirically.
Results and discussion
Since the purpose of the hierarchical algorithm described in this paper is to automatically initialization detection of key pelvic structures, performance is compared versus manually initialized ASM. This second set of examples is generated by a user manually placing the ASM template within the desired structure in the x-ray image, and then running the ASM algorithm. Since our algorithm is designed for hierarchical automated initialization of ASM, our primary concern is how it performs versus manual initialization, rather than how ASM itself performs on the pelvic structures. Note that in several cases, ASM is insufficient to correctly detect structures regardless of initialization; we are further developing a form of ASM that maintains shape curvature and offers greater control over deformation.
The same error measure is calculated for the reference shape and the shape detected via manually-initialized ASM. ANOVA is then performed for all three structures to determine whether there is a significant difference between results obtained via manual initialization and results obtained using our hierarchical automatic initialization algorithm.
Visual inspection results
Left Iliac Crest
Detection of the pubis bones, however, is less accurate; this may be due to the reason described above.
The results of our algorithm on test images are promising, and the hierarchical approach greatly aids in correct initialization of the ASM shape algorithm.
Despite occasionally poor detecton of contours, it can be observed in all images that the general position of each structures was correctly determined. This will allow each area to be analyzed for specific fracture characteristics. Furthermore, the similarity in results between our automatic algorithm and manual initialization suggests that the detection issues are due to ASM itself. Independently of this, ANOVA results indicate that our automatic initialization algorithm performs at least as well as manual initialization in detection and segmentation of key pelvic structures.
As evaluated by two radiologists and one trauma surgeon, detection of the crests, the ring, and the femurs was generally accurate in almost all cases. Detection of the pubis proved more of a challenge, but we intend to use more control points to control placement and perhaps prior deformation of the template shape before performing ASM detection. In some cases, artifacts on the x-rays caused the detection of false edges; if these can be distinguished from bone, possibly via texture analysis, these false edges can be avoided. The algorithm performs fairly well in the presence of background intensity variations. In Figure 9 it can be seen that the detection of the iliac crests was successful despite the dark edges of the structure compared to other example images. This indicates that the preprocessing of the images was successful in alleviating brightness and constrast variations. Background soft tissue, which can display similar intensity statistics to bone, was also correctly excluded from the segmentation results. Though there is frequent noise and intensity variation within the pelvic ring area, this structure was also successfully detected. Improvements can be made to the algorithm to compensate for the significant histogram differences between images. This preprocessing would naturally be automatic, to be integrated fully into the existing system.
Our method is fully automated, and, excluding the need for labelled training examples, no input is required from the user. The number of training examples required is also relatively low. As our dataset consists of pelvic injury patients, we have observed that the algorithm performs well in the presence of fracture. By isolating specific pelvic regions, we can then search these areas for fracture via such methods as texture analysis. Exceptions will occur when the pelvic ring is completely disrupted or the femurs are severely fractured. However, these injuries are so severe and so clearly visible that it is unlikely our system would be necessary.
Fractures of the pubis may be challenging to detect using our method in its current form, as the superior ramus and inferior ramus can break into two separate parts. This creates a gap in the bone edge. However, ASM may actually aid in detecting such fractures. if we are able to superimpose the general shape on the x-ray, we will be able to detect sudden dark spots (i.e. gaps) along the bone edge. The success of this approach will depend on alterations made to the fitness function, to better preserve the shape of the pubis in the presence of significant edge disruption.
Time complexity for the algorithm is acceptable; when tested on an Intel quad-core machine with 4 GB RAM, running time for a single image was approximately 1 minute. As the most time-consuming step is Hough circle detection, it is likely that the running time can be decreased by reducing the range of radii searched. This can be achieved by modelling the ratio of femoral head radius to femoral shaft width as a Gaussian, as outlined in , and searching the 95th percentile of the normal cove. We believe the same approach will apply to Hough detection of the iliac crests; preliminary analysis of the dataset suggests a relationship between crest radius and pelvic ring width. The ASM steps were quickly completed, which is likely due to the multi-resolution approach.
Although training is required for the algorithm to perform successfully, based on the current approach we anticipate it would need to be performed once per x-ray machine, in order to take account of differences in grey-scale range and intensity. Note that once these differences are equalized via preprocessing - an area we are currently exploring - training could be done offsite, using a separate database of past patients, prior to deployment of the system.
This paper provides a automated hierarchical method for segmentation of key structures from pelvic x-ray images: the iliac crests, the femurs, the pelvic ring and the pubis bones. First, directed Hough transform is used to detect the femur shafts, and so correctly determine the patient's horizontal position within the image. Hough transform is then combined with ASM to detect the femur - and in turn, the acetabulum. The position of the femurs is used to initialize ASM for pelvic ring detection, and the location of the pelvic ring is then used to initialize ASM for the pubis bones and to direct Hough transform for detection of the iliac crests. After the general position of the crests is known, ASM is applied. Our method offers several improvements over existing approaches. First, and most crucially, it is entirely automatic, requiring no user input other than specifying the patient's gender. It also performs accurately in the presence of fracture and deals with several issues affecting x-ray imaging in a clinical environment; specifically, uncertain pose angle and position of patient, and greyscale variations caused by differences between x-ray machines.
Future work will focus on refinement of the algorithm, particularly in dealing with a wider range of patient pose angles. As future work, we will also incorporate the Hough transform results into the active shape model algorithm for weighting, as well as for initialization of the starting shape. The Active Appearance Model algorithm (AAM) will also be tested for comparision; this has also been used within the literature for segmentation of medical images. We also plan to more finely control the deformation of the ASM template via the use of splines for maintaining curvature. After the segmentation process has been refined, work will begin on fracture detection within the identified structures. This will be integrated into a more comprehensive system under development, where details of fracture type and severity can be combined with physiological and demographic information to provide accurate diagnostic recommendation to physicians.
This material is based upon work supported by the National Science Foundation under Grant No. IIS0758410. The dataset used was obtained from Carolinas HealthCare System. The authors would also like to thank Scott Smith for his valuable feedback and discussion on this work.
This article has been published as part of BMC Medical Informatics and Decision Making Volume 9, Supplement 1, 2009: 2008 International Workshop on Biomedical and Health Informatics. The full contents of the supplement are available online at http://www.biomedcentral.com/1472-6947/9?issue=S1.
- Basta A, Blackmore C, Wessells H: Predicting urethral injury from pelvic fracture patterns in male patients with blunt trauma. J Urology. 2007, 177 (2): 571-575.View ArticleGoogle Scholar
- Schmal H, Markmiller M, Mehlhorn A, Sudkamp N: Epidemiology and outcome of complex pelvic injury. Acta Orthopaedica Belgica. 2005, 71:Google Scholar
- Tan S, Porter K: Free fall trauma. J Trauma. 2006, 8 (3): 157-167.View ArticleGoogle Scholar
- ACOS: ATLS Advanced Trauma Life Support Program for Doctors. 2004, American College of Surgeons, 7Google Scholar
- Haas B, Coradi T, Scholz M, Kunz P, Huber M, Oppitz U, Andre L, Lengkeek V, Huyskens D, van Esch A, Reddick R: Automatic segmentation of thoracic and pelvic CT images for radiotherapy planning using implicit anatomic knowledge and organ-specific segmentation strategies. Phys Med Biol. 2008, 53 (6): 1751-71.View ArticlePubMedGoogle Scholar
- Pasquier D, Lacornerie T, Vermandel M, Rousseau J, Lartigau E, Betrouni N: Automatic segmentation of pelvic structures from magnetic resonance images for prostate cancer radiotherapy. Int J Radiat Oncol Biol Phys. 2007, 68 (2): 592-600.View ArticlePubMedGoogle Scholar
- Kane SA: Introduction to Physics in Modern Medicine. 2002, CRCGoogle Scholar
- Ding F, Leow WK, Howe TS: Automatic segmentation of femur bones in anterior-posterior pelvis x-ray images. Computer Analysis of Images and Patterns. 2007, 4673: 205-212.Google Scholar
- Begg JD: Abdominal X-Rays Made Easy. 2006, Churchill Livingstone, 2Google Scholar
- Manos G, Cairns A, Rickets I, Sinclair D: Segmenting radiographs of the hand and wrist. Computer Methods and Programs in Biomedicine. 1993, 43 (3-4): 227-237.View ArticleGoogle Scholar
- Vittitoe N: Identification of lung regions in chest radiographs using Markov random field modeling. Medical Physics. 1998, 25 (6): 976-985.View ArticlePubMedGoogle Scholar
- Duryea J, Boone J: A fully automated algorithm for the segmentation of lung fields on digital chest radiographic images. Medical Phys. 1995, 22 (2): 183-191.View ArticleGoogle Scholar
- Pietka E: Lung segmentation in digital radiographs. Journal of Digital Imaging. 1994, 7 (2): 79-84.View ArticlePubMedGoogle Scholar
- McNitt-Gray M, Huang H, Sayre J: Feature selection in the pattern classification problem of digital chest radiograph segmentation. IEEE Trans. on Medical Imaging. 1995, 14 (3): 537-547.View ArticlePubMedGoogle Scholar
- Chen Y, Ee X, Leow WK, Howe TS: Automatic extraction of femur contours from hip x-ray images. Computer Vision for Biomedical Image Applications. 2005, 3765: 200-209.View ArticleGoogle Scholar
- MG R, Cootes T, Adams J: Vertebral morphometry: semiautomatic determination of detailed shape from dual-energy X-ray absorptiometry images using active appearance models. Invest Radiol. 2006, 41 (12): 849-859.View ArticleGoogle Scholar
- Behiels G, Vandermeulen D, Maes F, Suetens P, Dewaele P: Active Shape Model-Based Segmentation of Digital X-ray Images. MICCAI '99: Proceedings of the Second International Conference on Medical Image Computing and Computer-Assisted Intervention. 1999, 128-137.View ArticleGoogle Scholar
- Boukala N, Favier E, Laget B, Radeva P: Active shape model based segmentation of bone structures in hip radiographs. Industrial Technology. 2004, 3: 1682-1687. . IEEE ICIT '04. 2004 IEEE International Conference on 2004Google Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.