Correction
8 Nov 2012: Daboul A, Schwahn C, Schaffner G, Soehnel S, Samietz S, et al. (2012) Correction: Reproducibility of Frankfort Horizontal Plane on 3D Multi-Planar Reconstructed MR Images. PLOS ONE 7(11): 10.1371/annotation/6bc54ac4-3639-447d-92bc-dad0ddb24c1e. https://doi.org/10.1371/annotation/6bc54ac4-3639-447d-92bc-dad0ddb24c1e View correction
Figures
Abstract
Objective
The purpose of this study was to determine the accuracy and reliability of Frankfort horizontal plane identification using displays of multi-planar reconstructed MRI images, and propose it as a sufficiently stable and standardized reference plane for craniofacial structures.
Materials and Methods
MRI images of 43 subjects were obtained from the longitudinal population based cohort study SHIP-2 using a T1-weighted 3D sequence. Five examiners independently identified the three landmarks that form FH plane. Intra-examiner reproducibility and inter-examiner reliability, correlation coefficients (ICC), coefficient of variability and Bland-Altman plots were obtained for all landmarks coordinates to assess reproducibility. Intra-examiner reproducibility and inter-examiner reliability in terms of location and plane angulation were also assessed.
Results
Intra- and inter-examiner reliabilities for X, Y and Z coordinates of all three landmarks were excellent with ICC values ranging from 0.914 to 0.998. Differences among examiners were more in X and Z than in Y dimensions. The Bland–Altman analysis demonstrated excellent intra- as well as inter-examiner agreement between examiners in all coordinates for all landmarks. Intra-examiner reproducibility and inter-examiner reliability of the three landmarks in terms of distance showed mean differences between 1.3 to 2.9 mm, Mean differences in plane angulation were between 1.0° to 1.5° among examiners.
Citation: Daboul A, Schwahn C, Schaffner G, Soehnel S, Samietz S, Aljaghsi A, et al. (2012) Reproducibility of Frankfort Horizontal Plane on 3D Multi-Planar Reconstructed MR Images. PLoS ONE 7(10): e48281. https://doi.org/10.1371/journal.pone.0048281
Editor: Michael Glogauer, University of Toronto, Canada
Received: May 23, 2012; Accepted: September 21, 2012; Published: October 31, 2012
Copyright: © 2012 Daboul et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The present work has been supported by a joint grant from Siemens Healthcare (Siemens, Erlangen, Germany) and the Federal State of Mecklenburg-West Pomerania. The University of Greifswald is a member of the ‘Center of Knowledge Interchange’ program of Siemens AG. SHIP is part of the Community Medicine Research net of the University of Greifswald, Germany, which is funded by the Federal Ministry of Education and Research (grants no. 01ZZ9603, 01ZZ0103, and 01ZZ0403), the Ministry of Cultural Affairs and the Social Ministry of the Federal State of Mecklenburg-West Pomerania. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have the following interests. The present work has been supported by a joint grant from Siemens Healthcare (Siemens, Erlangen, Germany) and the Federal State of Mecklenburg-West Pomerania. The University of Greifswald is a member of the ‘Center of Knowledge Interchange’ program of Siemens AG. A whole-body 1.5 Tesla MR system (Magnetom Avanto; Siemens Medical Solutions, Erlangen, Germany) was used in this study. There are no further patents, products in development or marketed products to declare. This does not alter the authors’ adherence to all the PLOS ONE policies on sharing data and materials, as detailed online in the guide for authors.
Introduction
Since the development of magnetic resonance imaging (MRI), it has been increasingly used for medical diagnosis as an imaging modality with no ionizing radiation. In dentistry, MRI has been used to evaluate the temporomandibular joint, orofacial tissues, implant planning and in longitudinal studies analyzing craniofacial structures. [1]–[7] MRI has been shown to enable accurate and reproducible three-dimensional measurements of the craniofacial skeleton due to the contrast between the bone and the surrounding soft tissue [8], that allows us to evaluate the craniofacial morphology which is difficult to identify with cephalometric radiography.
a) Left Porion. b) Right Porion. c) Left Orbitale.
In three-dimensional (3D) analysis of the craniofacial area, different structures are measured with regard to lines or reference planes. Generally, these reference planes are based on anatomical landmarks that are traditionally used for cephalometric measurements. [9]–[13] Since the validity of craniofacial analysis and measurements depend highly on the accuracy and reliability of the reference plane used, the identification and reproducibility of the reference plane landmarks should be verified in each imaging modality. Furthermore, several factors that contribute to the reliability of landmark identification have to be considered, factors such as scan parameters, quality of images, training level or experience of the examiners, definition of the landmark and anatomic complexity will influence the magnitude of identification errors. [14]–[16].
Previous studies have recommended that every study should include an assessment of reproducibility [17], [18]. While this recommendation is not necessary in clinical studies, it is justified for research work where great precision is required. [19].
Gravely et al [20] concluded that Intra-examiner errors are generally lower than inter-examiner errors in landmarks identified on 2D cepahlometric images, and in a study conducted by Kragskov et al [21], it was suggested that landmarks detection on 3D CT images has less reliability than traditional 2D cephalometric images. Kragskov argued that the reason behind these findings was that distances calculated between points on 2D cephalograms consisted of two coordinates only in comparison to three coordinates for 3D CT images, thus adding an extra deviation. On the contrary, other studies have reported good reproducibility of craniofacial landmarks in 3D CT using phantoms and metallic markers. [22], [23] However, this approach demonstrates the accuracy of the imaging but does not simulate the clinical situation in which precision is influenced by the difficulty in identifying landmarks. [21].
The Frankfort Horizontal (FH) was originally introduced at an anthropological conference in Frankfurt, Germany in 1884. It was defined as a plane extending from the left Orbitale to both Porion points. [24] Since then, the plane has been widely recognized as a reference plane for the skull and has proved to be of great value in craniofacial studies and orthodontics. It has been presented in several studies as an adequate cranial base reference and was incorporated in anthropological studies, maxillofacial surgery planning and descriptive communications between clinicians. [25]–[28] However, in many of the previous studies in the craniofacial area, anatomical areas were studied based on FH plane visual estimation rather than landmark identification, FH landmark identification errors were not evaluated on images.
The purposes of the present study were to determine the accuracy and reliability of Frankfort horizontal plane identification using displays of multi- planar reconstructed MRI images, assess the reproducibility of its landmarks and propose it as a standardized reference plane for craniofacial measurements in MRI.
a) Horizontal and vertical lines were adjusted until the standard trans-porionic axis was observed. b) Balance between axial, coronal and sagittal axis adjusted to connect trans-porionic axis (purple) with Orbitale through a coronal axis (blue). c) Axial view through FH after connecting the 3 axes.
Materials and Methods
(a) Subjects and MRI Data Acquisition
This study was carried out on 43 subjects (26 f, 17 m), age between 26–78 years old (with a mean age ± standard deviation of 46.4±12.0) with normal skull shape. Subjects were randomly chosen from the longitudinal population based cohort study SHIP-2 [29], [30] at which the medical ethics committee of University of Greifswald approved the study protocol, and written informed consents were obtained from all the subjects who agreed to participate in the study.
MRI scans were performed in the SHIP center for clinical magnetic resonance research at the university of Greifswald using a whole-body 1.5 Tesla MR system (Magnetom Avanto; Siemens Medical Solutions, Erlangen, Germany). The protocol was identical for all participants and included axial T1-weighted ultra-fast gradient echo sequence (1.9/3.4 [repetition time ms/echo time ms]; flip angle 15°, 256 mm field of view, 1.0×1.0×1.0 mm voxel size and 176×256×176 acquisition matrix).
(b) Landmark Detection
For data analysis, an open source dicom viewer (OsiriX v3.8.1) was used on two workstations with 27 inch monitors (iMac Quad core i7; Apple Corp. Cupertino, CA, USA). 3D coordinates for each image were calculated from the DICOM headers which were based on the MRI scanner coordinates. Osirix determined the coordinates (x, y, z) for each voxel and converted the actual calculated size of voxels to millimeters.
In our MRi scans, the X-axis represented the right-left direction, the Y-axis and Z-axis corresponded to the posterior-anterior and superior-inferior directions respectively. This predetermined system of three axes is always the same when the same set of images is uploaded to the software. Since a selected point will give the same (x,y,z) value in any new rendered slice view, multi-planar reconstruction (MPR) was used to accurately identify the three landmarks that define FH plane. Sagittal, axial, and coronal rendered slices, as well as the 3D image reconstruction were used to determine the 3D positional coordinates of Left and right porion (Po) and left orbitale (Or) based on their anatomical position. (Fig. 1 & 2).
The color coded locaters in both coronal and axial view ports were used simultaneously to detect the most inferior point on the infraorbital rim, orbitale landmark was then located on the sagittal view port. In the same manner, the locater in the coronal view port was used to outline the soft tissue and bone above the external auditory meatus, porion landmark was then located on the corresponding sagittal view port as the most lateral point in a low signal intensity area.
Furthermore, the color-coded axis locaters on the three planar views were used for further view angle adjustments to locate FH accurately (Fig. 3).
(c) Evaluation of Reproducibility
Landmark coordinates for each image set were obtained by the main examiner two times in different sessions, and 1 time by 4 other examiners over a period of two weeks each, one week apart. All examiners were dentists and were previously trained in the use of Osirix software and craniofacial landmark identification. For investigator blinding, the images were identified by code and analyzed anonymously in random order.
a) In x coordinate of right Porion. The horizontal lines represent the mean within-pair difference (−0.32 for examiner 5– examiner 1), the mean ±1.96 standard deviations (1 SD = 1.70), and the mean ±1.96 SD ± square root (3*SD2/n) for 95% CIs of limits of mean ±1.96 standard deviations. b) In y coordinate of right Porion.
Intra-examiner Reproducibility was assessed by using intraclass correlation coefficients (ICC) for the main examiner measurements. ICC was also used to calculate inter-examiner reliability by comparing the main examiner mean trial with the measurements of the other 4 examiners. Following the recommendation by Shrout & Fleiss [31], ICC (2,1) was used to assess if the standardized reading procedure can be effectively used by a variety of readers.
Additionally, paired mean difference (D), standard deviation (SD), coefficient of variability and Bland-Altman plots were used as described and recommended by Szklo & Nieto. [32] The analyses and plots were performed using STATA/SE software, version 12.1 (StataCorp LP, College Station, Tex.).
In Bland-Altman plots, 95% confidence intervals (CI) of D–2S and D+2S were additionally drawn because only narrow 95% confidence interval reflect an appropriate sample size to detect reader differences. [33] Sample size calculation for these CIs in Bland-Altman plots are not available, therefore, we focused on the desired precision of ICC. The desired lower limit of 0.85 for ICCs of 0.90, 0.92, and 0.94 (interval widths of 0.10, 0.14, and 0.18, respectively) for 5 readers using the approximation given by Bonett [34] requires 36, 12, and 5 subjects, respectively. However, we decided to aim for 43 subjects because the interest is in the reliability of the plane rather than in those of a single coordinate.
a) in x coordinate of left Orbitale (the shown digit preference reflects the slice thickness of 1 mm) b) In y coordinate of left Orbitale.
To assess the reliability of the plane in terms of distance, the spherical distance d between two readings of the same point was calculated (square root from (x1– x2)2 + (y1– y2)2 + (z1– z2)2 with indices for the two readings). To assess the reliability of the plane in terms of angulation, the dihedral angle between the planes from two readings was calculated.
Results
The intra-examiner Reproducibility for each coordinate was greater than 0.94 in terms of ICC (Table 1). The 95% CIs were small with a lower limit of 0.85 indicating an excellent Reproducibility. The coefficients of variability were fairly low. The absolute systematic error (mean difference between both readings) for each Cartesian coordinate was lower than 1 mm. Systematic bias other than absolute error, such as proportional error, was graphically examined using Bland-Altman plots (not shown for intra-examiner Reproducibility). Intra-examiner reproducibility of the three landmarks in terms of distance showed mean differences between 1.3 to 2.4 mm (Table 2). Intra-examiner difference in the dihedral angle of FH was less than 3° for 97.7% of the readings with a mean of 1° (Table 3).
(Note the differences in the muscles cross sectional area between both views).
The inter-examiner reliability for each coordinate was greater than 0.90 in terms of ICC (Table 4). The 95% CIs were small with a lower limit of 0.90, indicating an excellent reliability. The coefficients of variability were fairly low. The absolute systematic error (mean difference to the first examiner) for each Cartesian coordinate in the three points was lower than 1.52 mm. Bland-Altman plots showed no conspicuous pattern except for the expected digit preference in the x coordinate (Fig. 4a & 5a). This digit preference for a whole number reflects clearly the slice thickness of 1 mm and was absent in y and z coordinates (Fig. 4b & 5b). The 95% CIs (dashed lines) for the lines of ±2 SD (solid lines) were small, reflecting the sufficient sample size and the relatively small variation of the differences. Inter-examiner reliability of the three landmarks in terms of distance showed mean differences between 1.3 to 2.9 mm (Table 2). Differences in the dihedral angle between each examiner and the first examiner readings of FH was less than 3° for 88.4% of the readings with mean differences between 1.1° to 1.5° (Table 3).
Discussion
Although FH plane is mentioned extensively in the literature as a reference plane for measuring craniofacial structures in MRI [35]–[38], no data have been published on its reproducibility. In this study, we evaluated the Intra- and Inter-examiner reproducibility of FH plane In MRI. We determined that this is important prior to its selection as a reference for cranial measurements, particularly in longitudinal studies that provide normative data for various craniofacial structures where any misjudgment in the reference plane may lead to false conclusions.
In the literature, many authors applied different methods to estimate FH inclination in relation to head posture. Machine ear rods, human skulls with metal markers were used to assist in its detection in cephalograms and CT. [11], [39]–[42] Pancherz et al [43], pointed out the high registration errors when a machine ear rod was used to identify porion point. They showed that ear rod markers gives Porion a soft tissue position (Po-m), which is unsuitable as a representation of the anatomical Porion (Po-a). It was concluded that the different locations of the two Porions will affect the angulation of FH and the measurements related to this reference line, subsequently, gross errors in the diagnosis and the treatment planning of orthodontic and surgical cases may result. In concordance with Pancherz et al study, Ludlow et al [44] reported high examiner variability in porion identification in conventional cephalograms and CT. They mentioned that identifying the mechanical location of porion could place this landmark more than 1 cm from its true anatomic position.
Photographs presented another approach of FH estimation accuracy [45], however, it was not possible to register the FH plane with a high degree of confidence on photographs, because this approach did not present the true clinical situation and the orbital rim could not be palpated and marked. Halazonetis et al [45] reported that direct comparison between the inclination of FH plane as measured from photographs or cephalometric radiographs was not valid.
In studies focusing on measuring craniofacial structures, FH plane was either estimated prior to MRI scans on the subject head while the subjects were in supine position [37], [38], or it was estimated perpendicular to the floor prior to CT scans. [46], [47] This approach might result in estimation errors and affect the accuracy of FH detection and the subsequent analysis, mainly because a simple head rotation would be enough to disturb the planned position of the head, making it difficult to maintain a horizontal plane angulation during scanning. Another shortcoming of FH estimation on subjects is the difference between the palpable landmarks and real landmarks on images. It was observed that the palpable soft tissue Frankfort plane (tragus-orbitale) was not parallel to the hard tissue Frankfort plane (porion-orbitale) and that the 2 planes show a deviation of 6° on average. [39] Our study was based on this consideration, since the majority of studies advocate the use of FH as a reference plane without questioning the differences between its detection on subjects heads and images and the consequent influence it carries on measuring craniofacial structures later on images. (Fig. 6).
Olszewski et al [10] studied the reproducibility of craniofacial landmarks and classified it into 4 groups based on the literature and the results of their study in CT. In their study, Porion was classified under mean inter-examiner reproducibility and Orbitale with low inter-examiner reproducibility. Later, in a study conducted by Lagravere et al [48], reproducibility of landmarks in Cephalograms and CT images was further assessed, in cephalograms, porion had moderate intra-examiner reliabilty for the y-axis (0.81) and mild inter-examiner reliability for the y-axis (0.46). In CT, Lagravere et al reported that right and left Porion showed the highest Intra-examiner mean differences in the X axis (2.62 and 3.37 mm, respectively) and high inter-examiner differences in the X axis in orbitale right and left (3.25 and 2.57 mm, respectively) and porion right and left (2.7 and 2.94 mm, respectively). Although differences in imaging modules, techniques and measurement methods make direct comparison of results reported in the literature on FH landmarks reproducibility rather unreliable, a general estimation on the 3D complexity of these landmarks can be concluded.
The results of our investigation showed that the examiner variability in detecting Porion (R/L) was slightly larger in the Sagittal plane than in the Axial and coronal planes. This observation is in accordance with that from other investigations [13], [44], [48] and it demonstrates the Medio-Lateral complexity of Porion in the MPR view due to its location on a widely curved bone. According to Ludlow et al [44] this variability in identifying porion is probably related to the inadequate definition of this landmark in the third dimension, they noted that while some examiners localized porion in the soft tissues of the ear canal, others localized it on the bone/soft tissue margin.
We attempted in this study to measure the variation in FH landmarks detection and the effect it carries on FH plane angulation. Differences in the 3D location of one of the landmarks caused up to 3° deviation of FH plane between examiners. Since variation in each of the three axes of a landmark will not contribute equally to its location, it may be difficult to establish which landmark is the primary contributor to the variability of FH plane angulation.
Our study found excellent inter- and intra-examiner reproducibility for the three points studied with 5 examiners utilizing 3D MRI images with 3 coordinate values for each point and using the anatomical definition for each landmark. Our study focused on the examiner reliability of FH detection on MRI, we did not intend to address specific measurement errors that may result when FH is not detected directly on MRI images. Future studies need to demonstrate the differences in specific craniofacial measurements when FH is estimated directly on subjects and when it is defined on images.
Conclusion
This study revealed excellent intra-examiner and inter-examiner reproducibility of Frankfort Horizontal plane through 3D landmark identification in MRI using freely available software Osirix. Sufficiently stable landmark-based reference plane could be used for different treatments and studies.
Author Contributions
Conceived and designed the experiments: AD CS RB. Performed the experiments: AD TK GS S. Soehnel S. Samietz AA. Analyzed the data: AD CS MH. Contributed reagents/materials/analysis tools: KH. Wrote the paper: AD CS. Permission to use MRI facilities: RP.
References
- 1. Guler N, Yatmaz P, Ataoglu H, Emlik D, Uckan S (2003) Temporomandibular internal derangement: correlation of MRI findings with clinical symptoms of pain and joint sounds in patients with bruxing behaviour. Dentomaxillofac Radiol 32: 304–310.
- 2. Sahni D, Sanjeev, Singh G, Jit I, Singh P (2008) Facial soft tissue thickness in northwest Indian adults. Forensic Sci Int 176: 137–46.
- 3. Gray C, Redpath T, Smith F (1998) Magnetic resonance imaging: a useful tool for evaluation of bone prior to implant surgery. Br Dent J 184: 603–607.
- 4. Farrugia ME, Bydder GM, Francis JM, Robson MD (2007) Magnetic resonance imaging of facial muscles. Clin Radiol 62: 1078–1086.
- 5. Goto TK, Yahagi M, Nakamura Y, Tokumori K, Langenbach GE, et al. (2005) vivo cross-sectional area of human jaw muscles varies with section location and jaw position. J Dent Res 84: 570–575.
- 6. Cotton F, Rozzi FR, Valee B, Pachai C, Hermier M, et al. (2005) Cranial sutures and craniometric points detected on MRI. Surg Radiol Anat 27: 64–70.
- 7. Hatipoglu HG, Ozcan HN, Hatipoglu US, Yuksel E (2008) Age, sex and body mass index in relation to calvarial diploe thickness and craniometric data on MRI. Forensic Sci Int 182: 46–51.
- 8. Goto TK, Nishida S, Nakamura Y, Tokumori K, Nakamura Y, et al. (2007) The accuracy of 3-dimensional magnetic resonance 3D vibe images of the mandible: an in vitro comparison of magnetic resonance imaging and computed tomography. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 103: 550–559.
- 9. Muramatsu A, Nawa H, Kimura M, Yoshida K, Maeda M, et al. (2008) Reproducibility of maxillofacial anatomic landmarks on 3-dimensional computed tomographic images determined with the 95% confidence ellipse method. Angle Orthod 78: 396–402.
- 10. Olszewski R, Tanesy O, Cosnard G, Zech F, Reychler H (2010) Reproducibility of osseous landmarks used for computed tomography based three-dimensional cephalometric analyses. J Craniomaxillofac Surg 38: 214–221.
- 11. Damstra J, Fourie Z, Dewit M, Ren Y (2011) A three-dimensional comparison of a morphometric and conventional cephalometric midsagittal planes for craniofacial asymmetry. Clin Oral Investig 16: 285–294.
- 12. Lagravère MO, Secanell M, Major PW, Carey JP (2011) Optimization analysis for plane orientation in 3-dimensional cephalometric analysis of serial cone-beam computerized tomography images. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 111: 771–777.
- 13. Oliveira AE, Cevidanes LH, Phillips C, Motta A, Burke B, et al. (2009) Observer reliability of three-dimensional cephalometric landmark identification on cone-beam computerized tomography. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 107: 256–265.
- 14. McWilliam JS, Welander U (1978) The effect of image quality on the identification of cephalometric landmarks. Angle Orthod 48: 49–56.
- 15. Houston WJ, Maher RE, McElroy D, Sherriff M (1986) Sources of error in measurements from cephalometric radiographs. Eur J Orthod 8: 149–151.
- 16. Lou L, Lagrave MO, Compton S, Major PW, Flores C (2007) Accuracy of measurements and reliability of landmark identification with computed tomography (CT) techniques in the maxillofacial area: a systematic review. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 104: 402–411.
- 17. Houston WJ (1983) The analysis of errors in orthodontic measurements. Am J Orthod 83: 382–390.
- 18. Waitzman AA, Posnick JC, Armstrong DC, Pron GE (1992) Craniofacial skeletal measurements based on computed tomography: Part I. Accuracy and reproducibility. Cleft Palate Craniofac J 29: 112–117.
- 19. Trpkova B, Major P, Prasad N, Nebbe B (1997) Cephalometric landmarks identification and reproducibility: a meta analysis. Am J Orthod Dentofacial Orthop 112: 165–170.
- 20. Gravely JF, Benzies PM (1974) The clinical significance of tracing error in cephalometry. Br J Orthod 1: 95–101.
- 21. Kragskov J, Bosch C, Gyldensted C, Sindet S (1997) Comparison of the reliability of craniofacial anatomic landmarks based on cephalometric radiographs and three-dimensional CT scans. Cleft Palate Craniofac J 34: 111–116.
- 22. Matteson SR, Bechtold W, Phillips C, Staab EV (1989) A method for three-dimensional image reformation for quantitative cephalometric analysis. J Oral Maxillofac Surg 47: 1053–1061.
- 23. Tyndall DA, Renner JB, Phillips C, Matteson SR (1992) Positional changes of the mandibular condyle assessed by three- dimensional computed tomography. J Oral Maxillofac Surg 50: 1164–1172.
- 24. Kollmann J, Ranke J, Virchow R (1883) Verständigung über ein gemeinsames craniometrisches Verfahren: Frankfurter Verständigung. Archiv für Anthropologie 15: 1–8.
- 25. Lundström A, Lundström F (1995) The Frankfort horizontal as a basis for cephalometric analysis. Am J Orthod Dentofacial Orthop 107: 537–540.
- 26. Van Eijden, Korfage JA, Brugman P (1997) Architecture of the human jaw-closing and jaw-opening muscles.Anat Rec. 248: 464–474.
- 27. Alves PV, Mazucheli J, Vogel CJ, Bolognese AM (2008) A protocol for cranial base reference in cephalometric studies. J Craniofac Surg 19: 211–215.
- 28. Hirohi T, Yoshimura K (2010) Lower face reduction with full-thickness marginal ostectomy of mandibular corpus-angle followed by corticectomy. J Plast Reconstr Aesthet Surg 63: 1251–129.
- 29.
Volzke H, Alte D, Schmidt C, Radke D, Lorbeer R, et al.. (2011) Cohort profile: the study of health in Pomerania. Int J Epidemiol 40, 294–307.
- 30. Hegenscheid K, Kühn JP, Völzke H, Biffar R, Hosten N, et al. (2009) Whole-body magnetic resonance imaging of healthy volunteers: pilot study results from the population-based SHIP study. Rofo 181: 748–759.
- 31. Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86: 420–428.
- 32.
Szklo M, Nieto JF (2007) Quality Assurance and Control In Epidemiology: Beyond the Basics. eds. M. Szklo & J. F. Nieto. 2nd edition, 297–349. Boston, Mass: Jones and Bartlett Publishers.
- 33.
Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1, 307–310.
- 34.
Bonett DG (2002) Sample size requirements for estimating intraclass correlations with desired precision. Stat Med, 21, 1331–1335.
- 35. Gökalp H, Türkkahraman H, Bzeizi N (2001) Correlation between eminence steepness and condyle disc movements in temporomandibular joints with internal derangements on magnetic resonance imaging. Eur J Orthod 23: 579–584.
- 36. Goto TK, Nishida S, Yahagi M, Langenbach GE, Nakamura Y, et al. (2006) Size and orientation of masticatory muscles in patients with mandibular laterognathism. J Dent Res 85: 552–556.
- 37. Lam E, Hannam A, Christiansen L (1991) Estimation of tendon-plane orientation within human masseter muscle from reconstructed magnetic resonance images. Arch Oral Biol 36: 845–853.
- 38. Boom H, Spronsen P, Ginkel F, Schijndel R, Castelijns J, et al. (2008) A comparison of human jaw muscle cross-sectional area and volume in long- and short-face subjects, using MRI. Arch Oral Biol 53: 273–281.
- 39. Ferrario VF, Sforza C, Germano D, Dalloca LL, Miani A Jr (1994) Head posture and cephalometric analyses: an integrated photographic/radiographic technique. Am J Orthod Dentofacial Orthop 106: 257–266.
- 40. Pancherz H, Gokbuket K (1996) The reliability of the Frankfort horizontal in roentgenographic cephalometry. Eur J Orthod 18: 367–72.
- 41. Ricketts R, Schulhof R, Bagha L (1976) Orientation-sella-nasion or Frankfort horizontal. Am J Orthod 69: 648–654.
- 42. Berco M, Rigali P, Miner R, DeLuca S, Anderson N, et al. (2009) Accuracy and reliability of linear cephalometric measurements from cone-beam computed tomography scans of a dry human skull. Am J Orthod Dentofacial Orthop 136: 17.e1–9.
- 43. Pancherz H, Gokbuket K (1996) The reliability of the Frankfort horizontal in roentgenographic cephalometry. Eur J Orthod 18: 367–72.
- 44. Ludlow JB, Gubler M, Cevidanes L, Mol A (2009) Precision of cephalometric landmark identification: cone-beam computed tomography vs conventional cephalometric views. Am J Orthod Dentofacial Orthop 136: 312.e1–10.
- 45. Halazonetis DJ (2002) Estimated natural head position and facial morphology. Am J Orthod Dentofacial Orthop 121: 364–368.
- 46. You K, Lee K, Lee S, Baik H (2010) Three-dimensional computed tomography analysis of mandibular morphology in patients with facial asymmetry and mandibular prognathism. Am J Orthod Dentofacial Orthop 138: 540.e1–8.
- 47. Hassan B, Stelt P, Sanderink G (2008) Accuracy of three-dimensional measurements obtained from cone beam computed tomography surface-rendered images for cephalometric analysis: influence of patient scanning position. Eur J Orthod 31: 129–34.
- 48. Lagravere MO, Low C, Flores-Mir C, Chung R, Carey JP, et al. (2010) Intraexaminer and interexaminer reliabilities of landmark identification on digitized lateral cephalograms and formatted 3-dimensional cone-beam computerized tomography images. Am J Orthod Dentofacial Orthop 137: 598–604.