# Intra- and Inter-rater Reliability of a Magnetic Resonance Imaging-Based Volumetric Analysis of the Abductor Hallucis Muscle

authors:

Nasrin Moulodi 1 , 2 , Maryam Jalali 2 , * , Javad Sarrafzadeh 3 , Fatemeh Azadinia 2 , Ali Shakourirad 4

Student Research Committee, Iran University of Medical Sciences, Tehran, Iran
Department of Orthotics and Prosthetics, Rehabilitation Research Center, School of Rehabilitation Sciences, Iran University of Medical Sciences, Tehran, Iran
Department of Physiotherapy, Rehabilitation Research Center, School of Rehabilitation Sciences, Iran University of Medical Sciences, Tehran, Iran
Department of Radiology, Sina Hospital, Tehran University of Medical Sciences, Tehran, Iran

how to cite: Moulodi N, Jalali M, Sarrafzadeh J, Azadinia F, Shakourirad A. Intra- and Inter-rater Reliability of a Magnetic Resonance Imaging-Based Volumetric Analysis of the Abductor Hallucis Muscle. Innov J Radiol. 2022;19(3):e128725. https://doi.org/10.5812/iranjradiol-128725.

### Abstract

#### Background:

The muscle volume considerably changes with aging, pathologies, mechanical loading and exercise, and immobilization. It is recognized as an important parameter that can be measured by various methods to evaluate the effectiveness of interventions focusing on muscle strengthening and function. However, before the application of any measurement method, their reliability needs to be investigated and established.

#### Objectives:

This study aimed to evaluate the inter- and intra-rater reliability of the manual measurement method of the abductor hallucis muscle volume in feet with hallux valgus deformities using magnetic resonance imaging (MRI).

#### Patients and Methods:

The MRI images of the feet of 15 samples with a hallux valgus deformity were selected in this study. The cross-sectional areas of the abductor hallucis muscle were measured in the cuts along the entire length of the foot and multiplied by slice thickness. Two trained raters performed the measurements. The second rater repeated the measurements after five days to eliminate the memory effect. The intra-rater reliability and inter-rater reliability were assessed based on the intraclass correlation coefficient [ICC (2, 1)] to evaluate the extent of agreement between the raters at a 95% confidence interval.

#### Results:

The between- and within-rater ICCs were 0.92 (0.79 - 0.97) and 0.99 (0.97 - 0.99), respectively. The standard error of measurements was also small in both inter-rater (6.2%) and intra-rater (2.1%) reliability analyses.

#### Conclusion:

The manually outlined slice-by-slice volume measurement of the abductor hallucis muscle based on MRI images showed excellent inter- and intra-rater reliability. The excellent intra-rater reliability, besides the lower standard error percentage of measurements, indicates the superiority of measurements by a single person. However, further studies with a larger sample size are recommended.

### 1. Background

The muscle volume is a reliable indicator of the physical capacity of a muscle in force and power generation (1). It considerably changes with aging, pathologies, mechanical loading and exercise, and immobilization (2, 3). This parameter can be used to evaluate the effectiveness of interventions focusing on muscle strengthening and function. Generally, various methods are used to measure the muscle volume (4). Nonetheless, before the application of any measurement method for research or clinical applications, their reliability needs to be established (5). Reliability is defined as the extent to which measurements can be replicated. In other words, it reflects not only the extent of correlation, but also the level of agreement between measurements. Without reliability measurements, we can neither rely on our measurements, nor draw any rational conclusions (6, 7).

The weakness of the intrinsic foot (IF) muscles is an important issue that has been investigated in different deformities. The weakness of these muscles may alter the foot alignment (8); the collapse of the medial longitudinal arch of the foot is an example of foot misalignment (9-11). In this regard, Chang et al. compared the volume of IF muscles between patients with plantar fasciitis and healthy individuals by separating the muscle tissues from non-muscular tissues in magnetic resonance (MR) images. In this study, the muscle borders were digitally marked, the intensity of muscle signals was examined, and the volume of muscles was calculated. The volume of intrinsic muscles in the forefoot of the plantar fasciitis group was 5.2% smaller than that of healthy feet (12).

The hallux valgus (HV) deformity is another example of muscle weakness. In this deformity, the head of the first metatarsal bone is deviated medially, the hallux is deviated laterally, and the abductor hallucis (AbdH) muscle is displaced relative to the metatarsophalangeal joint (13). From a clinical perspective, the role of the AbdH muscle is yet to be established. However, previous studies suggest that the AbdH muscle, its distal attachment, and muscle imbalance play a role in the etiology and treatment of HV deformities (14, 15). The measurement of the AbdH muscle in HV deformities and investigation of the effects of interventions on the volume of this muscle can provide useful information for the management of this prevalent deformity. Nevertheless, it is somewhat challenging to measure different characteristics of the IF muscles due to their small size and depth.

Magnetic resonance imaging (MRI) is considered as the reference standard technique to measure the muscle volume (16), as it yields three-dimensional images of the muscle and facilitates the assessment of muscle mass (17, 18). It also provides high-contrast, high-resolution images of soft tissues across multiple planes and enables examining the anatomical and functional characteristics of foot muscles (19). There are many techniques that can be used manually, semi-automatically, and automatically to examine and segment muscles from MRI images (20). Four manual techniques have been used in previous studies to measure the muscle volume. Slice-by-slice segmentation of the muscle cross-sectional area (CSA) is one of the manual techniques used as a standard reference method in studies on large muscles (21).

### 2. Objectives

The reliability assessment of measurements is especially important in examining the effects of clinical treatment, allowing researchers to evaluate between- and within-group changes over time. The manual technique has been mostly used in large muscles to calculate the muscle volume, while the reliability of this technique has not been investigated in the AbdH muscle, especially in HV deformities that greatly affect this muscle. Therefore, the present study aimed to assess the intra- and inter-rater reliability of the manual measurement of the AbdH muscle volume in HV deformities for clinical and research purposes to evaluate the effects of treatment.

### 3. Patients and Methods

#### 3.1. Study Sample

The MRI images of the right foot of 15 women with HV deformities were acquired in the frontal view. The sample size was estimated based on the hypothesized value of intraclass correlation coefficient (ICC) (0.6) (22), α value of 0.05, and test power of 80% (β = 0.2) for two replicated measurements. All participants signed a written informed consent form. This study was approved by the institutional review board of Iran University of Medical Sciences, Tehran, Iran (IR.IUMS.REC.1399.1037). The participants were screened for medical and orthopedic conditions that would preclude MRI procedures. The inclusion criteria were age of 18 - 44 years and lack of any underlying diseases, diabetes, gout, leprosy, or neurological conditions. Besides, they had no history of foot injuries (e.g., fractures and dislocations). A summary of the participants’ demographic information is presented in Table 1.

Table 1. The Demographic Information of the Participants
VariablesValues
Number15
Age (y)30.40 ± 5.56
Height (cm)162.27 ± 6.57
Weight (kg)60.80 ± 9.23
BMI (kg/m2)23.00 ± 3.04
Hallux valgus angle (degree)18.80 ± 3.46

#### 3.2. Image Acquisition

The MRI images of the right foot were acquired using an MRI system (MAGNETOM Symphony 1.5 Tesla, Siemens, Germany) with a one-channel knee coil. The participants were positioned in a supine position with the foot in a neutral position (rest position) and perpendicular to the bed inside the coil (23). To prevent extra movement during imaging, the foot and ankle were fixed with side pillows. The knee coil was used on the target foot to achieve the highest resolution without missing the signal strength-to-noise ratio (23). The position of the foot was maintained in a way that the natural shape of the soft tissue would not be altered; by keeping the foot straight, the locations of the muscle origin and insertion were in line. The images were recorded in three planes. The examination period was 26 minutes for each foot (Figure 1).

The MRI images were recorded from January 2021 to October 2021. The images were prepared based on the following parameters: repetition time, 540 ms; echo time, 12 ms; average, 3; slice thickness, 3 mm; inter-slice gap, 0 mm; field of view, 240×120 mm; flip angle, 90°; and matrix size, 320 × 200. The field of view covered one foot, depending on the foot length from the back part of the heel to the end of the longest toe.

#### 3.3. Muscle CSA Measurements

The cross-sections of the AbdH muscle in the frontal plane were manually outlined once by one of the raters (FD) and twice by the second rater (NM) in the target slices. The raters were trained by a professional to decide on the origin and insertion slices, separate the muscle borders, use the software utilities, measure the CSA on each slice, and calculate the total volume of the muscle. Before independent measurements by the raters, they practiced the method several times together to ensure the uniformity of their measurement technique. The CSA of the AbdH muscle was marked in each cut and measured using the Marco Packs software (Tahavolat Novin Yademan Co., Tehran, Iran), connected to a Siemens device. The entire length of the foot was examined in the frontal view (11). The number of cuts in which the muscle was defined varied from one person to another due to differences in the length of the feet (42 cuts on average).

The measurements were performed from the origin of the muscle on the calcaneus to the insertion of the muscle tissue in the forefoot. The CSA of the muscle in each cut was recorded in mm2 in Microsoft Excel software. There was a black area around the AbdH muscle, called a chemical shift, which occurs when there is fat surrounding the muscle. Different signal intensities allowed for the separation of muscle tissues from chemical shifts around the muscle compartments (24). Meanwhile, different views of each cut were evaluated to ensure that the outlines were carefully selected (Figure 2). Next, the sum of CSA measurements for all cuts was calculated. The total muscle volume was measured by multiplying the sum of total CSAs by the thickness of slices (3 mm) (muscle volume = ∑CSA × 3) (24-27).

#### 3.4. Reliability of Measurements

The manual slice-by-slice CSA segmentation of muscles is a standard method used in previous studies; however, it is a very time-consuming procedure due to the examination of all slices. Compared to other techniques, this technique can provide more accurate and detailed information (17). In this study, two trained raters outlined the AbdH muscle CSAs in the target cuts (55 cuts in the frontal view); this process was performed by both raters for each image separately (23); the raters were blind to the findings of one another. Next, the reliability of this method was analyzed for the two raters. Regarding the intra-rater reliability, the second rater repeated the measurements five days after the initial measurements (on average) to eliminate the memory effect (28).

#### 3.5. Statistical Analysis

The intra-rater reliability and inter-rater reliability were assessed in SPSS version 21.0 (IBM Corp. Released 2012. IBM SPSS Statistics for Windows, Version 21.0. Armonk, NY: IBM Corp.) by measuring the ICC. The reliability coefficients range from zero to one, with values closer to one representing higher reliability (29). The mean values and standard deviations were calculated for all variables. The ICC was measured by using the two-way random-effects and absolute agreement [ICC (2, 1)] model to evaluate the extent of agreement between the raters at a 95% confidence interval. In this model, each sample was measured by one rater, who represented a larger community of raters (reliability analysis based on single measurements) (28, 29). According to Portney and Watkins (2009), ICC values below 0.5 indicate poor reliability, values of 0.5 - 0.75 suggest moderate reliability, values of 0.75 - 0.90 suggest good reliability, and values > 0.90 represent excellent reliability (7). The standard error of measurement (SEM) was calculated by the following formula (Equation 1) to estimate the expected error value in measurements:

Equation 1.$SEM=SD×1-ICC$

SD, standard deviation.

The minimal detectable change (MDC) was also measured according to the following formula (Equation 2) (30):

Equation 2.

CI, confidence interval.

This procedure aimed to determine the magnitude of change that would exceed the minimal error of measurement at a 95% confidence interval; the observed changes between the two tests accurately represented the difference (not a measurement error) (30).

### 4. Results

#### 4.1. Inter-rater Reliability

Table 2 presents the results of reliability analysis between the two raters for 15 samples of the right foot with HV deformity. The descriptive data (mean and standard deviation) are also reported for the measurements. The ICC for the inter-rater reliability of the AbdH muscle volume measurement was excellent (0.92). Also, the SEM was small (621.13 mm3), which indicated the accuracy of measurements.

Table 2. The Results of Inter-rater Reliability Analysis
MeasureVolume measurement by rater 1 (mm3) (mean ± SD)Volume measurement by rater 2 (mm3) (mean ± SD)ICC (95% CI)SEMMDCP-value
CSA of the AbdH muscle10262.07 ± 2196.0310093.73 ± 2154.010.92 (0.79 - 0.97)621.131721.680.00

#### 4.2. Intra-rater Reliability

The results of intra-rater reliability analysis for 15 samples of the right foot with HV deformity are presented in Table 3. The intra-rater reliability was also found to be excellent (0.99). The SEM value for the intra-rater reliability was lower than that of the inter-rater reliability (215.40 mm3).

Table 3. The Results of Intra-rater Reliability Analysis
MeasureVolume measurement by rater 2 (mm3) (mean ± SD)Volume measurement by rater 2, repeat (mm3) (mean ± SD)ICC (95% CI)SEMMDCP-value
CSA of the AbdH muscle10093.73 ± 2154.019954.69 ± 2123.890.99 (0.97 - 0.99)215.40597.050.00

### 5. Discussion

This study aimed to evaluate the inter- and intra-rater reliability of a manual method used for measuring the AbdH muscle volume based on the MRI images of feet with HV deformity for research and clinical purposes. Before interpreting the results, it is necessary to evaluate the reliability of methods used for measuring the characteristics of muscles responsible for the formation of HV deformities. The ICCs for inter-rater and intra-rater reliability indicated excellent reliability. The SEM% for intra- and inter-rater agreement was estimated at 6.2% and 2.1%, respectively, which is comparable to the results of previous studies. In this regard, in a study by Franettovich Smith et al., the SEM% of inter- and intra-rater agreement was 4% and 6%, respectively for the CSA measurement of the AbdH muscle by ultrasound (31).

Moreover, based on the findings reported by Jung et al., the SEM% was estimated at 3.8% (32); nevertheless, it should be noted that both of these studies used the US imaging method. Generally, the SEM value represents the measurement error (33). An error may occur while detecting the exact location and borders of the muscle among other intrinsic muscles (33). The manual tracing of borders can also influence the measurements. Besides, the resolution of MRI images is an important factor that may affect the precision of muscle borders. Two raters were trained in several sessions, during which reference images, such as anatomical atlases of foot muscles, were used to determine the exact path and borders in different cuts; the prior experience of raters in such measurements may be the cause of high ICC and low SEM values (28).

Additionally, the inter- and intra-rater MDC95 values were estimated at 17.2% and 5.9%, respectively in the present study; the MDC value represents the potential to detect changes exceeding the measurement error for research or clinical applications. Therefore, if a single muscle volume measurement technique is employed by a single rater, not all changes in the muscle volume (< 5.9%) are actual changes. This finding is in line with the results of a study by Jung et al., which showed significant changes in the AbdH muscle CSA on ultrasound images after two types of interventions (32). Moreover, Hing et al. evaluated the reliability of two ultrasound machines and found that a change greater than 21.25% is needed to be 95% confident that a real change has occurred in the AbdH muscle CSA (34).

Similarly, Lund et al. examined inter- and intra-rater differences in using a manual method to measure the muscle volume of the dorsal ankle (tibialis anterior muscle, extensor digitorum longus, and extensor hallucis longus) in MRI images. Overall, these studies aimed to determine the number of slices needed for calculations and reported excellent inter- and intra-rater reliability (0.98 - 1.0) (16). It is known that the volume of these muscles (tibialis anterior muscle, extensor digitorum longus, and extensor hallucis longus) is larger than that of deep foot muscles, which may make it easier to identify and follow their path. In a validity and reliability study of a semi-automatic method for discriminating adipose tissue, subcutaneous fat, and intrinsic muscles of the foot, the ICC was mostly above 0.95, which indicated a high level of agreement among therapists (23). Also, Pons et al. examined the validity and reliability of automatic, semi-automatic, and manual techniques, which were used for measuring the muscle volume based on MRI images in healthy population. For cases of muscle pathology, more data on metrological quality of techniques are required. In addition, techniques that simplified the segmentation, made errors in volume and shape estimation (20). Previous research has investigated the reliability of slice-by-slice measurements. The intra-rater reliability was good to excellent in four studies (0.7 - 1.0) (21, 33, 35, 36), and inter-rater reliability was moderate to good in eight studies (0.5 - 0.89) (10, 21, 33, 35-39). Seven studies used manual methods to calculate the total volume of muscles by summing up the measured CSAs in all slices, similar to the method used in the current study (33, 35, 36, 38, 40-42). However, to the best of our knowledge, no study has yet evaluated our manual method to measure intrinsic foot muscles, especially the AbdH muscle. After muscle segmentation, seven methods were used to calculate the muscle volume. There was no measurement error in volume calculations, and error was related to the time of muscle segmentation (20).

In previous studies, the IF muscles, which are located deep within several layers, were commonly classified in groups due to their small and irregular size (11, 23, 24). The separation of a particular muscle from the adjacent intrinsic muscles is a somewhat difficult procedure. To find the beginning and end of a muscle, greater accuracy is needed, since there is a likelihood of measurement error. However, this is not an issue in the middle slices, as the border of muscles is easily separable. The measurement of the IF muscle volume is challenging because of its arrangement in a four-layer complex; therefore, it is very difficult to differentiate these muscles from others (43).

In individuals with HV deformities, the path of the AbdH muscle may be displaced below the head of the first metatarsal bone, depending on the severity of deformity (14, 15). Following changes in the muscle anatomy and biomechanics in individuals with HV deformities, muscle imbalance will develop between the abductor and adductor muscles of the hallux (15). Based on the results of a study by Stewart et al., significant changes were observed in the mediolateral width, dorsoplantar thickness, and CSA of the AbdH muscle between feet with and without HV based on ultrasound data. However, no significant changes were observed in different degrees of deformity (44). The reliability analysis of the AbdH muscle volume measurement in HV patients provides an important opportunity to gain further insight into the effects of interventions and strategies that focus on improving the strengths and functions of this small muscle by monitoring any related changes.

The limitations of this study include because of time-consuming image segmentation, measurement done one time by each rater; therefore, the absolute agreement was investigated and average reliability was not reported. A lack of comparison between the manual technique and automatic techniques is another limitation of this study.

In conclusion, the inter- and intra-rater reliability of the AbdH muscle volume measurement based on slice-by-slice examination in MRI images was found to be excellent. Therefore, it can be used as a reproducible method to measure the rate of change in the AbdH muscle volume in various treatments or research applications. Due to the excellent intra-rater reliability and lower standard error percentage of measurements, a single person is preferred to perform the measurements in comparative studies. Further research with a larger sample size is recommended.

### References

• 1.

Fukunaga T, Miyatani M, Tachi M, Kouzaki M, Kawakami Y, Kanehisa H. Muscle volume is a major determinant of joint torque in humans. Acta Physiol Scand. 2001;172(4):249-55. [PubMed ID: 11531646]. https://doi.org/10.1046/j.1365-201x.2001.00867.x.

• 2.

Narici MV, Maganaris CN, Reeves ND, Capodaglio P. Effect of aging on human muscle architecture. J Appl Physiol (1985). 2003;95(6):2229-34. [PubMed ID: 12844499]. https://doi.org/10.1152/japplphysiol.00433.2003.

• 3.

Marcon M, Ciritsis B, Laux C, Nanz D, Nguyen-Kim TD, Fischer MA, et al. Cross-sectional area measurements versus volumetric assessment of the quadriceps femoris muscle in patients with anterior cruciate ligament reconstructions. Eur Radiol. 2015;25(2):290-8. [PubMed ID: 25358592]. https://doi.org/10.1007/s00330-014-3424-2.

• 4.

Soysa A, Hiller C, Refshauge K, Burns J. Importance and challenges of measuring intrinsic foot muscle strength. J Foot Ankle Res. 2012;5(1):29. [PubMed ID: 23181771]. [PubMed Central ID: PMC3544647]. https://doi.org/10.1186/1757-1146-5-29.

• 5.

Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016;15(2):155-63. [PubMed ID: 27330520]. [PubMed Central ID: PMC4913118]. https://doi.org/10.1016/j.jcm.2016.02.012.

• 6.

Bruton A, Conway JH, Holgate ST. Reliability: What is it, and how is it measured? Physiotherapy. 2000;86(2):94-9. https://doi.org/10.1016/s0031-9406(05)61211-4.

• 7.

Portney LG, Watkins MP. Foundations of clinical research: applications to practice. 892. New Jersey, USA: Pearson; 2009.

• 8.

Moulodi N, Azadinia F, Ebrahimi-Takamjani I, Atlasi R, Jalali M, Kamali M. The functional capacity and morphological characteristics of the intrinsic foot muscles in subjects with Hallux Valgus deformity: A systematic review. Foot (Edinb). 2020;45:101706. [PubMed ID: 33039908]. https://doi.org/10.1016/j.foot.2020.101706.

• 9.

Andersen H. Muscular endurance in long-term IDDM patients. Diabetes Care. 1998;21(4):604-9. [PubMed ID: 9571350]. https://doi.org/10.2337/diacare.21.4.604.

• 10.

Andersen H, Stalberg E, Gjerstad MD, Jakobsen J. Association of muscle strength and electrophysiological measures of reinnervation in diabetic neuropathy. Muscle Nerve. 1998;21(12):1647-54. [PubMed ID: 9843064]. https://doi.org/10.1002/(sici)1097-4598(199812)21:12<1647::aid-mus4>3.0.co;2-d.

• 11.

Bus SA, Yang QX, Wang JH, Smith MB, Wunderlich R, Cavanagh PR. Intrinsic muscle atrophy and toe deformity in the diabetic neuropathic foot: a magnetic resonance imaging study. Diabetes Care. 2002;25(8):1444-50. [PubMed ID: 12145248]. https://doi.org/10.2337/diacare.25.8.1444.

• 12.

Chang R, Kent-Braun JA, Hamill J. Use of MRI for volume estimation of tibialis posterior and plantar intrinsic foot muscles in healthy and chronic plantar fasciitis limbs. Clin Biomech (Bristol, Avon). 2012;27(5):500-5. [PubMed ID: 22166747]. https://doi.org/10.1016/j.clinbiomech.2011.11.007.

• 13.

Eustace S, Williamson D, Wilson M, O'Byrne J, Bussolari L, Thomas M, et al. Tendon shift in hallux valgus: observations at MR imaging. Skeletal Radiol. 1996;25(6):519-24. [PubMed ID: 8865484]. https://doi.org/10.1007/s002560050128.

• 14.

Brenner E. Insertion of the abductor hallucis muscle in feet with and without hallux valgus. Anat Rec. 1999;254(3):429-34. [PubMed ID: 10096675]. https://doi.org/10.1002/(SICI)1097-0185(19990301)254:3<429::AID-AR14>3.0.CO;2-5.

• 15.

Arinci Incel N, Genc H, Erdem HR, Yorgancioglu ZR. Muscle imbalance in hallux valgus: an electromyographic study. Am J Phys Med Rehabil. 2003;82(5):345-9. [PubMed ID: 12704272]. https://doi.org/10.1097/01.PHM.0000064718.24109.26.

• 16.

Lund H, Christensen L, Savnik A, Boesen J, Danneskiold-Samsoe B, Bliddal H. Volume estimation of extensor muscles of the lower leg based on MR imaging. Eur Radiol. 2002;12(12):2982-7. [PubMed ID: 12439580]. https://doi.org/10.1007/s00330-002-1334-1.

• 17.

Tothill P, Stewart AD. Estimation of thigh muscle and adipose tissue volume using magnetic resonance imaging and anthropometry. J Sports Sci. 2002;20(7):563-76. [PubMed ID: 12166882]. https://doi.org/10.1080/026404102760000062.

• 18.

Nakatani M, Takai Y, Akagi R, Wakahara T, Sugisaki N, Ohta M, et al. Validity of muscle thickness-based prediction equation for quadriceps femoris volume in middle-aged and older men and women. Eur J Appl Physiol. 2016;116(11-12):2125-33. [PubMed ID: 27590314]. https://doi.org/10.1007/s00421-016-3464-1.

• 19.

Farjoodi P, Mesfin A, Carrino JA, Khanna AJ. Magnetic resonance imaging of the musculoskeletal system: basic science, pulse sequences, and a systematic approach to image interpretation. J Bone Joint Surg Am. 2010;92(Suppl 2):105-16. [PubMed ID: 21189247]. https://doi.org/10.2106/JBJS.J.00783.

• 20.

Pons C, Borotikar B, Garetier M, Burdin V, Ben Salem D, Lempereur M, et al. Quantifying skeletal muscle volume and shape in humans using MRI: A systematic review of validity and reliability. PLoS One. 2018;13(11). e0207847. [PubMed ID: 30496308]. [PubMed Central ID: PMC6264864]. https://doi.org/10.1371/journal.pone.0207847.

• 21.

Nordez A, Jolivet E, Sudhoff I, Bonneau D, de Guise JA, Skalli W. Comparison of methods to assess quadriceps muscle volume using magnetic resonance imaging. J Magn Reson Imaging. 2009;30(5):1116-23. [PubMed ID: 19856445]. https://doi.org/10.1002/jmri.21867.

• 22.

Hummel J, Skweres J, Heineman N, Dessouky R, Xi Y, Zhang L, et al. Hallux valgus assessment on X-ray and Magnetic resonance Imaging (MRI): Correlation with qualitative soft tissue and internal derangement findings on MRI. Eur J Radiol. 2019;113:24-31. [PubMed ID: 30927954]. https://doi.org/10.1016/j.ejrad.2019.01.035.

• 23.

Cheuy VA, Commean PK, Hastings MK, Mueller MJ. Reliability and validity of a MR-based volumetric analysis of the intrinsic foot muscles. J Magn Reson Imaging. 2013;38(5):1083-93. [PubMed ID: 23450691]. [PubMed Central ID: PMC4400725]. https://doi.org/10.1002/jmri.24069.

• 24.

Andersen H, Gjerstad MD, Jakobsen J. Atrophy of foot muscles: a measure of diabetic neuropathy. Diabetes Care. 2004;27(10):2382-5. [PubMed ID: 15451904]. https://doi.org/10.2337/diacare.27.10.2382.

• 25.

Fukunaga T, Roy RR, Shellock FG, Hodgson JA, Day MK, Lee PL, et al. Physiological cross-sectional area of human leg muscles based on magnetic resonance imaging. J Orthop Res. 1992;10(6):928-34. [PubMed ID: 1403308]. https://doi.org/10.1002/jor.1100100623.

• 26.

Severinsen K, Andersen H. Evaluation of atrophy of foot muscles in diabetic neuropathy -- a comparative study of nerve conduction studies and ultrasonography. Clin Neurophysiol. 2007;118(10):2172-5. [PubMed ID: 17709290]. https://doi.org/10.1016/j.clinph.2007.06.019.

• 27.

Severinsen K, Obel A, Jakobsen J, Andersen H. Atrophy of foot muscles in diabetic patients can be detected with ultrasonography. Diabetes Care. 2007;30(12):3053-7. [PubMed ID: 17717286]. https://doi.org/10.2337/dc07-0108.

• 28.

Fortin M, Dobrescu O, Jarzem P, Ouellet J, Weber MH. Quantitative Magnetic Resonance Imaging Analysis of the Cervical Spine Extensor Muscles: Intrarater and Interrater Reliability of a Novice and an Experienced Rater. Asian Spine J. 2018;12(1):94-102. [PubMed ID: 29503688]. [PubMed Central ID: PMC5821939]. https://doi.org/10.4184/asj.2018.12.1.94.

• 29.

Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420-8. [PubMed ID: 18839484]. https://doi.org/10.1037//0033-2909.86.2.420.

• 30.

Jeon I, Kim M. Reliability of Thickness Measurements of the Abductor Hallucis Muscle Using the Spring Gauge Technique in Hallux Valgus Subjects: An Ultrasonographic Study. J Korean Phys Ther. 2016;28(2):119-23. https://doi.org/10.18857/jkpt.2016.28.2.119.

• 31.

Franettovich Smith MM, Hides JA, Hodges PW, Collins NJ. Intrinsic foot muscle size can be measured reliably in weight bearing using ultrasound imaging. Gait Posture. 2019;68:369-74. [PubMed ID: 30583193]. https://doi.org/10.1016/j.gaitpost.2018.12.012.

• 32.

Jung DY, Koh EK, Kwon OY. Effect of foot orthoses and short-foot exercise on the cross-sectional area of the abductor hallucis muscle in subjects with pes planus: a randomized controlled trial. J Back Musculoskelet Rehabil. 2011;24(4):225-31. [PubMed ID: 22142711]. https://doi.org/10.3233/BMR-2011-0299.

• 33.

Tingart MJ, Apreleva M, Lehtinen JT, Capell B, Palmer WE, Warner JJ. Magnetic resonance imaging in quantitative analysis of rotator cuff muscle volume. Clin Orthop Relat Res. 2003;(415):104-10. [PubMed ID: 14612636]. https://doi.org/10.1097/01.blo.0000092969.12414.e1.

• 34.

Hing WA, Rome K, Cameron AF. Reliability of measuring abductor hallucis muscle parameters using two different diagnostic ultrasound machines. J Foot Ankle Res. 2009;2:33. [PubMed ID: 19917127]. [PubMed Central ID: PMC2784754]. https://doi.org/10.1186/1757-1146-2-33.

• 35.

Smeulders MJ, van den Berg S, Oudeman J, Nederveen AJ, Kreulen M, Maas M. Reliability of in vivo determination of forearm muscle volume using 3.0 T magnetic resonance imaging. J Magn Reson Imaging. 2010;31(5):1252-5. [PubMed ID: 20432364]. https://doi.org/10.1002/jmri.22153.

• 36.

Springer I, Muller M, Hamm B, Dewey M. Intra- and interobserver variability of magnetic resonance imaging for quantitative assessment of abductor and external rotator muscle changes after total hip arthroplasty. Eur J Radiol. 2012;81(5):928-33. [PubMed ID: 21354740]. https://doi.org/10.1016/j.ejrad.2011.01.113.

• 37.

Morse CI, Degens H, Jones DA. The validity of estimating quadriceps volume from single MRI cross-sections in young men. Eur J Appl Physiol. 2007;100(3):267-74. [PubMed ID: 17342544]. https://doi.org/10.1007/s00421-007-0429-4.

• 38.

Valentin S, Yeates TD, Licka T, Elliott J. Inter-rater reliability of trunk muscle morphometric analysis. J Back Musculoskelet Rehabil. 2015;28(1):181-90. [PubMed ID: 25628042]. [PubMed Central ID: PMC5614442]. https://doi.org/10.3233/BMR-140552.

• 39.

Skorupska E, Keczmer P, Lochowski RM, Tomal P, Rychlik M, Samborski W. Reliability of MR-Based Volumetric 3-D Analysis of Pelvic Muscles among Subjects with Low Back with Leg Pain and Healthy Volunteers. PLoS One. 2016;11(7). e0159587. [PubMed ID: 27459688]. [PubMed Central ID: PMC4961367]. https://doi.org/10.1371/journal.pone.0159587.

• 40.

Barnouin Y, Butler-Browne G, Voit T, Reversat D, Azzabou N, Leroux G, et al. Manual segmentation of individual muscles of the quadriceps femoris using MRI: a reappraisal. J Magn Reson Imaging. 2014;40(1):239-47. [PubMed ID: 24615897]. https://doi.org/10.1002/jmri.24370.

• 41.

Yamauchi K, Yoshiko A, Suzuki S, Kato C, Akima H, Kato T, et al. Estimation of individual thigh muscle volumes from a single-slice muscle cross-sectional area and muscle thickness using magnetic resonance imaging in patients with knee osteoarthritis. J Orthop Surg (Hong Kong). 2017;25(3):2309499017743100. [PubMed ID: 29212436]. https://doi.org/10.1177/2309499017743101.

• 42.

Vanmechelen IM, Shortland AP, Noble JJ. Lower limb muscle volume estimation from maximum cross-sectional area and muscle length in cerebral palsy and typically developing individuals. Clin Biomech (Bristol, Avon). 2018;51:40-4. [PubMed ID: 29179032]. https://doi.org/10.1016/j.clinbiomech.2017.11.004.

• 43.

Crofts G, Angin S, Mickle KJ, Hill S, Nester CJ. Reliability of ultrasound for measurement of selected foot structures. Gait Posture. 2014;39(1):35-9. [PubMed ID: 23791782]. https://doi.org/10.1016/j.gaitpost.2013.05.022.

• 44.

Stewart S, Ellis R, Heath M, Rome K. Ultrasonic evaluation of the abductor hallucis muscle in hallux valgus: a cross-sectional observational study. BMC Musculoskelet Disord. 2013;14:45. [PubMed ID: 23356426]. [PubMed Central ID: PMC3564793]. https://doi.org/10.1186/1471-2474-14-45.

Copyright © 2022, Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.