Reliability of Voluntary Response Index Analysis Using Surface Electromyography in Professional Football Players

authors:

avatar Ahmadreza Firouzi ORCID 1 , avatar Mahmood Reza Azghani 2 , avatar Mandana Rezaei ORCID 1 , * , avatar Ali Jahan 3

Department of Physiotherapy, Faculty of Rehabilitation Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
Department of Biomechanics, Faculty of Biomechanics Engineering, Sahand University of Technology, Tabriz, Iran
Department of Speech and Language Pathology, Faculty of Rehabilitation sciences, Tabriz University of Medical Sciences, Tabriz, Iran
Middle East Journal of Rehabilitation and Health Studies: Vol.11, issue 3; e146098
published online: April 7, 2024
article type: Research Article
received: February 18, 2024
revised: March 2, 2024
accepted: March 3, 2024
DOI: https://doi.org/10.5812/mejrh-146098

how to cite: Firouzi A, Azghani M R, Rezaei M, Jahan A. Reliability of Voluntary Response Index Analysis Using Surface Electromyography in Professional Football Players. Middle East J Rehabil Health Stud. 2024;11(3):e146098. https://doi.org/10.5812/mejrh-146098.

Abstract

Background:

Surface electromyography (sEMG) represents a widely utilized technique in medical research. The voluntary response index (VRI) introduces a novel method for analyzing the motor control of voluntary movements via sEMG. This study aimed to assess the reliability of VRI and breakpoint angles (BPA) among professional football players during the Nordic Hamstring test (NHT).

Methods:

This study included 24 healthy professional football players. Through the use of sEMG, two aspects of VRI [magnitude (MAG) and similarity index (SI)] were evaluated during the NHT. Additionally, BPAs were determined by capturing slow-motion videos of functional tasks. The test-retest reliability across three trials was determined using the intra-class correlation coefficient (ICC).

Results:

The reliability of the VRI components during the NHT was found to be excellent. The ICC for MAG was 0.9 and 0.81 for the SI. Breakpoint angles exhibited moderate reliability (ICC = 0.65) during a functional task. The SI displayed a lower standard error of measurement (SEM = 0.07). The MAG’s SEM was 0.25, while BPA’s SEM was 17.8.

Conclusions:

The analysis of the VRI via sEMG showed nearly perfect reliability in professional football players during the NHT, a functional task. Breakpoint angles demonstrated significant reliability. The findings of this study indicate that both VRI and BPA are reliable methods for estimating motor control during dynamic movement tasks in professional athletes.

1. Background

Football is among the world's most popular sports (1), boasting 500 million players globally. Research indicates that professional football players experience an injury incidence of 101 injuries per 1,000 hours of play (2). Hamstring muscle (HM) injuries, prevalent in sprinting-related activities like football, have an incidence rate of 6 - 29% across sports (3, 4) with football seeing 8% to 25% of all injuries resulting from hamstring strains (5). The central nervous system controls voluntary movement and muscular patterns (6), with two primary mechanisms of HM injury identified as overstretching and explosive eccentric contractions (4).

The Nordic hamstring exercise, a recent literature subject, is an eccentric strengthening exercise for the HM (7). This exercise involves individuals kneeling, their ankles secured, as they gradually lower their upper body towards the ground in a prone position (8), enhancing the eccentric strength of knee flexor muscles and reducing HM injury rates (9, 10). Studies have also shown its application as a field test for estimating HM eccentric ability (11-13), with the breakpoint angle (BPA) defined as the angle at which subjects cannot maintain contraction due to an increased gravitational moment, leading to their fall during the Nordic Hamstring test (NHT) (12).

Traditionally, Surface electromyography (sEMG) studies have focused on measuring muscle activity and timing (14), with the objective evaluation of voluntary motor control and muscular patterns proving challenging (15). Introduced in 2004, the voluntary response index (VRI) offers a novel surface EMG analysis sensitive enough to measure motor control (16) by evaluating whole muscle patterns rather than individual muscle activities, encompassing two components: Magnitude (MAG) and similarity index (SI) (15). Voluntary response index aims to reduce participation variability in EMG signal analysis by comparing voluntary motor control patterns across tasks.

Voluntary response index methodologies have been applied in diverse research areas, including incomplete spinal cord injuries (17, 18), shoulder dysfunction (19), trunk muscle fatigue (20), anterior cruciate ligament (ACL) injury (21), and trunk muscle activity during variable weight lifting (22). A higher SI value indicates superior motor control in voluntary tasks.

When selecting research tools or methods, verifying within-day reliability is essential to confirm their validity and consistency in replicating results across identical conditions and populations.

The reliability of MAG and SI was explored in individuals with incomplete spinal cord injuries (23), showing good to excellent reliability [MAG (ICC = 0.71 - 0.99), SI (ICC = 0.65 - 0.96)] in repeated tests. The reliability of BPA was also examined in football and track and field student-athletes (24), revealing perfect reliability (ICC = 0.93 - 0.98). However, the reliability of VRI in healthy professional athletic populations remains a subject of ongoing research. For example, Hajouj et al. assessed VRI reliability in athletes post-ACL reconstruction (25), discovering high to very high reliability during sit-stand-sit tasks and recommending this method for motor control assessment post-knee ligament injury. This underscores the importance of validating the VRI analysis method's reliability in participants with high physical fitness during varied functional tasks.

2. Objectives

The primary objective of our study was to evaluate the within-day reliability of the VRI, including the SI and MAG, as well as the BPA during the NHT in healthy professional football players. We hypothesized that both the VRI method and BPA would prove to be reliable tools for use in studies of motor control among professional athletes, particularly football players.

3. Methods

3.1. Study Participants

Twenty-four healthy male professional football players, aged between 21 and 34 years [mean age 26.4 ± 4.3 years, height 180 ± 6.4 cm, weight 73.6 ± 5.1 kg, BMI 22.6 ± 0.9 kg/m2 (mean ± SD)], participated in this study. The sample size was determined using online applications designed for research on reliability and measurement error (26). All participants scored 9 or higher on the Tegner activity scale and played in the second division of the Iranian football league (21). Players with a history of HM injury or other lower limb injuries, such as soft tissue damage and fractures in the past six months, hyperlordosis in the lumbar spine, or any neurological disorders, were excluded from the study (24). This research received approval from the Tabriz University of Medical Sciences Ethical Committee (IR.TBZMED.REC.1400.1089). All participants provided written informed consent and agreed to the publication of their data. They were also informed of their right to withdraw from the study at any time. The study took place in the Medical Committee laboratory of the Guilan football board in 2023.

3.2. Experimental Procedure

A single examiner, a physiotherapist with eight years of experience in sports physiotherapy, conducted all procedures. Participants were briefed on performing the NHT and completed a demographic questionnaire before the assessment. They were advised to avoid any high-intensity exercises for at least 48 hours before the test. Initially, a warm-up session consisting of muscle stretching exercises and a five-minute jog was conducted. Preparation of the skin for sEMG involved cleaning the electrode areas with alcohol and shaving any hair. Following the attachment of electrodes and verification of proper recording, participants performed three trials of the NHT.

3.3. Surface Electromyography Measurement

Muscular activities were recorded using an eight-channel portable sEMG system with 16-bit resolution (Biosignals Plux, Lisbon, Portugal). The recordings were made with preamplifier bipolar active electrodes. Each electrode had a 50 mm diameter and a 10 mm recording diameter, with a center-to-center distance of 20 mm, prepared by the examiner. The electrodes featured a built-in differential amplifier with a gain of 1000, an input impedance of over 100 GOhm, a common-mode rejection ratio of 100 dB, a bandwidth of 25 - 500 Hz, a sampling frequency of 1 kHz, and a 1 mA consumption. Reference electrodes were placed on the skin over the left proximal fibula head.

3.4. Electrode Placement

Surface EMG activity from the biceps femoris (BF), semitendinosus (ST), erector spinae (ES), and medial gastrocnemius (MG) muscles on both sides were recorded during the NHT (Figure 1). Electrode placement followed the recommendations of SENIAM (Surface EMG for Non-Invasive Assessment of Muscles) (27). The electrode for the BF was positioned at the midpoint between the lateral epicondyle of the femur and the ischial tuberosity. For the ST, the electrode was placed at the midpoint between the medial epicondyle of the femur and the ischial tuberosity. Medial gastrocnemius electrodes were positioned on the muscle's most prominent bulge, and ES electrodes were placed two fingers' width lateral to the spinous process of L1.

Electrode placement areas
Electrode placement areas
Figure 1.

Electrode placement areas

3.5. Nordic Hamstring Test

Participants performed three repetitions of the NHT with two-minute intervals between each repetition. Four LED markers were affixed to the lateral shoulder, hip, knee joints, and lateral malleolus by the examiner. The NHT began in a kneeling position with the trunk upright, knees flexed at 90°, and arms held by the sides. The examiner stabilized the participants' lower legs to support their body weight. Participants lowered their bodies forward towards the floor until reaching the maximum point of descent (Figure 2). They were instructed to keep the shoulder, hip, and knee joints aligned and to maintain this alignment throughout the NHT. Each trial was captured using an iPhone 7+ camera, set to record slow-motion video at 720 pixels and 240 frames per second, positioned two meters to the participant's left side. Angles were analyzed using Kinovea software (beta 0.08.27), whose validity and reliability have been established in recent research (28). This software identified LED markers in the video files, extracted joint coordinates, and plotted joint angle and speed diagrams for each trial participant. The BPA was identified as the point where the speed exceeded 10º/ second.

Nordic hamstring test (NHT) recorded by an iPhone camera: A, beginning; B, midpoint; C, end position of participants during NHT.
Nordic hamstring test (NHT) recorded by an iPhone camera: A, beginning; B, midpoint; C, end position of participants during NHT.
Figure 2.

Nordic hamstring test (NHT) recorded by an iPhone camera: A, beginning; B, midpoint; C, end position of participants during NHT.

3.6. Data Analysis

For the objective analysis of motor control during the NHT, we employed the VRI, a vector analysis method that includes two components. The MAG component quantifies the combined sEMG activity of all muscles as the length of the response vector (RV) for a given task. The SI reflects the consistency of sEMG activity distribution during a task. Initially, data files were imported into custom-developed MATLAB software (Math Works), and raw sEMG data were plotted (Figure 3). The moving average of the root mean square (RMS) values for eight muscles was calculated during each NHT attempt. The RV, composed of RMS values from all muscles of a participant, was then computed. Subsequently, a prototype response matrix (PRM) was generated using RVs from 10 professional players not included in the study. The prototype response vector (PRV) was derived from the PRM, and its MAG was determined using Equation 1. After calculating the participant's RV, the MAG of the subject's response vector (sRV) was determined using Equation 2. Finally, SI was calculated as the inner product of PRV and sRV, representing the cosine of the angle between them by Equation 3 (29). In the equations, PRV stands for prototype response vector, sRV for subject response vector, and the subsequent abbreviations denote muscles.

Raw EMG signal from one selected muscle (left medial gastrocnemius) during Nordic hamstring test (NHT).
Raw EMG signal from one selected muscle (left medial gastrocnemius) during Nordic hamstring test (NHT).
Figure 3.

Raw EMG signal from one selected muscle (left medial gastrocnemius) during Nordic hamstring test (NHT).

NMagnitude=PRV=PRV2RER+PRV2RBF+…+ PRV2LMG
sMagnitude=sRV=sRV2RER+sRV2RBF+…+ sRV2LMG
SI= PRVRER×sRVRER+⋯+PRVLMG×sRVLMGNMagnitude×sMagnitude

All statistical analyses were performed using SPSS software version 27. The Shapiro-Wilk test assessed data normality. The intra-class correlation coefficient (ICC) was used to evaluate test-retest (within-day) reliability. Intra-class correlation coefficient values were interpreted according to the Landis and Koch criteria (poor = 0 - 0.02, fair = 0.21 - 0.40, moderate = 0.41 - 0.60, substantial = 0.61 - 0.80, and almost perfect = 0.81 - 1 (30). The standard error of measurement (SEM) was calculated using the formula [SEM = Zα * SD * √(1 - ICC)]. The minimal detect change (MDC) was also determined with the formula 1.95 * √2 * SEM (31).

4. Results

Descriptive statistics, including means and standard deviations (SD) for MAG, SI, and BPA across three NHT trials, are detailed in Table 1. The reliability of VRI components (MAG, SI) and BPA is outlined in Table 2, featuring the ICC with a 95% confidence interval (CI), the standard error of measurement (SEM), and the minimal detectable change (MDC). The VRI components, MAG (ICC = 0.90) and SI (ICC = 0.81) demonstrated almost perfect reliability in the functional task. BPA exhibited substantial reliability (ICC = 0.65) during the NHT. A lower SEM indicates a reduced error in measurement across trials.

Table 1.

Descriptive Analysis of the Magnitude, Similarity Index, and Breakpoint Angle in the Nordic Hamstring Test (n = 24) a

VariablesTrial 1Trial 2Trial 3
MAG, mV0.45 ± 0.140.46 ± 0.130.46 ± 0.16
SI0.91 ± 0.040.92 ± 0.020.92 ± 0.03
BPA, °44.07 ± 6.1446.84 ± 4.8449.54 ± 8.54

Abbreviations: MAG, magnitude; SI, similarity index; BPA, breakpoint angle.

a Values are expressed as mean ± SD.

Table 2.

Reliability of VRI Components and BPA in NHT

VariablesICC (95%CI)SEMMDC
MAG, mV0.900.251.37
SI0.810.070.72
BPA, °0.6517.811.6

Abbreviations: ICC, intra-class correlation coefficient; CI, confidence interval; SEM, standard error of measurement; MDC, minimal detectable change; MAG, magnitude; SI, similarity index; BPA, breakpoint angle.

5. Discussion

This study aimed to evaluate the test-retest reliability of sEMG recordings using the novel VRI method and BPA in professional football players during a functional task (NHT). To our knowledge, this is the first study to explore the reliability of sEMG analysis via VRI during the NHT in professional football players. The findings indicated that VRI achieved almost perfect reliability, and BPA showed substantial reliability during the NHT among professional football players.

Surface EMG technology has traditionally been employed for assessing muscle activity for medical purposes. Literature suggests that surface electrode recordings may offer more reliability than needle EMG (32). This greater reliability and ease of use of sEMG make it a preferred choice for researchers conducting EMG analysis studies (32).

Recently, the VRI analysis method has been applied to evaluate motor control and muscular patterns by assessing the overall activity of muscles involved in specific motor tasks (15). Voluntary response index analysis can identify motor control deficits and compensatory strategies by examining the collective muscle activity involved in a task (16). In one study, VRI analysis was utilized to investigate differences in motor control patterns during a specific voluntary task in patients with incomplete spinal cord injuries (33).

The VRI method has also been applied in studying the motor control of shoulder muscles in patients with shoulder disorders across four functional tasks. It was discovered that lower SI values could indicate abnormal muscular patterns during these tasks (19).

In another study, VRI was used to assess the reciprocal coactivation of knee muscles in patients with patellofemoral pain syndrome, revealing ICC values ranging from 0.85 to 0.99 for VRI components (34).

The findings of the present study demonstrated nearly perfect reliability for the MAG (ICC = 0.90) and SI (ICC = 0.81). In a similar vein, Ghofrani et al. explored the reliability of trunk muscle VRI during the lifting of variable loads in healthy individuals (22), discovering that VRI was a reliable and repeatable method (ICC = 0.73 - 0.97) for assessing trunk muscle recruitment patterns during load lifting. Hajouj et al. assessed the reliability of the VRI approach in individuals with knee ligament injuries engaging in a specific voluntary motor task (35). Their findings indicated that VRI is a reliable technique (ICC = 0.75 - 0.92) for individuals who have undergone knee ligament surgery when performing functional tasks.

This study also revealed that the BPA could effectively illustrate hamstring eccentric strength in football players (12). The ICC for BPA was moderate (0.65) during the NHT. Sadri-Aghdam et al. recently assessed the reliability of BPA among recreational football players and track and field student-athletes during the NHT (24), showing high reliability (ICC = 0.93 - 0.98) for BPA in both groups.

The NHT's Similarity Index exhibited the lowest SEM and MDC, indicating a sensitive level of measurement error. The comparatively lower ICC for BPA in our study might be attributed to the higher physical activity levels of the athletes, who likely adopt varied strategies to prevent falling during the NHT compared to those in the study by Sadri-Aghdam et al. (24). The implications of this study are specifically relevant to professional football players; hence, further research is suggested to explore VRI in various sports and among athletes with hamstring injuries.

In our study, reliability was assessed among male professional football players. However, further research involving more participants and various sports disciplines is necessary to understand the differences between genders and sports.

In EMG analysis studies, skin preparation, electrode placement, and motion artifacts can influence sEMG data. The authors utilized best practices and appropriate filtering to minimize sEMG signal noise, recommending these procedures for future measurements.

Additionally, it is recommended that researchers design studies to assess the reliability of the VRI method during different competition seasons to account for variations in athletes' physical condition. Evaluating the VRI among athletes with and without Hamstring injuries is also suggested.

5.1. Conclusions

The results of these studies demonstrated almost perfect reliability for the VRI. Thus, utilizing VRI to assess motor control for specific tasks could be a beneficial and reliable method to evaluate the impact of eccentric exercise interventions on professional football players.

Acknowledgements

References

  • 1.

    Milanovic Z, Pantelic S, Covic N, Sporis G, Krustrup P. Is Recreational Soccer Effective for Improving VO2max A Systematic Review and Meta-Analysis. Sports Med. 2015;45(9):1339-53. [PubMed ID: 26210229]. [PubMed Central ID: PMC4536283]. https://doi.org/10.1007/s40279-015-0361-4.

  • 2.

    Klein C, Luig P, Henke T, Platen P. Injury burden differs considerably between single teams from German professional male football (soccer): surveillance of three consecutive seasons. Knee Surg Sports Traumatol Arthrosc. 2020;28(5):1656-64. [PubMed ID: 31324965]. https://doi.org/10.1007/s00167-019-05623-y.

  • 3.

    Hickey J, Shield AJ, Williams MD, Opar DA. The financial cost of hamstring strain injuries in the Australian Football League. Br J Sports Med. 2014;48(8):729-30. [PubMed ID: 24124035]. https://doi.org/10.1136/bjsports-2013-092884.

  • 4.

    Prior M, Guerin M, Grimmer K. An evidence-based approach to hamstring strain injury: a systematic review of the literature. Sports Health. 2009;1(2):154-64. [PubMed ID: 23015867]. [PubMed Central ID: PMC3445075]. https://doi.org/10.1177/1941738108324962.

  • 5.

    Opar D, Drezner J, Shield A, Williams M, Webner D, Sennett B, et al. Acute injuries in track and field athletes: a 3-year observational study at the Penn Relays Carnival with epidemiology and medical coverage implications. Am J Sports Med. 2015;43(4):816-22. [PubMed ID: 25560540]. https://doi.org/10.1177/0363546514562553.

  • 6.

    Fousekis K, Tsepis E, Poulmedis P, Athanasopoulos S, Vagenas G. Intrinsic risk factors of non-contact quadriceps and hamstring strains in soccer: a prospective study of 100 professional players. Br J Sports Med. 2011;45(9):709-14. [PubMed ID: 21119022]. https://doi.org/10.1136/bjsm.2010.077560.

  • 7.

    Brockett CL, Morgan DL, Proske U. Human hamstring muscles adapt to eccentric exercise by changing optimum length. Med Sci Sports Exerc. 2001;33(5):783-90. [PubMed ID: 11323549]. https://doi.org/10.1097/00005768-200105000-00017.

  • 8.

    Cuthbert M, Ripley N, McMahon JJ, Evans M, Haff GG, Comfort P. The effect of Nordic hamstring exercise intervention volume on eccentric strength and muscle architecture adaptations: a systematic review and meta-analyses. Sports Medicine. 2020;50:83-99.

  • 9.

    van der Horst N, Smits DW, Petersen J, Goedhart EA, Backx FJ. The preventive effect of the nordic hamstring exercise on hamstring injuries in amateur soccer players: a randomized controlled trial. Am J Sports Med. 2015;43(6):1316-23. [PubMed ID: 25794868]. https://doi.org/10.1177/0363546515574057.

  • 10.

    Al Attar WSA, Soomro N, Sinclair PJ, Pappas E, Sanders RH. Effect of Injury Prevention Programs that Include the Nordic Hamstring Exercise on Hamstring Injury Rates in Soccer Players: A Systematic Review and Meta-Analysis. Sports Med. 2017;47(5):907-16. [PubMed ID: 27752982]. https://doi.org/10.1007/s40279-016-0638-2.

  • 11.

    Lee JWY, Cai MJ, Yung PSH, Chan KM. Reliability, Validity, and Sensitivity of a Novel Smartphone-Based Eccentric Hamstring Strength Test in Professional Football Players. Int J Sports Physiol Perform. 2018;13(5):620-4. [PubMed ID: 29283704]. https://doi.org/10.1123/ijspp.2017-0336.

  • 12.

    Sconce E, Jones P, Turner E, Comfort P, Graham-Smith P. The validity of the nordic hamstring lower for a field-based assessment of eccentric hamstring strength. J Sport Rehabil. 2015;24(1):13-20. [PubMed ID: 25606859]. https://doi.org/10.1123/JSR.2013-0097.

  • 13.

    Lee JWY, Li C, Yung PSH, Chan KM. The reliability and validity of a video-based method for assessing hamstring strength in football players. J Exerc Sci Fit. 2017;15(1):18-21. [PubMed ID: 29541126]. [PubMed Central ID: PMC5812858]. https://doi.org/10.1016/j.jesf.2017.04.001.

  • 14.

    Lauer RT, Stackhouse CA, Shewokis PA, Smith BT, Tucker CA, McCarthy J. A time-frequency based electromyographic analysis technique for use in cerebral palsy. Gait Posture. 2007;26(3):420-7. [PubMed ID: 17161603]. https://doi.org/10.1016/j.gaitpost.2006.10.015.

  • 15.

    Lee DC, Lim HK, McKay WB, Priebe MM, Holmes SA, Sherwood AM. Toward an objective interpretation of surface EMG patterns: a voluntary response index (VRI). J Electromyogr Kinesiol. 2004;14(3):379-88. [PubMed ID: 15094151]. https://doi.org/10.1016/j.jelekin.2003.10.006.

  • 16.

    Lim HK, Lee DC, McKay WB, Protas EJ, Holmes SA, Priebe MM, et al. Analysis of sEMG during voluntary movement--Part II: Voluntary response index sensitivity. IEEE Trans Neural Syst Rehabil Eng. 2004;12(4):416-21. [PubMed ID: 15614997]. https://doi.org/10.1109/TNSRE.2004.838445.

  • 17.

    McKay WB, Lim HK, Priebe MM, Stokic DS, Sherwood AM. Clinical neurophysiological assessment of residual motor control in post-spinal cord injury paralysis. Neurorehabil Neural Repair. 2004;18(3):144-53. [PubMed ID: 15375274]. https://doi.org/10.1177/0888439004267674.

  • 18.

    Zoghi M, Galea M, Morgan D. A Brain Motor Control Assessment (BMCA) protocol for upper limb function. PLoS One. 2013;8(11). e79483. [PubMed ID: 24223953]. [PubMed Central ID: PMC3817096]. https://doi.org/10.1371/journal.pone.0079483.

  • 19.

    Lin JJ, Lim HK, Soto-quijano DA, Hanten WP, Olson SL, Roddey TS, et al. Altered patterns of muscle activation during performance of four functional tasks in patients with shoulder disorders: interpretation from voluntary response index. J Electromyogr Kinesiol. 2006;16(5):458-68. [PubMed ID: 16324850]. https://doi.org/10.1016/j.jelekin.2005.09.008.

  • 20.

    Talebian S, Hosseini M, Bagheri H, Olyaei GR, Reazasoltani A. Trunk muscle fatigue in subjects with a history of low back pain and a group of healthy controls measured by similarity index. J Back Musculoskelet Rehabil. 2011;24(1):17-22. [PubMed ID: 21248396]. https://doi.org/10.3233/BMR-2011-0270.

  • 21.

    Norouzi Fashkhami A, Rahimi A, Khademi Kalantari K. The Voluntary Response Index in Electromyographic Study During Landing Test of the Patients With ACL Deficiency: A New Study Protocol. Iran Red Crescent Med J. 2014;16(5). e14119. [PubMed ID: 25031855]. [PubMed Central ID: PMC4082515]. https://doi.org/10.5812/ircmj.14119.

  • 22.

    Ghofrani M, Olyaei G, Talebian S, Bagheri H, Kazemi P. Reliability of SEMG measurements for trunk muscles during lifting variable loads in healthy subjects. J Bodyw Mov Ther. 2017;21(3):711-8. [PubMed ID: 28750989]. https://doi.org/10.1016/j.jbmt.2016.12.003.

  • 23.

    Lim HK, Sherwood AM. Reliability of surface electromyographic measurements from subjects with spinal cord injury during voluntary motor tasks. J Rehabil Res Dev. 2005;42(4):413-22. [PubMed ID: 16320138]. https://doi.org/10.1682/jrrd.2004.07.0079.

  • 24.

    Sadri-Aghdam N, Rezaei M, Azghani MR, Ghaderi F, Adigozali H. The Relationship between Nordic Hamstring Test and Isokinetic Dynamometry in Football and Track and Field Student Athletes: a Cross-Sectional Study. Muscle Ligament Tendon J (MLTJ). 2020;10(4).

  • 25.

    Hajouj E, Hadian MR, Mir SM, Talebian S, Ghazi S. Motor Control Changes after Innovative Aquatic Proprioceptive Training in Athletes with Anterior Cruciate Ligament Reconstruction: Voluntary Response Index Analysis. Arch Neurosci. 2021;8(2). https://doi.org/10.5812/ans.112185.

  • 26.

    Mokkink LB, de Vet H, Diemeer S, Eekhout I. Sample size recommendations for studies on reliability and measurement error: an online application based on simulation studies. Health Serv Outcomes Res Method. 2022;23(3):241-65. https://doi.org/10.1007/s10742-022-00293-9.

  • 27.

    Hermens HJ, Freriks B, Disselhorst-Klug C, Rau G. Development of recommendations for SEMG sensors and sensor placement procedures. J Electromyogr Kinesiol. 2000;10(5):361-74. [PubMed ID: 11018445]. https://doi.org/10.1016/s1050-6411(00)00027-4.

  • 28.

    Puig-Divi A, Escalona-Marfil C, Padulles-Riu JM, Busquets A, Padulles-Chando X, Marcos-Ruiz D. Validity and reliability of the Kinovea program in obtaining angles and distances using coordinates in 4 perspectives. PLoS One. 2019;14(6). e0216448. [PubMed ID: 31166989]. [PubMed Central ID: PMC6550386]. https://doi.org/10.1371/journal.pone.0216448.

  • 29.

    Aslan SC, Chopra MK, McKay WB, Folz RJ, Ovechkin AV. Evaluation of respiratory muscle activation using respiratory motor control assessment (RMCA) in individuals with chronic spinal cord injury. J Vis Exp. 2013;(77). [PubMed ID: 23912611]. [PubMed Central ID: PMC3740445]. https://doi.org/10.3791/50178.

  • 30.

    Hanfelt JJ. Statistical approaches to experimental design and data analysis of in vivo studies. Breast Cancer Res Treat. 1997;46(2-3):279-302. [PubMed ID: 9478281]. https://doi.org/10.1023/a:1005946614343.

  • 31.

    Thomas JR, Martin P, Etnier JL, Silverman SJ. Research methods in physical activity. Champaign,Israel: Human kinetics; 2022.

  • 32.

    Pease WS, Elinski MA. Surface and wire electromyographic. Recording during fatiguing exercise. Electromyograph clin neurophysiology. 2003;43(5):267-71.

  • 33.

    Lim HK, Lee DC, McKay WB, Priebe MM, Holmes SA, Sherwood AM. Neurophysiological assessment of lower-limb voluntary control in incomplete spinal cord injury. Spinal Cord. 2005;43(5):283-90.

  • 34.

    Khaleghi F, Olyaei GR, Talebian S, Malmir K, Bagheri H, Ansari NN, et al. Knee muscle reciprocal co-activation in patellofemoral pain syndrome during isokinetic exercise: a voluntary response index analysis. J Clin Physiotherapy Res. 2016;1(1):6-11.

  • 35.

    Hajouj E, Hadian MR, Mir SM, Talebian S, Halabchi F, Ghazi S. Test-retest reliability of surface electromyographic measurements in athletes with anterior cruciate ligament reconstruction: A voluntary response index analysis. J Mod Rehabili. 2021;15(1):1-6.