Abstract
Context:
The purpose of this study is to conduct a systematic review and meta-analysis into the effects of spinal manipulation or mobilization for lumbar disc herniation with radiculopathy (LDHR).Evidence Acquisition:
An electronic database search of titles and abstracts of articles published in English will be conducted in the following databases: PEDro (physiotherapy evidence database), CINAHL (cumulative index to nursing and allied health literature), PubMed, Science Direct, Google Scholar, and The Cochrane Library. The specific search strategies will depend on the particular database being searched. Hand searches of the reference lists of the included articles will be performed. Studies would be included if they reported an acceptable comparison group and at least one of the main clinically relevant outcome measures for LDHR. Two independent reviewers will screen the identified records and all disagreements will be resolved. The internal and external validities of the included studies will be assessed using the PEDro scale and the external validity assessment tool (EVAT), respectively. The clinical relevance and risk of bias of the studies will be determined using five criteria developed by the Cochrane Back Review Group and the Cochrane Risk of Bias Assessment Tool, respectively. Studies will be pooled into the meta-analysis where appropriate using RevMan software and the outcomes will be reported using the PRISMA guidelines.Conclusions:
This review will summarize the current evidence about the effects of spinal manipulation or mobilization compared with other interventions in the management of individuals with LDHR. A meta-analysis will also be conducted where appropriate in this review to compare the effects of spinal manipulation or mobilization and other interventions to find out which technique is better in the management of individuals with LDHR.Keywords
Spinal Manipulation Spinal Mobilization Lumbar Disc Herniation Systematic Review Meta-Analysis
1. Context
Lumbar disc herniation (LDH) is a common condition that frequently affects the spine in young and middle-aged individuals (1). This condition is usually treated when the disc material compresses the thecal sac or lumbar nerve roots (2). The pain that comes from LDH occurs due to a combination of some factors including nerve root ischemia and inflammation resulting from local pressure and degeneration of the disc material (3), which subsequently leads to lower limb radiculopathy (4).
Lumbar disc herniation with radiculopathy (LDHR) is treated using various therapies including surgical management (5), nonsurgical management (6), and a combination of many therapies (7). The possible reason for the existence of many different treatment strategies for the management of LDHR is that none of them seems to work all the time. One of the problems inherent in treating patients with LDHR is the difficulty in determining which intervention applies to which patients (8). However, during the last few decades, the paradigm regarding the best non-operative treatment to treat LDHR has shifted between spinal manipulation (9-17) and mobilization (18-25).
Even though there are a few recent systematic reviews (26, 27) that have examined the effects of spinal manipulation and mobilization, these reviews were largely conducted on participants with non-specific low-back (26, 27) and neck pains (27). Non-specific low-back or neck pain is quite unique and different from LDHR because the former is defined as the pain not attributable to a recognizable or known specific pathology (28) while the latter is defined as the localized displacement of disc material beyond the limits of the intervertebral disc space resulting in pain, weakness, or numbness in a myotome or dermatome distribution (29). Based on these definitions, it is very clear that the etiology of the pain in non-specific low-back or neck pain is often unknown and not categorized with a major pathogenic etiology, which is in contrast to LDHR.
Although a systematic review by Leininger et al. (30) collated the published evidence on the effects of spinal manipulation or mobilization for lumbar radiculopathy, the study failed to pool outcomes or identify who benefits more from spinal manipulation and who from mobilization. There are two potential explanations for the failure of the Leininger et al. review to identify this difference in treatment effect, including the poor reporting of data and the clinical heterogeneity of the included trials and their respective participants.
In addition, it has also been suggested that the median duration of survival time of a systematic review is 5.5 years, with almost one-quarter (23%) of the included studies being out of date in the first two years of publication (31). There has been a considerable growth in evidence-based practice since 2011, with an additional number of new trials being published. Therefore, a new study is highly warranted to gather the current evidence regarding the management of LDHR using spinal manipulation and/or mobilization. The objective of the current systematic review is to compare and summarize the current evidence regarding the effectiveness of spinal manipulation and/or mobilization for patients with radiculopathy due to lumbar disc herniation and if appropriate to identify who benefits more from manipulation and who from mobilization.
2. Methods
2.1. Data Sources
An electronic database search of titles and abstracts of articles published in English will be conducted in the following databases: PEDro (physiotherapy evidence database), CINAHL (cumulative index to nursing and allied health literature), PubMed, Science Direct, Google Scholar, and The Cochrane Library. The specific search strategies will depend on the particular database being searched. The MeSH criteria for PubMed and Cochrane database search strategies will be used. In PEDro, a simple search will be conducted, combining search terms separately. In CINAHL, Google Scholar, and Science Direct, all search terms will be combined. The keywords and search strategies used for the PubMed database are illustrated in Table 1. The reference lists of the included articles will also be manually searched. This review has been registered in the International Prospective Register of Systematic Reviews (PROSPERO; registration number: CRD42019131292). Any change regarding the review will be updated in the PROSPERO database.
PubMed Search Strategy
| No. | Search Terms |
|---|---|
| 1 | Spinal manipulation or high-velocity manipulative thrust or high-velocity low-amplitude manipulative thrust |
| 2 | Spinal mobilization or spinal apophyseal glides or spinal oscillations |
| 3 | Lumbar disc herniation or lumbar disc disease or lumbar disc lesion or lumbar disc proplapse or discogenic lumbar disc |
| 4 | 1, 2, and 3 |
2.2. Eligibility Criteria
Studies will be included if they meet the following criteria: (1) investigating male and/or female participants diagnosed with lumbar disc herniation of any duration, (2) recruiting participants with the age of 18 or above, (3) using spinal manipulation and/or mobilization of the spine as the primary therapy in at least one intervention group or in combination with other active treatments, (4) reporting an acceptable comparison group including no treatment, placebo, and any other type of active intervention, (5) evaluating outcome(s) including at least one of the main clinically relevant outcome measures for lumbar disc herniation (i.e., pain, functional ability, global perceived effect, sciatica frequency, sciatica bothersomeness, return to work, absenteeism, or recovery) using a valid instrument, and (6) randomized controlled or clinical trials (RCTs) published in English. Studies not performing between-group analyses for the measured outcomes will be excluded from the review.
2.3. Study Selection
Two independent reviewers will conduct the electronic database searches and screen the titles and abstracts of the retrieved studies (see Figure 1 for the review flow chart). After the removal of duplication records, full copies of potential eligible papers will be retrieved and screened by the two reviewers. The percentage of agreement between the reviewers will be assessed using Cohen’s kappa (κ) statistic method (32). Disagreements will be resolved by consensus with a third reviewer if applicable.
Study Selection Process
2.4. Data Extraction
Data to be extracted from the studies include study design, sample size, sex, age, participants, interventions, outcomes, and follow-up. In addition, the information will also be retrieved directly from previous systematic reviews conducted in the field of spinal manipulation and mobilization (26, 27, 30). Data will be extracted by two independent reviewers and will be cross-checked by other co-authors so that any disagreements will be resolved by consensus.
2.5. Methodological Quality Assessment
The methodological quality of the included studies will be reported in a table. The rating of trials on methodological quality (internal validity) will be carried out using the PEDro scale (supplementary file Appendix 1) (33). The scale was developed by Verhagen et al. (34) using the Delphi consensus technique to develop a list of criteria thought by the experts in the field to measure the methodological quality. The scoring of the PEDro scale depends on the number of items in the scale and the design of the included studies. Items 2 - 9 refer to the internal validity of studies and items 10 and 11 refer to the statistical analysis, ensuring sufficient data to enable appropriate interpretation of the results. Item one is related to the external validity of the included studies and thus, it will not be included in the total PEDro scores (35). Studies scoring ≥ 6 out of 10 will be considered as high-quality, while studies scoring ≤ 6 out of 10 will be considered as low-quality (36). The external validity of the included studies will be assessed using the external validity assessment tool (EVAT) (37). This tool measures the generalizability of studies to other individuals (external validity) and settings (model validity) outside the scope of a study.
2.6. Risk of Bias Assessment
The risk of bias will be assessed using the Cochrane risk of bias assessment tool (38). The tool uses five different items (selection bias, performance bias, detection bias, attrition bias, and reporting bias) to determine the quality of the included studies. The tool items will be rated on a three-point scale to assess the risk of bias (0 = high-risk, 1 = unclear risk, 2 = low-risk). The tool has a maximum score of 16 points and lower scores indicate a higher risk of bias.
2.7. Clinical Relevance
The clinical relevance of the included studies will be independently assessed by two reviewers using the five-criteria recommended by the Cochrane Back Review Group (supplementary file Appendix 2) (39). In addition, the authors will also extend the third criterion to require a paper to comment on the reliability and validity of the outcome measures used in their studies because reporting on such properties is recommended in the revised CONSORT statement (40).
2.8. Statistical Analysis
The included studies will be categorized under separate comparisons with clinically homogeneous characteristics. A priori list of items will be used for data extraction. Both descriptive data and quantitative data will be extracted regarding the primary and secondary outcome measures. With sufficient clinically and statistically homogeneous and comparable reported outcomes, data will be pooled with the aid of RevMan-5 software and a random or fixed-effects model will be used in the analysis (39). Between-study statistical heterogeneity will be assessed with the I2 statistic and this review will consider ≤ 25% as low, ≤ 50% as moderate, and ≥ 75% as high heterogeneity (41). To identify publication bias, funnel plots will be examined (42).
2.9. Sensitivity Analysis
The reliability of our results will be tested using sensitivity analysis (39). We have planned to assess the impact of using high-quality studies with low, medium, and high-quality combined studies.
3. Data Synthesis
Data synthesis will be performed to pool studies for inclusion into the meta-analysis. Meta-analysis in this study will be conducted in two parts. The first part will consist of studies that compared spinal manipulation with other interventions and the second part will consist of studies that compared spinal mobilization with other interventions. The criteria that will inform about the study choice for inclusion in the meta-analysis will be clinical homogeneity in the study population, study design, outcome measure, and duration. Any study that did not meet the clinical homogeneity criteria will not be considered for inclusion in the meta-analysis. In the case in which the meta-analysis is not feasible, the best evidence synthesis will be conducted using low-risk-of-bias studies. The overall quality of the evidence will be graded as high, moderate, low, or very low, according to the GRADE approach by Furlan et al. (39).
Statistical heterogeneity among included studies will be assessed using the index of variability, chi-square test (I2). If the I2 is ≤ 25%, studies will be considered homogeneous and the fixed-effects model will be used for the meta-analysis. If the I2 is ≥ 75%, studies will be considered highly heterogeneous and the random-effects model will be used for the meta-analysis (43). In addition, if all the included studies measured the same outcome and used the same measurement scale, the mean difference (MD) would be used to determine the effect measure. Furthermore, if all the included studies measured the same outcome but did not use the same measurement scale, the effect measure would be determined by two options. The first option is to convert the data so that all data are on the same scale. However, if this is not possible, then the standardized mean difference (SMD) will be used. The SMD is the MD standardized (adjusted) by the units of the standard deviation. There are many standardized effect measures but this systematic review will use Hedge’s g, which includes an adjustment for small sample bias and is used by default in the RevMan software (44).
4. Conclusions
This systematic review will investigate and give an overview of the current evidence on the effects of spinal manipulation or spinal mobilization in comparison with other interventions in the management of individuals with LDHR. A meta-analysis will also be conducted where appropriate in this review to compare the effects of spinal manipulation or mobilization and other interventions to find out which technique is better in the management of LDHR. In addition, studies conducting a neck-to-neck comparison of spinal manipulation with mobilization will be examined to determine which of the techniques is better in the management of LDHR. Furthermore, methodological limitations of the current review and that of the included trials will be reported to give recommendations for future research.
References
-
1.
Herkowitz HN. The spine. Saunders/Elsevier; 2011.
-
2.
Iorio R. Master techniques in orthopaedic surgery. J Bone Joint Surg. 2003;85(10):2067. https://doi.org/10.2106/00004623-200310000-00038.
-
3.
Majlesi J, Togay H, Unalan H, Toprak S. The sensitivity and specificity of the slump and the straight leg raising tests in patients with lumbar disc herniation. J Clin Rheumatol. 2008;14(2):87-91. [PubMed ID: 18391677]. https://doi.org/10.1097/RHU.0b013e31816b2f99.
-
4.
Carragee E. Surgical treatment of lumbar disk disorders. JAMA. 2006;296(20):2485-7. [PubMed ID: 17119147]. https://doi.org/10.1001/jama.296.20.2485.
-
5.
Jacobs WC, Arts MP, van Tulder MW, Rubinstein SM, van Middelkoop M, Ostelo RW, et al. Surgical techniques for sciatica due to herniated disc, a systematic review. Eur Spine J. 2012;21(11):2232-51. [PubMed ID: 22814567]. [PubMed Central ID: PMC3481105]. https://doi.org/10.1007/s00586-012-2422-9.
-
6.
Hahne AJ, Ford JJ, McMeeken JM. Conservative management of lumbar disc herniation with associated radiculopathy: A systematic review. Spine (Phila Pa 1976). 2010;35(11):E488-504. [PubMed ID: 20421859]. https://doi.org/10.1097/BRS.0b013e3181cc3f56.
-
7.
Dan-Azumi MS, Bello B, Rufai SA, Abdulrahman MA. Surgery versus conservative management for lumbar disc herniation with radiculopathy: A systematic review and meta-analysis. Journal of Health Sciences. 2018;8(1):42-53. https://doi.org/10.17532/jhsci.2018.479.
-
8.
Danazumi MS, Ibrahim SU, Abubakar MF, Yakasai AM, Zakari UU. Effect of spinal manipulation compared with spinal mobilization for lumbar disc herniation with radiculopathy: Design of a randomized clinical trial with 1 year follow-up. Middle East J Rehabil Health Stud. 2019;6(3). https://doi.org/10.5812/mejrh.92770.
-
9.
McMorland G, Suter E, Casha S, du Plessis SJ, Hurlbert RJ. Manipulation or microdiskectomy for sciatica? A prospective randomized clinical study. J Manipulative Physiol Ther. 2010;33(8):576-84. [PubMed ID: 21036279]. https://doi.org/10.1016/j.jmpt.2010.08.013.
-
10.
Peterson CK, Leemann S, Lechmann M, Pfirrmann CW, Hodler J, Humphreys BK. Symptomatic magnetic resonance imaging-confirmed lumbar disk herniation patients: A comparative effectiveness prospective observational study of 2 age- and sex-matched cohorts treated with either high-velocity, low-amplitude spinal manipulative therapy or imaging-guided lumbar nerve root injections. J Manipulative Physiol Ther. 2013;36(4):218-25. [PubMed ID: 23706678]. https://doi.org/10.1016/j.jmpt.2013.04.005.
-
11.
Burton AK, Tillotson KM, Cleary J. Single-blind randomised controlled trial of chemonucleolysis and manipulation in the treatment of symptomatic lumbar disc herniation. Eur Spine J. 2000;9(3):202-7. [PubMed ID: 10905437]. [PubMed Central ID: PMC3611397]. https://doi.org/10.1007/s005869900113.
-
12.
Santilli V, Beghi E, Finucci S. Chiropractic manipulation in the treatment of acute back pain and sciatica with disc protrusion: A randomized double-blind clinical trial of active and simulated spinal manipulations. Spine J. 2006;6(2):131-7. [PubMed ID: 16517383]. https://doi.org/10.1016/j.spinee.2005.08.001.
-
13.
Coxhead CE, Inskip H, Meade TW, North WR, Troup JD. Multicentre trial of physiotherapy in the management of sciatic symptoms. Lancet. 1981;1(8229):1065-8. [PubMed ID: 6112444]. https://doi.org/10.1016/s0140-6736(81)92238-8.
-
14.
Mathews JA, Mills SB, Jenkins VM, Grimes SM, Morkel MJ, Mathews W, et al. Back pain and sciatica: controlled trials of manipulation, traction, sclerosant and epidural injections. Br J Rheumatol. 1987;26(6):416-23. [PubMed ID: 2961394]. https://doi.org/10.1093/rheumatology/26.6.416.
-
15.
Postacchini F, Facchini M, Palieri P. Efficacy of various forms of conservative treatment in low back pain. A comparative study. Neuro Orthoped. 1988;6:28-35.
-
16.
Timm KE. A randomized-control study of active and passive treatments for chronic low back pain following L5 laminectomy. J Orthop Sports Phys Ther. 1994;20(6):276-86. [PubMed ID: 7849747]. https://doi.org/10.2519/jospt.1994.20.6.276.
-
17.
Liu J, Zhang S. Treatment of protrusion of lumbar intervertebral disc by pulling and turning manipulations. J Tradit Chin Med. 2000;20(3):195-7. [PubMed ID: 11038982].
-
18.
Kumar SP, Cherian PJ. Efficacy of spinal mobilization in the treatment of patients with lumbar radiculopathy due to disc herniation: A randomized clinical trial. Int J Neurol Neurosurg. 2011;3(2):65-76.
-
19.
Lopez-Diaz JV, Arias-Buria JL, Lopez-Gordo E, Lopez Gordo S, Oyarzun AP. "Effectiveness of continuous vertebral resonant oscillation using the POLD method in the treatment of lumbar disc hernia". A randomized controlled pilot study. Man Ther. 2015;20(3):481-6. [PubMed ID: 25511449]. https://doi.org/10.1016/j.math.2014.11.013.
-
20.
Yadav S, Nijhawan MA, Panda P. Effectiveness of spinal mobilization with leg movement (SMWLM) in patients with lumbar radiculopathy (L5/S1 nerve root) in lumbar disc herniation. Int J Physiother Res. 2014;2(5):712-8.
-
21.
Das SMS, Dowle P, Iyengar R. Effect of spinal mobilization with leg movement as an adjunct to neural mobilization and conventional therapy in patients with lumbar radiculopathy: Randomized controlled trial. J Med Sci Res. 2018;6(1):11-9. https://doi.org/10.17727/jmsr.2018/6-3.
-
22.
Ahmed N, Khan Z. Comparison of mulligans spinal mobilization with limb movement (SMWLM) and neural tissue mobilization for the treatment of lumbar disc herniation: A randomized clinical trial. J Novel Physiother. 2016;6(4):304. https://doi.org/10.4172/2165-7025.1000304.
-
23.
Paatelma M, Kilpikoski S, Simonen R, Heinonen A, Alen M, Videman T. Orthopaedic manual therapy, McKenzie method or advice only for low back pain in working adults: A randomized controlled trial with one year follow-up. J Rehabil Med. 2008;40(10):858-63. [PubMed ID: 19242624]. https://doi.org/10.2340/16501977-0262.
-
24.
Hofstee DJ, Gijtenbeek JM, Hoogland PH, van Houwelingen HC, Kloet A, Lotters F, et al. Westeinde sciatica trial: Randomized controlled study of bed rest and physiotherapy for acute sciatica. J Neurosurg. 2002;96(1 Suppl):45-9. [PubMed ID: 11797655]. https://doi.org/10.3171/spi.2002.96.1.0045.
-
25.
Gudavalli MR, Cambron JA, McGregor M, Jedlicka J, Keenum M, Ghanayem AJ, et al. A randomized clinical trial and subgroup analysis to compare flexion-distraction with active exercise for chronic low back pain. Eur Spine J. 2006;15(7):1070-82. [PubMed ID: 16341712]. [PubMed Central ID: PMC3233943]. https://doi.org/10.1007/s00586-005-0021-8.
-
26.
Coulter ID, Crawford C, Hurwitz EL, Vernon H, Khorsan R, Suttorp Booth M, et al. Manipulation and mobilization for treating chronic low back pain: A systematic review and meta-analysis. Spine J. 2018;18(5):866-79. [PubMed ID: 29371112]. [PubMed Central ID: PMC6020029]. https://doi.org/10.1016/j.spinee.2018.01.013.
-
27.
Roenz D, Broccolo J, Brust S, Billings J, Perrott A, Hagadorn J, et al. The impact of pragmatic vs. prescriptive study designs on the outcomes of low back and neck pain when using mobilization or manipulation techniques: A systematic review and meta-analysis. J Man Manip Ther. 2018;26(3):123-35. [PubMed ID: 30042627]. [PubMed Central ID: PMC6055961]. https://doi.org/10.1080/10669817.2017.1398923.
-
28.
Maher C, Underwood M, Buchbinder R. Non-specific low back pain. Lancet. 2017;389(10070):736-47. [PubMed ID: 27745712]. https://doi.org/10.1016/S0140-6736(16)30970-9.
-
29.
Kreiner DS, Hwang SW, Easa JE, Resnick DK, Baisden JL, Bess S, et al. An evidence-based clinical guideline for the diagnosis and treatment of lumbar disc herniation with radiculopathy. Spine J. 2014;14(1):180-91. [PubMed ID: 24239490]. https://doi.org/10.1016/j.spinee.2013.08.003.
-
30.
Leininger B, Bronfort G, Evans R, Reiter T. Spinal manipulation or mobilization for radiculopathy: A systematic review. Phys Med Rehabil Clin N Am. 2011;22(1):105-25. [PubMed ID: 21292148]. https://doi.org/10.1016/j.pmr.2010.11.002.
-
31.
Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147(4):224-33. [PubMed ID: 17638714]. https://doi.org/10.7326/0003-4819-147-4-200708210-00179.
-
32.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74. [PubMed ID: 843571].
-
33.
Maher CG, Sherrington C, Herbert RD, Moseley AM, Elkins M. Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther. 2003;83(8):713-21. [PubMed ID: 12882612].
-
34.
Verhagen AP, de Vet HCW, de Bie RA, Kessels AGH, Boers M, Bouter LM, et al. The Delphi list: A criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol. 1998;51(12):1235-41. https://doi.org/10.1016/s0895-4356(98)00131-0.
-
35.
Sherrington C, Herbert RD, Maher CG, Moseley AM. PEDro. A database of randomized trials and systematic reviews in physiotherapy. Man Ther. 2000;5(4):223-6. [PubMed ID: 11052901]. https://doi.org/10.1054/math.2000.0372.
-
36.
Moseley AM, Herbert RD, Sherrington C, Maher CG. Evidence for physiotherapy practice: A survey of the Physiotherapy Evidence Database (PEDro). Aust J Physiother. 2002;48(1):43-9. [PubMed ID: 11869164]. https://doi.org/10.1016/s0004-9514(14)60281-6.
-
37.
Khorsan R, Crawford C. How to assess the external validity and model validity of therapeutic trials: A conceptual approach to systematic review methodology. Evid Based Complement Alternat Med. 2014;2014:694804. [PubMed ID: 24734111]. [PubMed Central ID: PMC3963220]. https://doi.org/10.1155/2014/694804.
-
38.
Furlan AD, Malmivaara A, Chou R, Maher CG, Deyo RA, Schoene M, et al. 2015 updated method guideline for systematic reviews in the Cochrane Back and Neck Group. Spine (Phila Pa 1976). 2015;40(21):1660-73. [PubMed ID: 26208232]. https://doi.org/10.1097/BRS.0000000000001061.
-
39.
Furlan AD, Pennick V, Bombardier C, van Tulder M; Editorial Board Cochrane Back Review Group. 2009 updated method guidelines for systematic reviews in the Cochrane Back Review Group. Spine (Phila Pa 1976). 2009;34(18):1929-41. [PubMed ID: 19680101]. https://doi.org/10.1097/BRS.0b013e3181b1c99f.
-
40.
Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, et al. CONSORT for reporting randomized controlled trials in journal and conference abstracts: Explanation and elaboration. PLoS Med. 2008;5(1). e20. [PubMed ID: 18215107]. [PubMed Central ID: PMC2211558]. https://doi.org/10.1371/journal.pmed.0050020.
-
41.
Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557-60. [PubMed ID: 12958120]. [PubMed Central ID: PMC192859]. https://doi.org/10.1136/bmj.327.7414.557.
-
42.
Liu JL. The role of the funnel plot in detecting publication and related biases in meta-analysis. Evid Based Dent. 2011;12(4):121-2. [PubMed ID: 22193659]. https://doi.org/10.1038/sj.ebd.6400831.
-
43.
Papageorgiou SN. Meta-analysis for orthodontists: Part I--How to choose effect measure and statistical model. J Orthod. 2014;41(4):317-26. [PubMed ID: 25404668]. https://doi.org/10.1179/1465313314Y.0000000111.
-
44.
Engels EA, Schmid CH, Terrin N, Olkin I, Lau J. Heterogeneity and statistical significance in meta-analysis: An empirical study of 125 meta-analyses. Stat Med. 2000;19(13):1707-28. https://doi.org/10.1002/1097-0258(20000715)19:13<1707::aid-sim491>3.0.co;2-p.