Abstract
Background:
Emergence of multidrug-resistant Acinetobacter baumannii has resulted in the treatment failure of related infections and an increase in patient mortality. The presence of class D β-lactamases (oxacillinases) in this organism is an important mechanism underlying resistance to beta-lactam antibiotics.Objectives:
The aim of this work was to investigate the correlation between oxacillinase gene carriage and genetic fingerprints in imipenem-resistant burn and non-burn isolates of A. baumannii.Materials and Methods:
Fifty-eight A. baumannii isolates were collected from October 2011 to April 2012, which included 28 burn isolates from Shahid Motahari Hospital and 30 non-burn isolates from Imam Hossein Hospital. The minimum inhibitory and minimum bactericidal concentrations (MIC and MBC) of imipenem were measured by the broth microdilution method. The presence of oxacillinase genes (OXA-23-, OXA-24-, OXA-51-, and OXA-58-like genes) was shown using type-specific primers and PCR. Genetic profiles were generated by RAPD-PCR fingerprinting.Results:
OXA-23 was observed in 81% of the isolates and its distribution was similar within the two groups. The presence of OXA-51 was shown in 58.6% of the isolates, of which most were burn isolates (67.6%). OXA-24 was present in 20.7% of the isolates, all belonging to the burn group; OXA-58 was not observed in any of the isolates. RAPD-PCR fingerprints revealed two clusters at a similarity level of 70% (A, B). At a similarity level of 85%, nine different groups were observed for burn and non-bun isolates.Conclusions:
Our results showed that blaOXA-23 was the most prevalent gene, followed by blaOXA-51, among the burn and non-burn clinical isolates of A. baumannii. BlaOXA-24-like genes were detected at a lower level and were only found among the burn isolates, which also showed higher heterogeneity compared to the non-burn group.Keywords
1. Background
Emergence and spread of multidrug-resistant (MDR) Acinetobacter baumannii in nosocomial settings has become a serious concern in clinical practice. The organism commonly targets critically ill patients in intensive care units (ICU) and burn wards (1). The infections caused by this organism include bacteremia, ventilator-associated pneumonia, meningitis, and infections of the urinary tract, wounds, and burns (1, 2). Acinetobacter baumannii exhibits a variety of resistance mechanisms to all existing antibiotic classes, including active drug efflux, modification of drug target sites, and most importantly, enzymatic inactivation of the antimicrobial agents (2, 3). Carbapenems, especially imipenem, is often used as the drug of choice for treatment of A. baumannii infections. However recently, high levels of resistance have emerged, causing treatment failure (4, 5). The most common mechanism responsible for carbapenem resistance in A. baumannii is production of carbapenemases, including metallo-β-lactamases (MBLs) and class D β-lactamases (oxacillinases) which, class D β-lactamases have been reported as the most widespread carbapenemases in A. baumannii isolates (2, 5-8).
The first oxacillinase found in A. baumannii was observed in an imipenem-resistant strain in Scotland in 1985, which was later designated as OXA-23. Today, over 220 OXA-type enzymes have been reported (9). Among these, five main phylogenetic subgroups have been recognized in imipenem-resistant A. baumannii, including OXA-23-, OXA-24/40-, OXA-51-, OXA-58-, and more recently, OXA-143-like oxacillinases (10). The largest subgroup is the chromosomally encoded OXA-51, followed by OXA-23-like enzymes (10, 11). However, plasmid-mediated OXA-51 genes have also been reported (12). blaOXA-23- and blaOXA-24/40-like genes can be chromosomal or plasmid-mediated, whereas blaOXA-58-like genes are mostly plasmid-mediated (11). Rapid development of MDR strains, mostly owing to the horizontal transfer of antibiotic determinants among the isolates, makes it imperative to identify the underlying resistance mechanisms and study the epidemiology of these infections. Among the fingerprinting methods used, randomly amplified polymorphic DNA (RAPD) has been widely used to detect polymorphisms in many organisms, including A. baumannii.
2. Objectives
The objective of this study was to compare the presence of blaOXA-23-, blaOXA-24/40-, blaOXA-51-, and blaOXA-58-like genes in two groups of burn and non-burn clinical isolates of A. baumannii and study the clonal spread and heterogeneity of the isolates.
3. Materials and Methods
3.1. Bacterial Isolates
Fifty-eight A. baumannii isolates were collected from Imam Hossein (30 non-burn) and Shahid Motahari (28 burn) Hospitals from October 2011 to April 2012 in Tehran. Table 1 shows the distribution of different specimen types among burn and non-burn clinical isolates of A. baumannii. Phenotypic identification of the isolates was confirmed by standard biochemical tests; the isolates were maintained in brain heart infusion broth (Oxoid, UK) containing 10% dimethyl sulfoxide (v/v) at -20°C.
Distribution of Different Specimen Types among Burn and Non-Burn Clinical Isolates of Acinetobacter baumanniia
Isolate Group | Number of Isolates in Each Specimen Type | |||||
---|---|---|---|---|---|---|
Wound | Sputum | Blood | Catheter | CSF | Trachea | |
Burn | 25 | 3 | 0 | 0 | 0 | 0 |
Non-burn | 3 | 16 | 5 | 3 | 2 | 1 |
3.2. Imipenem Susceptibility Testing
The MIC and MBC of imipenem (Moon Chemicals, China) were determined by broth microdilution, according to the guidelines recommended by the Clinical and Laboratory Standards Institute (13).
3.3. Detection of OXA-Like Genes by PCR
DNA extraction was carried out by boiling. Briefly, a loopful of an overnight grown culture of each test isolate was suspended in 500 μL of sterile double-distilled water, boiled at 100°C for 10 min, and centrifuged at 13,000 × g for 10 minutes. The supernatant was then used as the DNA template for PCR amplification. blaOXA-23-, blaOXA-24-, blaOXA-51-, and blaOXA-58-like genes were detected by PCR using the primers listed in Table 2 (14). PCR reaction mixtures (25 μL) contained 1 μL of DNA template, 1.4 mM MgCl2, 0.2 mM each dNTP, 0.4 μM primer, and 0.625 U of Taq DNA polymerase in the buffer provided by the manufacturer (CinnaGen, Iran). The amplifications were performed in a thermocycler (Techne TC-3000G; UK), with the following program: initial denaturation at 94°C for 5 minutes, 33 cycles of 94°C for 25 seconds, 53°C for 40 seconds, and 72°C for 50 seconds, followed by a final elongation step at 72°C for 6 minutes (11). A. baumannii NCTC 13304 harboring blaOXA-23 and A. baumannii NCTC 12156 carrying blaOXA-51 were used as controls (15). PCR products were separated on 1% agarose gels and observed after staining with RedSafe (iNtRON Biotechnology, Korea) using an image analysis system (UVLtec; St John's Innovation Centre, UK).
Primers Used for Detection of OXA-Like Genes
Primer | Sequence | Product Size, bp |
---|---|---|
OXA-23 | 501 | |
Forward | 5´-GATCGGATTGGAGAACCAGA-3´ | |
Reverse | 5´-ATTTCTGACCGCATTTCCAT-3´ | |
OXA-24 | 246 | |
Forward | 5´-GGTTAGTTGGCCCCCTTAAA-3´ | |
Reverse | 5´-AGTTGAGCGAAAAGGGGATT-3´ | |
OXA-51 | 353 | |
Forward | 5´-TAATGCTTTGATCGGCCTTG-3´ | |
Reverse | 5´-TGGATTGCACTTCATCTTGG-3´ | |
OXA-58 | 599 | |
Forward | 5´-AAGTATTGGGGCTTGTGCTG-3´ | |
Reverse | 5´-CCCCTCTGCGCTCTACATAC-3´ |
3.4. Generation of DNA Fingerprints by RAPD-PCR
PCR reaction mixtures (25 μL) contained 2 μL of template DNA, 0.5 mM each dNTP, 4 mM MgCl2, 1.5 U of Taq polymerase, and 1 μM DAF4 primer (5´-CGGCAGCGCC-3´) in the buffer provided by the manufacturer (CinnaGen, Iran) (16). Amplifications were performed in a thermal cycler (Techne TC-3000G, UK) using the following program: denaturation at 94°C for 2 minutes followed by 45 cycles of denaturation at 94°C for 40 seconds, annealing at 48°C for 1 minute, and extension at 72°C for 40 seconds, with a final extension period of 5 minutes at 72°C. The PCR products were separated on 1.2% agarose gels, stained, and visualized as described above.
3.5. Statistical Analyses
Chi-square analysis was employed for the comparison of OXA gene carriage between the two groups of isolates using the SPSS version 21. Dendrograms for RAPD fingerprints were generated based on the band-matching coefficient of Dice, SAHN, and clustering in the unweighted pair group method with arithmetic averages (NTSYS-pc version 2.02; Exeter Software, Setauket, NY, USA).
4. Results
All isolates were resistant to imipenem with MIC and MBC values of > 32 μg/mL. However, these values for non-burn isolates ranged from 32 to 128 μg/mL, whereas the burn isolates had MIC and MBC values of > 128 – 1012 μg/mL, indicating even higher levels of resistance. The results of PCR amplifications (Figure 1) showed that blaOXA-23 was present in 47 isolates (81%), which was not significantly different between the two groups (78.6% burn vs. 83.3% non-burn). The presence of blaOXA-51 was shown in 34 isolates (58.6%), of which most were burn isolates (82.1% vs. 36.6%, P < 0.05). Interestingly, blaOXA-24 was found in 12 isolates (20.7%), all belonging to the burn group, and none of the isolates harbored blaOXA-58 (Figure 1). Overall, among the non-burn group, 16 isolates (53.3%) carried blaOXA-23 and two (6.7%) harbored blaOXA-51 alone, nine (30%) had both genes, and three did not carry any of the tested OXA genes. On the other hand, OXA-like genes were more widely distributed among the burn isolates, where one (3.6%), two (7.2%), and three (10.6%) isolates carried blaOXA-23, blaOXA-24, and blaOXA-51 alone, respectively. Twelve burn strains had both blaOXA-23 and blaOXA-51 (42.8%), two carried blaOXA-23/blaOXA-24 (7.2%), one harbored blaOXA-24/blaOXA-51 (3.6%), and seven isolates had all three OXA-like genes (25%). These results show a higher rate of multiple OXA gene carriage among the burn isolates and correlate with the higher imipenem MIC and MBC values obtained for the burn isolates.
Distribution of Oxacillinase Genes in Imipenem-Resistant Burn and Non-Burn Isolates of Acinetobacter baumannii
Figure 2 presents the RAPD fingerprints of A. baumannii isolates. Analysis of these fingerprints revealed two clusters (A and B) at a similarity level of 70% and nine groups at a similarity level of 85% (Figure 3). Table 3 shows the distribution of RAPD fingerprints among burn and non-burn isolates. Most of the burn isolates (n = 18, 64.3%) were placed in cluster B, of which, seven, eight, and three belonged to the groups B7, B8, and B9, respectively. Of the 10 burn isolates in cluster A, four, five, and one isolate were placed in the groups A3, A4, and A5, respectively (Table 3). Most of the non-burn strains belonged to cluster A (n = 21, 70%), of which majority (n = 16, 76.2%) were in the group A1 and the remaining five were found in groups A2 (n = 1), A3 and A4 (n = 2 each). The non-burn strains placed in cluster B were found in groups B6 and B7 (n = 4 each), and B8 (n = 1). These results suggest the clonal spread of A. baumannii in the clinical isolates from the two hospitals. However, a higher degree of heterogeneity was observed among the burn isolates compared to the non-burn isolates.
RAPD-PCR Finger Prints of Acinetobacter baumannii Clinical Isolates
Clonal Distribution of Acinetobacter baumannii Burn and Non-Burn Isolates Using RAPD-PCR Fingerprints at a Similarity Level of 85%
Distribution of RAPD-PCR Fingerprints among Burn and Non-Burn Cluster B (No. of Isolates)
5. Discussion
Nosocomial outbreaks of oxacillinase-producing A. baumannii have been reported worldwide. Among the five main phylogenic subgroups, the chromosomally located blaOXA-51-like gene has been used as a species-specific marker for the identification of A. baumannii (16-18). However, plasmid-mediated OXA-51 has also been detected in A. baumannii isolates (12). In addition, “non-baumannii” species of Acinetobacter have been shown to harbor blaOXA-51 (19). In the present study, 58.6% of the A. baumannii clinical isolates harbored blaOXA-51, majority of which were burn isolates. The prevalence of blaOXA-51 in the clinical isolates of A. baumannii was reported as 77.8% in Turkey and 85.3% in South Africa (20, 21). Iranian studies have mostly used the presence of blaOXA-51 as a tool to identify A. baumannii and have shown 100% carriage of the gene (18, 22, 23). The presence of blaOXA-51 does not correlate with the level of carbapenem resistance because the gene is regulated by the insertion sequence ISAba1; this indicates that resistance to carbapenems cannot be inferred solely from the detection of blaOXA-51-like genes (24). In contrast, genes encoding OXA-23, OXA-24, and OXA-58 enzymes are consistently associated with resistance or reduced susceptibility to imipenem (24). Among oxacillinases, OXA-23 has been shown as the most prevalent gene in Acinetobacter spp. worldwide, followed by blaOXA-51 (11, 25, 26). As found in the present study, several studies from Iran have found blaOXA-23 to be the most prevalent oxacillinase gene, and found much lower rates of blaOXA-24 and blaOXA-58 occurrence among A. baumannii clinical isolates (18, 23, 27).
Coexistence of multiple OXA genes has been reported in many studies. Feizabadi et al. showed that 25% and 17.9% of MDR A. baumannii carried blaOXA-51/blaOXA-23 and blaOXA-51/blaOXA-24, respectively (18). A study from Poland compared OXA gene carriage between burn and ICU isolates and found that blaOXA-51/blaOXA-24 genes were dominant in the ICU group and blaOXA-51/blaOXA-23-like genes were dominant among the burn isolates (28). Our results showed that only 30% of the non-burn isolates carried blaOXA-23/blaOXA-51, while 78.6% of the burn isolates harbored two to three oxacillinase genes.
Our RAPD-PCR results showed clear differences between the distribution of OXA genes in the two groups of isolates; higher heterogeneity was observed among the burn strains (Table 2). Sadeghifard et al. showed 6 RAPD-PCR patterns among Acinetobacter spp. isolates in Tehran and found distinguishable fingerprints for A. baumannii strains compared to the non-A. baumannii isolates (29). Popova et al. used RAPD-PCR to type 130 MDR A. baumannii strains and showed that all strains grouped into two clusters (A and B), of which 82% were in the two dominant groups (30). We also found two clusters among which the RAPD fingerprints of both groups of isolates were distributed. However, most of the burn isolates (64.3%) were placed in one cluster (B). Conversely, 70% of the non-burn isolates were placed in the second cluster (A). In addition, there was much higher heterogeneity among the burn isolates at a similarity level of 85%, compared to that among the non-burn isolates (Table 2). These results show the limited lineage of infection-causing A. baumannii isolates in hospital environments. The heterogeneity, when detected, would most probably be attributed to the horizontal transfer of genetic elements such as plasmids among individual isolates.
Acknowledgements
References
-
1.
Peleg AY, Seifert H, Paterson DL. Acinetobacter baumannii: emergence of a successful pathogen. Clin Microbiol Rev. 2008;21(3):538-82. [PubMed ID: 18625687]. https://doi.org/10.1128/CMR.00058-07.
-
2.
Maragakis LL, Perl TM. Acinetobacter baumannii: epidemiology, antimicrobial resistance, and treatment options. Clin Infect Dis. 2008;46(8):1254-63. [PubMed ID: 18444865]. https://doi.org/10.1086/529198.
-
3.
Manchanda V, Sanchaita S, Singh N. Multidrug resistant acinetobacter. J Glob Infect Dis. 2010;2(3):291-304. [PubMed ID: 20927292]. https://doi.org/10.4103/0974-777X.68538.
-
4.
Amudhan SM, Sekar U, Arunagiri K, Sekar B. OXA beta-lactamase-mediated carbapenem resistance in Acinetobacter baumannii. Indian J Med Microbiol. 2011;29(3):269-74. [PubMed ID: 21860108]. https://doi.org/10.4103/0255-0857.83911.
-
5.
Poirel L, Nordmann P. Carbapenem resistance in Acinetobacter baumannii: mechanisms and epidemiology. Clin Microbiol Infect. 2006;12(9):826-36. [PubMed ID: 16882287]. https://doi.org/10.1111/j.1469-0691.2006.01456.x.
-
6.
Lu PL, Doumith M, Livermore DM, Chen TP, Woodford N. Diversity of carbapenem resistance mechanisms in Acinetobacter baumannii from a Taiwan hospital: spread of plasmid-borne OXA-72 carbapenemase. J Antimicrob Chemother. 2009;63(4):641-7. [PubMed ID: 19182237]. https://doi.org/10.1093/jac/dkn553.
-
7.
Yang HY, Lee HJ, Suh JT, Lee KM. Outbreaks of imipenem resistant Acinetobacter baumannii producing OXA-23 beta-lactamase in a tertiary care hospital in Korea. Yonsei Med J. 2009;50(6):764-70. [PubMed ID: 20046415]. https://doi.org/10.3349/ymj.2009.50.6.764.
-
8.
Merino M, Acosta J, Poza M, Sanz F, Beceiro A, Chaves F, et al. OXA-24 carbapenemase gene flanked by XerC/XerD-like recombination sites in different plasmids from different Acinetobacter species isolated during a nosocomial outbreak. Antimicrob Agents Chemother. 2010;54(6):2724-7. [PubMed ID: 20385865]. https://doi.org/10.1128/AAC.01674-09.
-
9.
Paton R, Miles RS, Hood J, Amyes SG, Miles RS, Amyes SG. ARI 1: beta-lactamase-mediated imipenem resistance in Acinetobacter baumannii. Int J Antimicrob Agents. 1993;2(2):81-7. [PubMed ID: 18611526].
-
10.
Higgins PG, Dammhayn C, Hackel M, Seifert H. Global spread of carbapenem-resistant Acinetobacter baumannii. J Antimicrob Chemother. 2010;65(2):233-8. [PubMed ID: 19996144]. https://doi.org/10.1093/jac/dkp428.
-
11.
D'Arezzo S, Principe L, Capone A, Petrosillo N, Petrucca A, Visca P. Changing carbapenemase gene pattern in an epidemic multidrug-resistant Acinetobacter baumannii lineage causing multiple outbreaks in central Italy. J Antimicrob Chemother. 2011;66(1):54-61. [PubMed ID: 21088019]. https://doi.org/10.1093/jac/dkq407.
-
12.
Chen TL, Lee YT, Kuo SC, Hsueh PR, Chang FY, Siu LK, et al. Emergence and Distribution of Plasmids Bearing the blaOXA-51-like gene with an upstream ISAba1 in carbapenem-resistant Acinetobacter baumannii isolates in Taiwan. Antimicrob Agents Chemother. 2010;54(11):4575-81. [PubMed ID: 20713680]. https://doi.org/10.1128/AAC.00764-10.
-
13.
Performance Standards for Antimicrobial Susceptibility Testing: Twenty-first Informational Supplement. Wayne, PA: CLSI; 2011.
-
14.
Grundmann HJ, Towner KJ, Dijkshoorn L, Gerner-Smidt P, Maher M, Seifert H, et al. Multicenter study using standardized protocols and reagents for evaluation of reproducibility of PCR-based fingerprinting of Acinetobacter spp. J Clin Microbiol. 1997;35(12):3071-7.
-
15.
Shahcheraghi F, Abbasalipour M, Feizabadi M, Ebrahimipour G, Akbari N. Isolation and genetic characterization of metallo-beta-lactamase and carbapenamase producing strains of Acinetobacter baumannii from patients at Tehran hospitals. Iran J Microbiol. 2011;3(2):68-74. [PubMed ID: 22347585].
-
16.
Turton JF, Woodford N, Glover J, Yarde S, Kaufmann ME, Pitt TL. Identification of Acinetobacter baumannii by detection of the blaOXA-51-like carbapenemase gene intrinsic to this species. J Clin Microbiol. 2006;44(8):2974-6. [PubMed ID: 16891520]. https://doi.org/10.1128/JCM.01021-06.
-
17.
Zander E, Nemec A, Seifert H, Higgins PG. Association between beta-lactamase-encoding bla(OXA-51) variants and DiversiLab rep-PCR-based typing of Acinetobacter baumannii isolates. J Clin Microbiol. 2012;50(6):1900-4. [PubMed ID: 22422849]. https://doi.org/10.1128/JCM.06462-11.
-
18.
Feizabadi MM, Fathollahzadeh B, Taherikalani M, Rasoolinejad M, Sadeghifard N, Aligholi M, et al. Antimicrobial susceptibility patterns and distribution of blaOXA genes among Acinetobacter spp. Isolated from patients at Tehran hospitals. Jpn J Infect Dis. 2008;61(4):274-8. [PubMed ID: 18653968].
-
19.
Lee YT, Kuo SC, Chiang MC, Yang SP, Chen CP, Chen TL, et al. Emergence of carbapenem-resistant non-baumannii species of Acinetobacter harboring a blaOXA-51-like gene that is intrinsic to A. baumannii. Antimicrob Agents Chemother. 2012;56(2):1124-7. [PubMed ID: 22083478]. https://doi.org/10.1128/AAC.00622-11.
-
20.
Vahaboglu H, Budak F, Kasap M, Gacar G, Torol S, Karadenizli A, et al. High prevalence of OXA-51-type class D beta-lactamases among ceftazidime-resistant clinical isolates of Acinetobacter spp.: co-existence with OXA-58 in multiple centres. J Antimicrob Chemother. 2006;58(3):537-42. [PubMed ID: 16816400]. https://doi.org/10.1093/jac/dkl273.
-
21.
Kock MM, Bellomo AN, Storm N, Ehlers MM. Prevalence of carbapenem resistance genes in Acinetobacter baumannii isolated from clinical specimens obtained from an academic hospital in South Africa: original research. South Afr J Epidemiol Infect. 2013;28(1):28-32.
-
22.
Akbari M, Niakian M, Taherikalani M, Feizabadi MM, Azadi NA, Soroush S. Rapid identification of IranianAcinetobacter Baumanniistrains by single PCR assay usingBLAoxa-51-like carbapenemase and evaluation of the antimicrobial resistance profiles of the isolates. Acta Microbiol Immunol Hung. 2010;57(2):87-94. https://doi.org/10.1556/AMicr.57.2010.2.2.
-
23.
Karmostaji A, Najar Peerayeh S, Hatef Salmanian A. Distribution of OXA-Type Class D β-Lactamase Genes Among Nosocomial Multi Drug Resistant Acinetobacter baumannii Isolated in Tehran Hospitals. Jundishapur J Microbiol. 2013;6(5). eee8219. https://doi.org/10.5812/jjm.8219.
-
24.
Corvec S, Poirel L, Naas T, Drugeon H, Nordmann P. Genetics and expression of the carbapenem-hydrolyzing oxacillinase gene blaOXA-23 in Acinetobacter baumannii. Antimicrob Agents Chemother. 2007;51(4):1530-3. [PubMed ID: 17220422]. https://doi.org/10.1128/AAC.01132-06.
-
25.
Mugnier PD, Poirel L, Naas T, Nordmann P. Worldwide dissemination of the blaOXA-23 carbapenemase gene of Acinetobacter baumannii. Emerg Infect Dis. 2010;16(1):35-40. [PubMed ID: 20031040]. https://doi.org/10.3201/eid1601.090852.
-
26.
Carvalho KR, Carvalho-Assef AP, Peirano G, Santos LC, Pereira MJ, Asensi MD. Dissemination of multidrug-resistant Acinetobacter baumannii genotypes carrying bla(OXA-23) collected from hospitals in Rio de Janeiro, Brazil. Int J Antimicrob Agents. 2009;34(1):25-8. [PubMed ID: 19216059]. https://doi.org/10.1016/j.ijantimicag.2008.12.009.
-
27.
Goudarzi H, Douraghi M, Ghalavand Z, Goudarzi M. Assessment of antibiotic resistance pattern in Acinetobacter bumannii carrying bla oxA type genes isolated from hospitalized patients. Novelty Biomed. 2013;1(2):54-61.
-
28.
Nowak P, Paluchowska P, Budak A. Distribution of blaOXA genes among carbapenem-resistant Acinetobacter baumannii nosocomial strains in Poland. New Microbiol. 2012;35(3):317-25.
-
29.
Sadeghifard N, Ranjbar R, Zaeimi J. Antimicrobial susceptibility, plasmid profiles, and RAPD-PCR typing of Acinetobacter bacteria. Asian Biomed. 2011;4(6):901-11.
-
30.
Popova AV, Myakinina VP, Platonov ME, Volozhantsev NV. Molecular genetic characterization of multidrug-resistant Acinetobacter baumannii strains and assessment of their sensitivity to phage AP22. Mol Gen Microbiol Virol. 2012;27(4):154-9. https://doi.org/10.3103/s0891416812040064.