Accuracy of Volatile Organic Compound (VOC) Detection in Exhaled Breath Compared to Reverse-transcriptase Polymerase Chain Reaction (RT-PCR) for Diagnosis of COVID-19: An Evidence-based Case Report

authors:

avatar Agus Dwi Susanto ORCID 1 , 2 , avatar Heidy Agustin 1 , 2 , avatar Muhammad Taufik 3 , avatar Mohammad Azizur Rahman 4 , avatar Moulid Hidayat ORCID 5 , *

Department of Pulmonology and Respiratory Medicine, Faculty of Medicine Universitas Indonesia-National Respiratory Center Persahabatan Hospital, Indonesia
Indonesian Society of Respirology, Jakarta, Indonesia
Faculty of Medicine, University of Indonesia, Jakarta, Indonesia
Faculty of Medicine, University of Dhaka, Bangladesh
Faculty of Medicine, University of Mataram, West Nusa Tenggara, Indonesia

how to cite: Susanto A D, Agustin H, Taufik M, Rahman M A, Hidayat M. Accuracy of Volatile Organic Compound (VOC) Detection in Exhaled Breath Compared to Reverse-transcriptase Polymerase Chain Reaction (RT-PCR) for Diagnosis of COVID-19: An Evidence-based Case Report. Arch Clin Infect Dis. 2022;17(5):e119263. https://doi.org/10.5812/archcid-119263.

Abstract

Background:

Coronavirus disease 2019 (COVID-19) is a contagious infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The World Health Organization (WHO) declared this infection a global pandemic in 2020. In addition, various methods have been developed to diagnose COVID-19 rapidly and accurately to reverse transcription-polymerase chain reaction (RT-PCR) as a gold standard method. One of these methods is the detection of volatile organic compounds (VOC) in exhaled breath.

Objectives:

The aim was to collect and investigate studies on the accuracy of VOC detection as a diagnostic method for COVID-19.

Methods:

A literature search was performed in five electronic databases, including PubMed, Cochrane Library, ProQuest, EBSCOhost, and Scopus, along with hand searching. The search was conducted in the titles and abstracts of articles using keywords and their equivalent terms, combined with the Boolean operators (OR and AND). The search results were then selected according to the inclusion and exclusion criteria and compatibility with the Population, Intervention, Control, and Outcomes (PICO) framework.

Results:

Based on the search results, two cross-sectional studies by Wintjens et al. and Ruszkiewicz et al. were selected, which were then critically appraised. Both studies showed good validity. Wintjens et al. reported 86% sensitivity and 54% specificity for their method, with a positive predictive value (PPV) and a negative predictive value (NPV) of 40% and 92%, respectively. Besides, Ruszkiewicz et al., who conducted a study in two different locations, reported 82.4% sensitivity and 75% specificity for their method in Edinburgh (UK), with PPV and NPV of 87.5% and 66.7%, respectively, while they reported 90% sensitivity and 80% specificity in Dortmund (Germany), with PPV and NPV of 45% and 97.8%, respectively. The accuracy of these three methods was 62%, 80%, and 82%, respectively.

Conclusions:

Detection of VOCs from exhaled breath can be a rapid, cost-effective, and simple method for diagnosing COVID-19. However, the accuracy of this method is still relatively low (62 - 82%) and inconsistent; therefore, it is only recommended for screening.

1. Background

Coronavirus disease 2019 (COVID-19) is a contagious infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). This novel RNA virus was first identified in pneumonia patients with a cluster of acute respiratory disease signs and symptoms in Wuhan, China, in 2019. COVID-19, declared a global pandemic by the World Health Organization (WHO) in March 2020, has spread rapidly worldwide (1).

SARS-CoV-2 is primarily transmitted between individuals through respiratory droplets and close contact. This disease has a broad clinical spectrum, ranging from asymptomatic cases to mild (e.g., fever, cough, fatigue, dyspnea, anosmia, and ageusia) and severe or critical (e.g., septic shock, multiorgan failure, and acute respiratory distress syndrome) symptoms (1, 2). Considering the pandemic status of COVID-19 and global concerns, various diagnostic tests have been developed to identify the patients. A rapid and accurate diagnosis of COVID-19 is essential not only for its clinical management but also for public health control and development of therapies. Traditional methods, such as cell culture and electron microscopy, are the gold standard methods for detecting new viruses in laboratories; however, they cannot be applied as routine tests.

Real-time reverse transcription-polymerase chain reaction (RT-PCR) of specimens collected from nasopharyngeal and/or oropharyngeal swabs has shown high sensitivity and specificity in detecting COVID-19; therefore, it has become the gold standard for COVID-19 diagnosis. Moreover, a rapid diagnostic test (RDT) has been developed for COVID-19, based on either a serological test of peripheral blood for detecting the patient's immune response to infection or detection of viral antigens in a nasopharyngeal swab. Radiological imaging modalities, such as computed tomography (CT) scans, can also provide additional information about radiological changes in the patient's lungs (3, 4).

In addition to the mentioned diagnostic methods, a diagnostic tool is currently being developed for COVID-19 by detecting the presence of volatile organic compounds (VOCs) from exhaled breath. Generally, exhaled breath contains thousands of metabolites and VOCs from the airway and internal organ systems, containing various microbiomes. In the form of commensal and pathogenic bacteria and viruses, microbiomes can produce different classes of VOCs; some can even act as biomarkers for diagnosing and monitoring various diseases (5).

Breath gas analysis of VOCs has become a growing field of research in recent years. During blood gas exchange in the pulmonary alveoli, carbon dioxide (CO2) is released, and oxygen (O2) is taken up from the inhaled air. This exchange also applies to volatile metabolites directly produced in the body or the lungs. Based on this mechanism, researchers are trying to detect volatile biomarkers in exhaled breath, which can indicate a disease or response to pharmacological treatments (6).

According to some studies, it is possible to directly detect SARS-CoV-2 from exhaled breath only by using specific devices that can collect and condense exhaled breath for several minutes. The virus can be extracted following the standard PCR method using this condensate. It has been extensively reported that the virus triggers the cells to produce metabolites, causing VOCs to be exhaled. These VOCs can be the target of breath diagnostics and used to assess the health status of patients non-invasively (7).

In 2021, Grassin-Delyle et al. reported the detection of SARS-CoV-2 directly from the exhaled breath and cough of patients with acute respiratory disease. This study aimed to demonstrate the efficacy of face masks in preventing viral diffusion and also suggested the possibility of direct viral detection from breath. This approach has attracted significant attention to other viral diagnostics. Overall, developing a non-invasive test to detect COVID-19 can be a significant step in managing this pandemic. There is a high probability that this disease can be detected in exhaled breath. Besides, monitoring the impact of treatment or medications on exhaled breath seems highly relevant (8).

A study by Chen et al. found that COVID-19 patients, compared to the average population, had a higher level of VOCs in the form of ethyl butanoate and lower levels of butyraldehyde and isopropanol (9). Another study reported that the four most prominent VOCs in COVID-19 were methylpent-2-enal, 2,4-octadiene 1-chloroheptane, and nonanal, with typical concentrations of 10 to 250 ppb (8). So far, using VOCs as a diagnostic tool has been combined with technologies, such as artificial intelligence (AI), deep sensing algorithms (DSA), and machine learning, to produce more accurate diagnostic methods.

COVID-19 diagnosis from exhaled breath can be a potentially rapid, non-invasive, cost-effective, and simple diagnostic method (10). The presence of VOCs in exhaled breath occurs in the early stages of infection, leading to the immediate detection of COVID-19.

2. Objectives

So far, comprehensive reviews have been published on the potential of VOCs as chemical biomarkers for diagnostics (11). However, the accuracy of this method in diagnosing COVID-19 has yet to be widely known. Therefore, this evidence-based study aimed to collect and examine existing studies on the accuracy of VOC detection in exhaled breath for diagnosis of COVID-19 and comparison of this method with RT-PCR.

2.1. Clinical Question

With this background in mind, the clinical question of this study was formulated, as shown in Table 1.

Table 1.

The PICO Framework and the Clinical Question

ParametersPopulationInterventionComparisonOutcomes
Patients indicated for COVID-19 testingVOCs in exhaled breath RT-PCR assay of nasopharyngeal and/or oropharyngeal swabsCOVID-19 diagnosis
Clinical questionHow accurate is the detection of VOCs from exhaled breath compared to RT-PCR in diagnosis of COVID-19?
Question typeDiagnosis
Study typeMeta-analysis, systematic review of cross-sectional studies, and cross-sectional

3. Methods

3.1. Search Strategy

A literature search was conducted in five databases, including PubMed, Cochrane Library, ProQuest, EBSCOHost, and Scopus, in April 2021. The search was carried out in the titles and abstracts of articles using the following keywords and their equivalent terms, combined with the Boolean operators (OR and AND): "volatile organic compounds," "polymerase chain reaction," and "COVID-19." The search queries from all databases and the results are presented in Table 2. Along with the search in the databases, a literature search was also carried out manually.

Table 2.

The Search Queries in the Databases, the Number of Hits, and the Number of Articles Retrieved

DatabasesSearch QueriesHitsSelected Articles
PubMed("Volatile organic compound" [Title/Abstract] OR "VOC" [Title/Abstract]) AND ("polymerase chain reaction" [Title/Abstract] OR "PCR" [Title/Abstract] OR "RT-PCR" [Title/Abstract]) AND ("COVID-19" [Title/Abstract] OR "SARS-CoV-2" [Title/Abstract] OR "coronavirus" [Title/Abstract])102
Cochrane Library((Volatile organic compound):ti,ab,kw OR (VOC):ti,ab,kw) AND (("polymerase chain reaction"):ti,ab,kw OR (PCR):ti,ab,kw OR (RT-PCR):ti,ab,kw) AND ((COVID-19):ti,ab,kw OR (SARS-CoV-2):ti,ab,kw OR (coronavirus):ti,ab,kw)10
ProQuest (("Volatile organic compound" OR "VOC") AND ("polymerase chain reaction" OR "PCR" OR "RT-PCR") AND ("COVID-19" OR "SARS-CoV-2" OR "coronavirus"):ab)70
EBSCOHost(("Volatile organic compound" OR "VOC") AND ("polymerase chain reaction" OR "PCR" OR "RT-PCR") AND ("COVID-19" OR "SARS-CoV-2" OR "coronavirus"):ab)70
Scopus(("Volatile organic compound" OR "VOC") AND ("polymerase chain reaction" OR "PCR" OR "RT-PCR") AND ("COVID-19" OR "SARS-CoV-2" OR "coronavirus"):ti,ab,kw)120

3.2. Search Selection

The search results of all five databases, besides the results of hand searching, yielded 38 articles. After preliminary screening for duplicates, 11 articles were excluded, and 27 remained in the review. Next, the titles and abstracts of the articles were screened. Eleven articles that did not match the Population, Intervention, Control, and Outcomes (PICO) format were excluded, leaving six articles. The full texts of the remaining articles were then analyzed according to the eligibility criteria. Finally, two articles were included in this review.

The eligibility criteria for the articles were as follows: (1) evaluation of populations indicated for COVID-19 testing; (2) cross-sectional studies, systematic reviews of cross-sectional studies, or meta-analyses; (3) use of VOCs from exhaled breath for diagnosis; and (4) collection of a PCR sample from the nasopharyngeal/oropharyngeal swab. On the other hand, articles that did not meet the inclusion criteria, were not written in English, and were not available in full text were excluded. The flowchart of the study selection is presented in Figure 1.

The flowchart of study selection
The flowchart of study selection

4. Results

4.1. Summary of Articles

Two studies conducted by Wintjens et al. (12) and Ruszkiewicz et al. (13) were examined in this study. Ruszkiewicz et al.’s study consisted of two analyses in two locations with different samples and analyses. The level of evidence was determined based on the 2011 Oxford Center of Evidence-Based Medicine (CEBM) criteria. The summary of these two studies is presented in Table 3.

Table 3.

Summary of the Articles

ParametersWintjens et al. (12)Ruszkiewicz et al. (13)
Title“Applying the electronic nose for pre-operative SARS-CoV-2 screening”“Diagnosis of COVID-19 by analysis of breath with gas chromatography ion mobility spectrometry: A feasibility study”
Study typeCross-sectionalCross-sectional
Level of evidence2 (CEBM, 2011)2 (CEBM, 2011)
Number of subjectsn = 219 Edinburgh study: n = 25; Dortmund study: n = 65
PopulationEmployees with symptoms of COVID-19 and confirmed COVID-19 patients in Maastricht University Medical Center (MUMC+, the Netherlands)Edinburgh study: Patients with respiratory symptoms of COVID-19 presenting to the emergency department of the Royal Infirmary of Edinburgh, UK. Dortmund study: Outpatients or patients with respiratory symptoms presenting to the emergency department of Klinikum Dortmund, Germany.
InterventionVOCs from exhaled breath detected with the Aeonose device (with a metal-oxide sensor)VOCs from exhaled breath detected via GC-IMS
ComparisonRT-PCR assay of nasopharyngeal/oropharyngeal swabsRT-PCR of nasopharyngeal/oropharyngeal swabs

4.2. Critical Appraisal

Three components of an article were investigated for the critical appraisal using the Oxford CEBM Critical Appraisal Tool: validity, importance, and applicability. The critical appraisal of studies included in this review is presented in the following tables (Tables 4 to 9).

Table 4.

Validity of Studies Included in the Analysis

Validity CriteriaWintjens et al. (12)Ruszkiewicz et al. (13)
Is the diagnostic test evaluated in a representative spectrum of patients?Yes, the population tested included patients indicated for COVID-19 testing who were consecutively admitted to a hospital.Yes, the population tested included patients indicated for COVID-19 testing who were consecutively admitted to a hospital.
Is the reference standard applied regardless of the index test result?Yes, the VOC breath test and RT-PCR were performed for all patients.Yes, the VOC breath test and RT-PCR were performed for all patients.
Is there an independent, blind comparison between the index test and the gold standard of diagnosis?No No
Table 5.

The Contingency of of the Study by Wintjens et al. (12)

Wintjens et al. (12)PCRTotal
+-
VOCs
+4975124
-88795
Total57162219
Table 6.

The Contingency of of the Study by Ruszkiewicz et al. in Edinburgh (13)

Ruszkiewicz et al. (13)PCRTotal
+-
VOCs
+14216
-369
Total17825
Table 7.

The Contingency of of the Study by Ruszkiewicz et al. in Dortmund, Germany (13)

Ruszkiewicz et al. (13)PCRTotal
+-
VOCs
+91120
-14445
Total105565
Table 8.

Importance of Studies Included in the Analysis

Importance CriteriaWintjens et al. (12)Ruszkiewicz et al. (13)Ruszkiewicz et al. (13)
Sensitivity, %8682.490
Specificity, %547580
PPV, %4087.545
NPV, %9266.797.8
LR (+)1.873.294.5
LR (-)0.260.240.125
Accuracy, %628082
Table 9.

Applicability of Studies Included in the Analysis

Applicability CriteriaWintjens et al. (12)Ruszkiewicz et al. (13)
Are the test methods described in sufficient detail to allow replication?Yes, the article presents a sufficient description of the test to allow its replication and interpretation of the results.Yes, the article presents a comprehensive description of the test to allow its replication and interpretation of the results.

The results of each study were entered into a 2 × 2 contingency table. As mentioned earlier, Ruszkiewicz et al. (13) conducted two analyses in different settings and reported different results; therefore, they were described separately in the table. Overall, three comparisons were made in terms of importance.

The results reported in these tables were then used to assess different aspects of importance.

5. Discussion

Generally, VOCs are the end products of carbohydrate and lipid metabolism, oxidative stress, and liver cytochrome p450 enzymes in human cells, besides aerobic and anaerobic fermentation processes by bacteria living in the gut microbiome (5). Under physiological conditions, various VOCs, such as acetate, propionate, short-chain fatty acids (SCFAs), alcohols, propanol, hydrocarbons, aldehydes, nitrogen, and sulfur-containing compounds, are exhaled from the human breath (14). However, many VOCs can act as biological markers for the detection of oxidative stress, inflammation, carcinogens, and microbial infections (15, 16).

In terms of COVID-19, a recent study by Chen et al. measured various VOCs from exhaled breath in COVID-19 patients and compared them with those of healthy controls and patients with a non-COVID respiratory infection or lung cancer. It was revealed that a VOC profile of lower butyraldehyde levels but higher ethyl butanoate levels corresponded to COVID-19 infection. In contrast, higher levels of butyraldehyde and ethyl butanoate probably resulted from infections caused by pathogens other than SARS-CoV-2 (9). Although this study had a small sample size, it could support the use of VOCs for the diagnosis of COVID-19.

Two studies were retrieved based on the literature search strategy and critically appraised. Both studies had a cross-sectional design, with a high level of evidence for diagnostic studies, according to the 2011 CEBM criteria (level 2). Also, the validity of diagnostic studies was appraised based on a representative spectrum of patients. The diagnostic test and reference standard were examined in all patients, and an independent, blind comparison was made between them. Both studies by Wintjens et al. (12) and Ruszkiewicz et al. (13) met the first two criteria, while there was no information regarding the independent, blind comparisons; however, it can be concluded that these studies are valid.

The critical aspects of the retrieved studies were appraised based on sensitivity, specificity, and predictive values. It should be noted that although in both studies, the diagnostic methods detected VOCs from exhaled breath, the devices used varied. In the study by Wintjens et al., an Aeonose device with a metal-oxide-based sensor was used for detecting VOCs in exhaled breath. The device showed 86% sensitivity with a negative predictive value (NPV) of 92%, while its specificity was 54% with the positive predictive value (PPV) of 40%. The high sensitivity and NPV implied that Aeonose was adequate in identifying people with COVID-19 and could be used for diagnostic triage to exclude a SARS-CoV-2 infection. However, the specificity and PPV were inappropriate; therefore, further investigation is required if an individual tests positive with this device.

Similar results were reported by Ruszkiewicz et al. (13) in Dortmund, Germany, as they reported high sensitivity (90%) with a high NPV (97.8%) and high specificity (80%) with a low PPV (45%) for their method. It can be concluded that the gas chromatography-ion migration spectroscopy (GC-IMS) method is also appropriate for excluding COVID-19, with fewer false-negative results, thereby making it a superior diagnostic triage tool. On the other hand, Ruszkiewicz et al. in Edinburgh showed a significantly lower NPV (66.7%) but a higher PPV (87.5%) compared to the other two studies. The sensitivity and specificity were also lower than those reported in the Dortmund study (82.4% and 75%, respectively). Overall, the results of their studies were not highly consistent, and their accuracy ranged from 62 to 82%.

In the study conducted by Ruszkiewicz et al., there is a possible bias from the patient's diet. The diet can influence exhaled VOCs and possibly produce confounding data and false positive results. However, in this study, the dietary factors were managed carefully (13). As for the study generated by Wintjens et al., the bias comes from using the RT-PCR test as a reference standard. As the RT-PCR procedure mainly has low sensitivity, the possibility of missing infected participants was high, resulting in an inaccurate study algorithm (12).

In terms of applicability, both studies described the tests in sufficient detail to allow replication. In the study by Wintjens et al., (12) Aeonose could be a rapid, low-cost, and non-invasive test for COVID-19; therefore, it was applicable in the triage of health facilities. Besides, Aeonose has been previously examined in Indonesia for the diagnosis of tuberculosis (17). GC-IMS is also widely used to detect VOCs in various respiratory diseases, such as acute respiratory distress syndrome (18).

5.1. Conclusions

Detection of VOCs from exhaled breath can be a rapid, cost-effective, and simple method for diagnosing COVID-19. However, the accuracy of this method still needs to be higher (62 - 82%), and the studies had a small sample size with inconsistent results. The tools used also varied and needed to be standardized. Although this method was proposed as a screening tool, further studies are required with a larger sample size and standardized equipment to obtain more accurate and consistent results.

References