- Research article
- Open Access
Essential properties and pitfalls of colorimetric Reverse Transcription Loop-mediated Isothermal Amplification as a point-of-care test for SARS-CoV-2 diagnosis
Molecular Medicine volume 27, Article number: 30 (2021)
SARS-CoV-2 Reverse Transcription Loop-mediated Isothermal Amplification (RT-LAMP) colorimetric detection is a sensitive and specific point-of-care molecular biology technique used to detect the virus in only 30 min. In this manuscript we have described a few nuances of the technique still not properly described in the literature: the presence of three colors clusters; the correlation of the viral load with the color change; and the importance of using an internal control to avoid false-negative results.
To achieve these findings, we performed colorimetric RT-LAMP assays of 466 SARS-CoV-2 RT-qPCR validated clinical samples, with color quantification measured at 434 nm and 560 nm.
First we determinate a sensitivity of 93.8% and specificity of 90.4%. In addition to the pink (negative) and yellow (positive) produced colors, we report for the first time the presence of an orange color cluster that may lead to wrong diagnosis. We also demonstrated using RT-qPCR and RT-LAMP that low viral loads are related to Ct values > 30, resulting in orange colors. We also demonstrated that the diagnosis of COVID-19 by colorimetric RT-LAMP is efficient until the fifth symptoms day when the viral load is still relatively high.
This study reports properties and indications for colorimetric RT-LAMP as point-of-care for SARS-CoV-2 diagnostic, reducing false results, interpretations and optimizing molecular diagnostics tests application.
The emergence of COVID-19 pandemic caused by SARS-CoV-2 began in Wuhan, China in December 2019, and since then this virus has infected over 89 million people around the globe. Despite its low mortality rate, according to the World Health Organization (WHO) its rapid spread has caused the death of more than a 1.9 million people in 2020 (https://covid19.who.int/, last accessed January 12, 2021). SARS-CoV-2 is a positive, single-stranded RNA virus related to the group of severe acute respiratory syndrome viruses. COVID-19 may develop from typical flu symptoms to severe pneumonia in 2 days to 2 weeks after first contact with the virus (Zhou et al. 2020). People with underlying medical conditions and the elderly are especially at risk to develop the most severe form of the disease (Emami et al. 2020). Currently, there is no specific treatment for COVID-19. Meanwhile, it is necessary to control the virus spread with a strong and rapid health vigilance and a reliable diagnostic tool for large-scale screening (Ali et al. 2020). At the moment, Real time reverse transcription-PCR (RT-qPCR) is the gold standard method for COVID-19 diagnosis. This molecular biology technique is able to detect the virus in approximately 2 h with high sensitivity and specificity. RT-qPCR simultaneously detects viral and human RNA, using specific primers for the viral RNA and for a housekeeping human gene (Corman et al. 2019; Lübke et al. 2020). Despite its high efficiency, this method has some limitations for large-scale testing, such as high costs, requirement of special facilities and trained personnel.
The implementation of a point-of-care approach is of urgent importance to control the pandemics, especially in less developed countries where there are limited resources. An efficient point-of-care test must be rapid, accessible, sensitive, specific and able to be performed without the necessity of special facilities or equipment (Gouilh et al. 2020; Osterdahl et al. 2020). The priority would be to apply this approach in airports, hospitals and in rural areas (Mautner et al. 2020).
The LAMP method was developed during 2000 by Notomi et al., where the nucleic acid amplification is carried by DNA polymerase from Bacillus stearothermophilus (Bst), an enzyme with both DNA polymerase and reverse transcriptase activity. This method is performed with 4 primers, two inner (FIP and BIP) and two outer (F3 and B3) primers, or usually 6 primers, the same 4 and more two loop primers (LF and LB), to improve and accelerate amplification. The DNA amplification in LAMP method is initiated by multiple primers simultaneously, making this an efficient and sensible technique. Detection method involves such agarose gel electrophoresis, colorimetric naked eye, sample turbidity and fluorescence. The reverse-transcription loop-mediated isothermal amplification (RT-LAMP) has been extensively applied for the diagnosis of many pathogens (Ahn et al. 2019; Imai et al. 2006; Sukphattanaudomchoke et al. 2020; Techathuvanan and D’Souza 2020), and can amplify RNA molecules in usually 30 min with high sensitivity and specificity in a single temperature, ranging from 60 to 65 °C (Notomi et al. 2000; Tomita et al. 2008; Ushikubo 2004). Due to this characteristic the test can be performed in heat blockers or any other device able to maintain a single temperature for the time needed. It is a cheap and reliable assay, that does not require special personnel and facilities. Therefore, RT-LAMP has all the necessary requirements for point-of-care applications, even more than reports demonstrating the use of RT-LAMP with crude clinical samples such as saliva, or with minimal sample processing (Augustine et al. 2020; Yamazaki et al. 2021; Howson et al. 2021; Chow et al. 2020; Wei et al. 2021). Moreover, immunological lateral-flow as point-of-care test for SARS-CoV-2 usually present low accuracy for IgM detection (Chembio Diagnostic system DPP® 2020; Haguet et al. 2021, Dortet et al. 2021). Again, lateral-flow as point-of-care targeting SARS-CoV-2 antigen relies low sensitivity and accuracy (Wise 2020; Coris BioConcept 2020; JMH Labour and Welfare 2020). More than that, lateral-flow tests allow just one sample per test while RT-LAMP multiple samples can be performed in a single run.
RT-LAMP for SARS-CoV-2 detection has already been widely studied and reported in literature (Gouilh et al. 2020; Lalli et al. 2020; Thi et al. 2020). When the primers are well designed, the test is highly specific and does not show cross reactivity with other pathogens (Meagher et al. 2018). RT-LAMP is also able to detect low copies of the virus, demonstrating its extremely promising sensitivity (Huang et al. 2020; Yan et al. 2020). Many authors optimize the reactions using pH indicators and fluorescent dyes to visualize the result by naked eye, eliminating the agarose gel step (Mautner et al. 2020; Zhang et al. 2020). This approach turns RT-LAMP cheaper and even more accessible. With that in mind, RT-LAMP is one of the most relevant point-of-care tools reported in literature recently. However, many authors do not associate the reaction with the use of an internal control as in RT-qPCR, which in our opinion compromises the fidelity of the results.
The internal control is used to prove the presence of RNA in the sample. Usually, it is used in a duplex, where human and viral RNA are detected simultaneously. The use of internal controls is mainly used in RT-qPCR but not in other assays (Vandesompele et al. 2002). If a sample turns positive for SARS-CoV-2 but not for the internal control, it is considered an invalid result. It indicates a problem either in the RNA extraction process or in sample collection. The use of an internal control is of paramount importance to minimize the occurrence of technical errors and false results. Generally, authors who suggest RT-LAMP as a point-of-care approach do not use internal controls, which seriously compromises the quality of the results obtained.
In this work, we propose a COVID-19 diagnosis assay for fast detection of SARS-CoV-2 virus based on RT-LAMP with the addition of an internal control. In both cases, the whole reaction can be performed in only 30 min, and positive or negative samples could be easily detected by naked eye through simple color change. We demonstrated how the internal control must be applied for results validation. These assays were validated using 466 clinical samples with 93.8% sensitivity. We further evaluated Ct cut-off values to improve RT-LAMP performance, its relation with high and low viremia, and how Ct values are determinant to establish a limitation for the colorimetric test.
Samples and ethical statement
Four hundred sixty-six clinical samples were collected from SARS-CoV-2 symptomatic patients from May to November 2020 in Erasto Gaertner Hospital (Curitiba—Brazil) after Local Ethics Committee approval (CAAE 31592620.4.3001.5248 and 31592620.4.1001.0098). All samples collection and experimental conduction were carried out in accordance with relevant guidelines and brazilian regulations. All recruted patients have written a consent. On the first day in the hospital, two nasal and one oral rayon-swabs were collected in 3 mL of 1 × PBS. The RNA extraction was performed with QIAmp Viral RNA Mini Kit (Qiagen) as described by the manufacturer. Symptom days were collected as patient self-declaratory data.
RT-qPCR protocol (Corman et al. 2020) was used as a gold-standard method for SARS-CoV-2 detection. Primers and probes for SARS-CoV-2 E-gene (FAM) and human RNase P (HEX) were acquired from Integrated DNA Technoogies (IDT, United States), and resuspended in nuclease-free water (Invitrogen, United States). Reactions were performed with SuperScript™ III Platinum™ One-Step qRT-PCR Kit (ThermoFisher, United States) and 5 μL of RNA at 50 °C for 30 min, 95 °C for 5 min, 45 cycles of 95 °C for 15 s and 58 °C for 30 s using the LightCycler96 platform (Roche, Germany). As positive control, we used RNA extracted from supernatants of SARS-CoV-2 cultured in Vero cells using QIAamp® RNA viral Mini Kit (Qiagen, Germany), following the manufacturer’s instructions. The RNA and consequent viral genome quantification were performed by real-time PCR on LightCycler® 96 (Roche, Germany) using the same primers and probes and an E-gene standard curve (SARS-CoV Frankfurt1; Full virus RNA, Lot2; Institute of Virology, Charité). Samples with a Ct lower than 35 in E-gene were considered SARS-CoV-2 positives. To validate the procedure, the samples had to amplify the internal control RNase P at a maximum Ct of 35.
RT-LAMP primers, assays and quantification
After literature screening for SARS-CoV-2 colorimetric RT-LAMP primer sets we selected those described by Rabe and Cepko 2020, named Orf1a-HMS, with FIP and BIP primers with 4 thymidine residues inserted in the middle (Orf1a-HMSe) (see Additional file 1: Table S1). For internal control, the primer set was designed by PrimerExplorer V5 (https://primerexplorer.jp/e/) for human 18S RNA sequence. Reactions were performed with WarmStart® Colorimetric LAMP 2X Master Mix (NEB, England), in a volume of 25 μL with 6 μL of primer mix (FIP and BIP at 1.6 μM each, FOP and BOP at 0.2 μM each and FL and BL at 0.4 μM each) and 5 μL of RNA sample. The reactions were incubated at 65 °C for 30 min using the ProFlex PCR System (Applied Biosystems, United States) and immediately after finishing the reaction the vials were incubated on ice. For clinical samples performed for both SARS-CoV-2 and internal control, two separate tubes were used for colorimetric RT-LAMP. As positive control, samples of 105 SARS-CoV-2 copies were used as described in the previous section. As non-template control (NTC) 5 μL of nuclease-free water was used. All reactions were submitted to 2% agarose gel electrophoresis (100 V) for 45 min, stained with ethidium bromide and visualized using an UV transilluminator (L-Pix Chemi, Loccus, Brazil). For color quantification, 20 μL of the reaction were pipetted in a 384-well plate and the optical density was measured at 434 nm and 560 nm using a BioteK Synergy reader. To obtain the ΔOD (color change difference), absorbance at 560 nm was subtracted from the one at 434 nm.
All graphics and data obtained were analyzed using GraphPad Prism software version 7.0 (GRAPH PAD software Inc, California, USA). Specificity of the RT-LAMP assay was calculated as the fraction of RT-qPCR negative samples that were also negative in the RT-LAMP assay. The sensitivity for Ct interval (Ct < 30 or Ct < 35) was calculated as the fraction of all samples that showed an RT-qPCR Ct value in that range that was also positive in the RT-LAMP assay. Statistical t-test was calculated as unpaired and parametric test, with a statistically significant difference of p < 0.05. Receiver Operating Characteristic (ROC) curve was calculated by grouping the ΔDO of SARS-CoV-2 colorimetric RT-LAMP of RT-qPCR positive and negative SARS-CoV-2 samples with 95% of confidence interval and a statistically significant difference of p < 0.05. Correlation between symptoms days and RT-qPCR SARS-CoV-2 detection and colorimetric RT-LAMP results were calculated using unpaired parametric t-test and a statistically significant difference of p < 0.05.
SARS-CoV-2 detection by RT-qPCR
From the 466 clinical samples, 250 were negative and 216 were positive for SARS-CoV-2 according to RT-qPCR, with an E-gene Ct ranging from 13.38 to 34.65. For SARS-CoV-2 positive samples, 74.1% presented Ct lower than 30, while 25.9% had Ct values between 30 and 35. All 466 samples were positive for RNAse P internal control, with Ct ranging from 14.24 to 34.91 (see Additional file 2: Fig. S1).
Validation of RT-LAMP for SARS-CoV-2 detection
After obtaining the RT-qPCR results, SARS-CoV-2 colorimetric RT-LAMP was performed with the same 466 clinical samples, aiming to determine RT-LAMP diagnostic sensitivity and specificity. Several RT-LAMP primer sets have been described for SARS-Cov-2 detection in literature with promising sensitivity and specificity. After a screening and previous evaluations from our group, it was decided to proceed with the primers designed by Rabe and Cepko (Rabe and Cepko 2020). A visible color change from pink to yellow is observed when the amplification of the target sequence has taken place, due to the presence of phenol red, a pH indicator presented in the reaction. When the reaction occurs, the pH drops from ~ 8 (pink) to ~ 6 (yellow) changing the color. During the testing process we verified that many samples presented an intermediate orange color that could not be easily distinguished. As a naked eye interpreted test, we clustered the samples in positive, intermediate and negative, according to the comparison with positive and non-template controls (Fig. 1). Most of the reactions with an intermediate orange color corresponded to positive samples with low viremia, as detected by RT-qPCR and demonstrated in the next sections. It is important to notice that negative samples may display the same intermediate color as those low-viremia samples. Under our knowledge, no previous reports described the existence of a third color cluster as a weakness of colorimetric RT-LAMP method for SARS-CoV-2.
As demonstrated in Table 1, the overall diagnostic sensitivity and specificity of colorimetric RT-LAMP when compared to RT-qPCR was 76.9% and 90.4%, respectively. It is important to emphasize that colorimetric RT-LAMP samples were considered positive when they presented a clear yellow color similar to positive control. All these samples were also positive after 2% agarose gel electrophoresis stained with ethidium bromide (Fig. 2a).
After evaluating the sensitivity and specificity rates obtained by colorimetric RT-LAMP in the literature, we decided to stratify the samples in two groups, high (Ct < 30) and low (Ct > 30) viremia, in order to better evaluate the assay performance, method properties and its limitations (Fowler et al. 2020; Thi et al. 2020). After this adjustment, the assertiveness of the test increased considerably, reaching a sensitivity of 93.8% as shown in Table 2. Although the sensitivity was 93.8%, only 0.6% of samples were false negatives, since 5.6% of the results were classified as intermediate. Regarding the specificity, the number of false positives was 5.2% and the percentage of negative samples that were detected as intermediate was 4.4%.
This cut-off value was decided after observation of unspecific amplifications with Ct > 35 and by previous experiments of our group demonstrating that our RT-qPCR protocol showed 100% of sensitivity for 100 copies of SARS-CoV-2 with a mean Ct close to 35 (data not shown). If we sum positive and intermediate colorimetric RT-LAMP results the sensitivity increases to 89.4% for overall RT-qPCR positive samples (76.9% positive + 12.5% intermediate) and to 99.4% when considered samples with Ct < 30 (93.8% positive + 5.6% intermediate). In a similar way, if we sum negative and intermediate colorimetric RT-LAMP results, the specificity increases to 94.8%. In order to increase the reliability of color determination and interpretation, we performed color quantification by spectrophotometry. The color change rearranges the wavelength peaks at 434 nm and 560 nm from phenol red that drastically changes during the acidification reaction. Although naked eye visualization is sufficient to detect whether a sample is positive or negative in the colorimetric RT-LAMP, we decided to measure the absorbance difference (ΔOD) of the 434 nm and 560 nm peaks of phenol red. When amplification occurs, it leads to an acidification of the reaction that changes the peaks of the dye and makes quantification possible. With this approach we observed that the three colors clusters are clearly distinguished and significantly different from each other (Fig. 2b). These results demonstrate that not all colorimetric RT-LAMP samples are able to be easily and uniquely discriminated between positive and negative samples.
To better evaluate SARS-CoV-2 colorimetric RT-LAMP assay here described, we performed a Receiver Operating Characteristic (ROC) curve, illustrating the diagnostic ability and connection between diagnostic sensitivity and specificity. As demonstrated in Fig. 2c, this ROC curve returns an area under the curve (AUC) of 0.92, indicating that this method presents an excellent performance (Fig. 2c).
For an improved comprehension of color determination, viral load and colorimetric RT-LAMP, we demonstrate the correlation between RT-qPCR SARS-CoV-2 positive samples and colorimetric RT-LAMP results (Fig. 2d). We showed and determined a “gray zone” between Ct 28 and 32 in which positive, intermediate and negative colorimetric RT-LAMP samples can be observed. All samples with Ct values lower than 28 were positive in colorimetric RT-LAMP, while Ct values greater than 32 were mostly negative. Thus, we propose that RT-qPCR CT values of 28 or less represent the method safe zone, while higher values may produce inconsistent results.
This safe zone was also demonstrated when the assay repeatability was assessed with 172 samples. From 90 SARS-CoV-2 positive samples, it was found 23 inconsistencies, but all of them had a Ct greater than 28 for the E-gene, while all 50 samples with Ct lower than 28 showed 100% reproducibility. Regarding 82 SARS-CoV-2 negative samples (Ct > 35), 12 showed inconsistent results, with 8 samples varying between negative and intermediate. It was also observed that intermediate samples provided the less consistent results, reinforcing the proposed colorimetric RT-LAMP safe zone. However, we believe that some of the mismatch results may be due to low quantity or quality of the genetic material after RNA extraction and suggest that before performing RT-LAMP reactions it is necessary to ensure that there is good quality and quantity of RNA.
To perform RT-LAMP with internal control, the primer set designed for human internal control was within the 18S ribosomal RNA. The internal control reactions for colorimetric RT-LAMP were performed in 155 clinical samples and divided in two groups according to RT-qPCR internal control performance: 115 samples with Ct < 30 and 40 samples with Ct > 30. Sample amplifications were also confirmed by agarose gel electrophoresis stained with ethidium bromide (data not shown). As demonstrated in Table 3, we observed 94.8% sensitivity for reactions with Ct < 30, in which the colorimetric RT-LAMP was able to detect 109 out of 115 samples, with only 2 negative samples and 4 intermediate samples. When the second cluster was analyzed, i.e. 40 samples with Ct > 30, only 15 were positive for internal control in colorimetric RT-LAMP, 23 were negative and 2 intermediate. Again, the reaction color was measured by spectrophotometry, demonstrating a statistical significance between positive, intermediate and negative samples (Fig. 3a).
The results of the colorimetric RT-LAMP with internal control reinforce that this method has a higher sensitivity only for samples with Ct < 30. In agreement with data previously shown for colorimetric RT-LAMP for SARS-CoV-2 detection, clinical samples with low RNA amount, represented by Ct > 30 demonstrated a high rate of negative results.
The importance of internal control in colorimetric RT-LAMP is clearly visualized when the result is plotted against RT-qPCR internal control Ct. The great majority of RT-qPCR samples with internal control Ct above 32 returns negative colorimetric RT-LAMP results (83%). Samples with internal control Ct lower than 28 are mostly positive (98.8%), while samples with Ct between 28 and 32 can potentially return all 3 results possibilities (Fig. 3b).
To illustrate the essential role of internal control for colorimetric RT-LAMP as a point-of-care test, Table 4 displays RT-qPCR Ct for E-gene and RNAse P (internal control) for SARS-CoV-2 detection using some of the samples tested in this report. As it was previously demonstrated, samples with Ct > 30 may produce false-negative results in colorimetric RT-LAMP. When all these 12 samples were performed in colorimetric RT-LAMP just for SARS-CoV-2 detection alone without an internal control, all returned a false-negative test. When the internal control was also performed, it returned a negative result, which clearly indicates low RNA amount or quality, that invalidates the test and avoids false-negative results that would be generated if the internal control was not assessed. Similar situations will occur in point-of-care application of colorimetric SARS-CoV-2 RT-LAMP.
Days of symptoms
The correlation between the number of days after symptoms onset (self-reported) and the results from RT-qPCR and colorimetric RT-LAMP was conducted in positive SARS-CoV-2 patients, to assess a more in-depth analysis of the assay performance. Table 5 and Additional file 3: Fig. S2 shows RT-qPCR results divided in two groups: one with Ct < 30 and the other with Ct between 30 and 35; and the paired data of self-reported number of days after symptoms onset. There was a significant difference in the mean number of days after symptoms onset between the two Ct groups, with a mean of 5.53 and 7.28 days for Ct > 30 and Ct 30–35, respectively. More importantly, similar results were obtained for colorimetric RT-LAMP and self-reported number of days after symptoms onset, which showed a significant difference between positive and intermediated/negative groups, with mean of 5.36 and 7.63 days, respectively.
During the colorimetric RT-LAMP it was possible to indicate some technical variables as potentially responsible for the origin of intermediate color reactions, such as temperature, time and primer dimer formation. When the test temperature is above 65 °C it was observed that even the no template control (NTC) color was affected, but it did not happen when the temperature was below 65ºC. This observation indicates a direct relationship between temperature and primer dimer formation in our study. It also emphasizes that RT-LAMP needs to be performed in a device able to maintain a precise constant temperature. There are works on literature reporting how LAMP primers (FIP and BIP) tend to create dimers due to their long sequences (Gao et al. 2019; Meagher et al. 2018). Therefore, RT-LAMP primers must be extensively tested before their diagnostic use. After the established reaction time of 30 min in this study, the samples were immediately put in ice. This extra step was implemented after the observation that reactions resting for longer than 30 min had increased nonspecific amplifications. Fowler et al. 2020 had the same conclusion and optimized the reaction time for only 16 min. The decrease in temperature was used to stop the enzyme activity and it was perceptible that the reaction colors were enhanced when in contact with ice (data not shown).
Regarding the color quantification, according to Thi et al. 2020 it is useful to determine RT-LAMP exact sensitivity. The numbers support the naked eye analysis, contributing to the test credibility and decreasing its subjectivity. Still, this quantification improvement is not explored by RT-LAMP studies. Our results clearly exhibit the intermediate range, where samples are harder to classify and thus generate indeterminate results. During the experiments, it was noticed that this range changes according to the lot of master mix used.
The Ct cut-off was determined by our group after unspecific amplifications started to occur. Fowler et al. 2020 performed a 33 Ct cut-off and obtained 97% of sensitivity and 99% of specificity in 16 min. The author emphasizes and recommends the importance of detection within this time limit to avoid nucleic acid degradation. Osterdahl et al. 2020 does not report a Ct cut-off for their RT-LAMP reaction, but the authors reported a sensitivity of 80% and a specificity of 73%, a test performance that is considered low when compared to other studies. A suggested detection limit of Ct < 30 for colorimetric RT-LAMP was proposed by Thi et al. 2020 in clinical trials. After the evaluation of 768 samples the authors observed that samples with Ct > 30 remained negative or after 30 min unspecific amplification started to occur. Schermer et al. 2020 established a Ct < 30 cut-off in combination to a primer optimization step by multiplexing RT-LAMP. The study aimed to detect Orf7a and Orf3a genes simultaneously. After the optimization process, the overall test specificity was 94%. It is important to note that none of these papers refers to intermediate samples in the same way as we did and clearly observed during screening.
These observations led us to consider that the color determination and interpretation represents an important property in colorimetric RT-LAMP assays due to point-of-care glimpse, where no automated method is proposed to determine the results. Operator naked eye result determination should be clear between positive (yellow) and negative (pink) results, while intermediate color will be confusing and may produce an incorrect report or biased interpretation.
The mismatch results in RT-LAMP brought some questions about their connection to the intermediate color pattern. It was difficult to ensure RNA quality to every clinical sample as a repetition process, because the nasopharyngeal or saliva effective collection depends on the collector’s ability, the patient's condition and to the RNA extraction process. Therefore, for colorimetric RT-LAMP as a point-of-care application a strict internal control must be established. Controls are very consolidated in scientific literature and diagnostic procedures. The usage of internal control in RT-qPCR validates not only template but also molecular biology reagents quality and amount. Samples that are undetected for the target and for the internal control are invalidated, preventing false-negative results. Some SARS-CoV-2 RT-LAMP studies use an internal control from RT-qPCR (Lau et al. 2020; Osterdahl et al. 2020; Zhang and Tanner 2020) however, the objective is not performing any sophisticated additional technique and validation for the point-of-care application. With that in mind, the present study showed for the first time the essential role of the internal control in RT-LAMP context, evaluating the performance of the primers and the clinical relevance of the method.
With all the demonstrated findings, we can assert that colorimetric RT-LAMP SARS-CoV-2 assays should be performed with target tests in combination to an internal control as a validation procedure. Both tests analyzed here returned poor performance and sensitivity when low RNA amount was used, with RT-qPCR Ct > 30. Meyerson et al. 2020 is one of the few authors found in literature that actually performed RNA internal control for colorimetric RT-LAMP reactions. In their article they evaluated SARS-CoV-2 detection in saliva by colorimetric RT-LAMP and RNAse P as internal control, which was positive in all 463 clinical samples tested, but they did not describe the performance in comparison to RT-qPCR. Multiplex RT-LAMP able to detect SARS-CoV-2 multiple genes plus the internal control was already suggested by Meyerson et al. 2020 and Zhang and Tanner 2020. Although these reports describe how easy the implementation of a human RNA control is, recent and relevant publications seem to ignore it.
The days of symptoms data is an important finding regarding colorimetric RT-LAMP assay, emphasizing that colorimetric RT-LAMP for SARS-CoV-2 as a point-of-care retains application period. With this data we demonstrated that SARS-CoV-2 detection by colorimetric RT-LAMP as a point-of-care test is strictly related with the days of symptoms reported by the patients, suggesting that until five days of symptoms the use of colorimetric RT-LAMP is indicated, while with more than seven days, the method has a reduced sensitivity. Moreover, the performance of colorimetric RT-LAMP and RT-qPCR is comparable regarding the days of symptoms, with very similar results. Thus, colorimetric RT-LAMP correlates with RT-qPCR performance, as patients with Ct < 30 presented number of days after symptoms onset very similar to those that showed a positive colorimetric RT-LAMP, while samples with Ct between 30 and 35 presented symptoms days similar to intermediate/negative colorimetric RT-LAMP.
Here we demonstrated that colorimetric RT-LAMP SARS-CoV-2 detection is an efficient, practical and reliable assay but has its limitations. The colorimetric method of this approach represents a positive property due to its simplicity but shows limitations in color determination and interpretation. Our recommendation for a realistic application of colorimetric RT-LAMP as a point-of-care diagnostic tool, is to always repeat the intermediate samples or perform a distinct technique, such as RT-qPCR to confirm the results. Despite the absence of an established Ct cut-off, La Scola et al. 2020 states that patients with Ct > 33 are not contagious, which reinforces that colorimetric RT-LAMP results are effective to detect patients that are able to spread the SARS-CoV-2 virus. Second, a high diagnostic sensitivity is reached when viremia is also high, mainly in the first week of symptoms (Cevik et al. 2020) which restrains the test to a limited timeline application but with great performance as a point-of-care for SARS-CoV-2 acute infections. Finally, we demonstrated the need for an internal control in parallel with SARS-CoV-2 detection in colorimetric RT-LAMP to validate the assay and avoid false-negative results. In the context of a pandemic situation, the lack of internal control and consequent generation of false-negative results may lead to mistaken diagnosis, increased virus spread, inappropriate or useless treatments and ultimately to an increase in the number of deaths.
Data availability of data and materials
The datasets supporting the conclusions of this article are included within the article and its additional files.
Coronavirus disease 2019
Reverse Transcription Loop-mediated Isothermal Amplification
Quantitative reverse transcription-polymerase chain reaction
Severe acute respiratory syndrome coronavirus 2
Ahn SJ, Baek YH, Lloren KKS, Choi WS, Jeong JH, Antigua KJC, Kwon HI, Park SJ, Kim EH, Kim YI, Si YJ, Hong SB, Shin KS, Chun S, Choi YK, Song MS. Rapid and simple colorimetric detection of multiple influenza viruses infecting humans using a reverse transcriptional loop-mediated isothermal amplification (RT-LAMP) diagnostic platform. BMC Infect Dis. 2019;19(1):1–12. https://doi.org/10.1186/s12879-019-4277-8.
Ali Z, Aman R, Mahas A, Rao GS, Tehseen M, Marsic T, Salunke R, Subudhi AK, Hala SM, Hamdan SM, Pain A, Alofi FS, Alsomali A, Hashem AM, Khogeer A, Almontashiri NAM, Abedalthagafi M, Hassan N, Mahfouz MM. ISCAN: an RT-LAMP-Coupled CRISPR-Cas12 module for rapid, sensitive detection of SARS-CoV-2. Virus Res. 2020;288:198129. https://doi.org/10.1016/j.virusres.2020.198129.
Augustine R, Hasan A, Das S, Ahmed R, Mori Y, Notomi T, Kevadiya B, Thakor A. Loop-mediated isothermal amplification (LAMP): a rapid, sensitive, specific, and cost-effective point-of-care test for coronaviruses in the context of COVID-19 pandemic. Biology. 2020;9(8):182. https://doi.org/10.3390/biology9080182.
Cevik M, Tate M, Lloyd O, Maraolo AE, Schafers J, Ho A. SARS-CoV-2, SARS-CoV, and MERS-CoV viral load dynamics, duration of viral shedding, and infectiousness: a systematic review and meta-analysis. Lancet Microbe. 2020;2(1):e13-22. https://doi.org/10.1016/s2666-5247(20)30172-5.
Chembio Diagnostic System, DPP® COVID-19 IgM/IgG System, 2020, 14 Apr 2020. https://www.fda.gov/media/136963/download, 26th Feb 2021.
Chow FW, Chan TT, Tam AR, Zhao S, Yao W, Fung J, Cheng FK, Lo GC, Chu S, Aw-Yong KL, Tang JY, Tsang CC, Luk HKH, Wong ACP, Li KSM, Zhu L, He Z, Tam EWT, Chung TWH, Wong SCY, Que TL, Fung KSC, Lung DC, Wu AKL, Hung IFN, Woo PCY, Lau SKP, Rapid A. Simple, inexpensive, and mobile colorimetric assay covid-19-lamp for mass on-site screening of covid-19. Int J Mol Sci. 2020;21(15):1–10. https://doi.org/10.3390/ijms21155380.
Coris BioConcept, COVID-19 Ag Respi-Strip, 2020. www.corisbio.com/Products/Human-Field/Covid-19.php, 26th Feb 2021.
Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DKW, Bleicker T, Brünink S, Schneider J, Schmidt ML, Mulders DGJC, Haagmans BL, Van Der Veer B, Van Den Brink S, Wijsman L, Goderski G, Romette JL, Ellis J, Zambon M, Peiris M, Goossens H, Reusken C, Koopmans MPG, Drosten C. Detection of 2019 novel coronavirus (2019-NCoV) by real-time RT-PCR. Eurosurveillance. 2020;25(3):1. https://doi.org/10.2807/1560-7917.ES.2020.25.3.2000045.
Dortet L, Ronat JB, Vauloup-Fellous C, Langendorf C, Mendels DA, Emeraud C, Oueslati S, Girlich D, Chauvin A, Afdjei A, Bernabeu S, Le Pape S, Kallala R, Rochard A, Verstuyft C, Fortineau N, Roque-Afonso AM, Naas T. Evaluating 10 commercially available SARS-CoV-2 rapid serological tests by use of the STARD (Standards for Reporting of Diagnostic Accuracy Studies) method. J Clin Microbiol. 2021. https://doi.org/10.1128/JCM.02342-20.
Emami A, Javanmardi F, Pirbonyeh N, Akbari A. Prevalence of underlying diseases in hospitalized patients with COVID-19: a systematic review and meta-analysis. Arch Acad Emergency Med. 2020;8(1):e35. https://doi.org/10.22037/aaem.v8i1.600.
Fowler V, Armson B, Gonzales J, Wise E, Howson E, Vincent-Mistiaen Z, Fouch S, Maltby C, Grippon S, Munro S, Jones L, Holmes T, Tillyer C, Elwell J, Sowood A, Santos H, de Peyer O, Dixon S, Hatcher T, Sivanesan S, Knight H, Laxman S, Walsh C, Andreou M, Morant N, Clark D, Houghton R, Moore N, Cortes N, Kidd S. A reverse-transcription loop-mediated isothermal amplification (RT-LAMP) assay for the rapid detection of SARS-CoV-2 within nasopharyngeal and oropharyngeal swabs at hampshire hospitals NHS foundation trust. MedRxiv. 2020. https://doi.org/10.1101/2020.06.30.20142935.
Gao X, Sun B, Guan Y. Pullulan reduces the non-specific amplification of loop-mediated isothermal amplification (LAMP). Anal Bioanal Chem. 2019;411(6):1211–8. https://doi.org/10.1007/s00216-018-1552-2.
Gouilh MAR, Cassier R, Maille E, Schanen C, Rocque L-M, Vabret A. SARS-CoV2 RT-LAMP test for point-of-care and diagnostic lab an easy, reliable and rapid SARS-CoV2 RT-lamp based test for point-of-care and diagnostic lab. MedRxiv. 2020. https://doi.org/10.1101/2020.09.25.20200956.
Haguet H, Douxfils J, Eucher C, Elsen M, Cadrobbi J, Tré-Hardy M, Dogné J-M, Favresse J. Clinical performance of the panbio assay for the detection of SARS-CoV-2 IgM and IgG in COVID-19 patients. J Med Virol. 2021. https://doi.org/10.1002/jmv.26884.
Howson EL, Kidd SP, Armson B, Goring A, Sawyer J, Cassar C, Cross D, Lewis T, Hockey J, Rivers S, Cawthraw S, Banyard A, Anderson P, Rahou S, Andreou M, Morant N, Clark D, Walsh C, Laxman S, Houghton R, Slater-Jefferies J, Costello P, Brown I, Cortes N, Godfrey KM, Fowler VL. Preliminary optimisation of a simplified sample preparation method to permit direct detection of SARS-CoV-2 within saliva samples using reverse-transcription loop-mediated isothermal amplification (RT-LAMP). J Virol Methods. 2021;289:114048. https://doi.org/10.1016/j.jviromet.2020.114048.
Huang WE, Lim B, Hsu C-C, Xiong D, Wei Wu, Yejiong Yu, Jia H, Wang Y, Zeng Y, Ji M, Chang H, Zhang X, Wang H, Cui Z. RT-LAMP for rapid diagnosis of coronavirus SARS-CoV-2. Microb Biotechnol. 2020;13(4):950–61. https://doi.org/10.1111/1751-7915.13586.
Imai M, Ninomiya Ai, Minekawa H, Notomi T, Ishizaki T, Tashiro M, Odagiri T. Development of H5-RT-LAMP (loop-mediated isothermal amplification) system for rapid diagnosis of H5 avian influenza virus infection. Vaccine. 2006;24(44–46):6679–82. https://doi.org/10.1016/j.vaccine.2006.05.046.
JMH (Japanese Ministry of Health) Labour and Welfare, Approval of in Viro Diagnostic for the Novel Coronavirus infection, Japanese Ministry of Health Labour and Welfare, 2020. https://www.mhlw.go.jp/content/11124500/000632304.pdf. Accessed 26 Feb 2021.
La Scola B, Le Bideau M, Andreani J, Grimaldier C, Colson P, Gautret P, Raoult D. Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39(6):1059–61. https://doi.org/10.1007/s10096-020-03913-9.
Lalli MA, Langmade SJ, Chen X, Fronick CC, Sawyer CS, Burcea LC, Wilkinson MN, Fulton RS, Heinz M, Buchser WJ, Head RD, Mitra RD, Milbrandt J. Rapid and extraction-free detection of SARS-CoV-2 from saliva by colorimetric reverse-transcription loop-mediated isothermal amplification. Clin Chem. 2020. https://doi.org/10.1093/clinchem/hvaa267.
Lau YL, Ismail I, Mustapa NI, Lai MY, Soh TST, Hassan A, Peariasamy KM, Lee YL, Chong YM, Sam IC, Goh PP. Real-time reverse transcription loop-mediated isothermal amplification for rapid detection of SARS-CoV-2. PeerJ. 2020. https://doi.org/10.7717/peerj.9278.
Lübke N, Senff T, Scherger S, Hauka S, Andrée M, Adams O, Timm J, Walker A. Extraction-free SARS-CoV-2 detection by rapid RT-QPCR universal for all primary respiratory materials. J Clin Virol. 2020;130:104579. https://doi.org/10.1016/j.jcv.2020.104579.
Mautner L, Baillie CK, Herold HM, Volkwein W, Guertler P, Eberle U, Ackermann N, Sing A, Pavlovic M, Goerlich O, Busch U, Wassill L, Huber I, Baiker A. Rapid point-of-care detection of SARS-CoV-2 using reverse transcription loop-mediated isothermal amplification (RT-LAMP). Virol J. 2020;17(1):1–14. https://doi.org/10.1186/s12985-020-01435-6.
Meagher RJ, Priye A, Light YK, Huang C, Wang E. Impact of primer dimers and self-amplifying hairpins on reverse transcription loop-mediated isothermal amplification detection of viral RNA. Analyst. 2018;143(8):1924–33. https://doi.org/10.1039/c7an01897e.
Meyerson NR, Yang Q, Clark SK, Paige CL, Fattor WT, Gilchrist AR, Barbachano-Guerrero A, Sawyer SL. A community-deployable SARS-CoV-2 screening test using raw saliva with 45 minutes sample-to-results turnaround. MedRxiv. 2020;07(16):20150250. https://doi.org/10.1101/2020.07.16.20150250.
Notomi T, Okayama H, Masubuchi H, Yonekawa T, Watanabe K, Amino N, Hase T. Loop-mediated isothermal amplification of DNA. Nucleic Acids Res. 2000. https://doi.org/10.1093/nar/28.12.e63.
Osterdahl M, Lee K, Ni Lochlainn M, Wilson S, Douthwaite S, Horsfall R, Sheedy A, Goldenberg S, Stanley C, Spector T, Steves C. Detecting SARS-CoV-2 at point of care: preliminary data comparing loop-mediated isothermal amplification (LAMP) to PCR. SSRN Electron J. 2020. https://doi.org/10.1101/2020.04.01.20047357.
Rabe BA, Cepko C. SARS-CoV-2 detection using isothermal amplification and a rapid, inexpensive protocol for sample inactivation and purification. 2020;117(39):24450–58. https://doi.org/10.1073/pnas.2011221117/-/DCSupplemental.
Schermer B, Fabretti F, Damagnez M, Di Cristanziano V, Heger E, Arjune S, Tanner NA, Imhof T, Koch M, Ladha A, Joung J, Gootenberg JS, Abudayyeh OO, Burst V, Zhang F, Klein F, Benzing T, Müller R-U. Rapid SARS-CoV-2 testing in primary material based on a novel multiplex RT-LAMP assay. PLoS ONE. 2020;15(11):e0238612. https://doi.org/10.1371/journal.pone.0238612.
Sukphattanaudomchoke C, Siripattanapipong S, Thita T, Leelayoova S, Piyaraj P, Mungthin M, Ruang-areerate T. Simplified closed tube loop mediated isothermal amplification (LAMP) assay for visual diagnosis of leishmania infection. Acta Trop. 2020;212:105651. https://doi.org/10.1016/j.actatropica.2020.105651.
Techathuvanan C, D’Souza DH. Propidium monoazide for viable salmonella enterica detection by PCR and LAMP assays in comparison to RNA-based RT-PCR, RT-LAMP, and culture-based assays. J Food Sci. 2020;85(10):3509–16. https://doi.org/10.1111/1750-3841.15459.
Thi VLD, Herbst K, Boerner K, Meurer M, Kremer LP, Kirrmaier D, Freistaedter A, Papagiannidis D, Galmozzi C, Stanifer ML, Boulant S, Klein S, Chlanda P, Khalid D, Miranda IB, Schnitzler P, Kräusslich HG, Knop M, Anders S. A colorimetric RT-LAMP assay and LAMP-sequencing for detecting SARS-CoV-2 RNA in clinical samples. Sci Trans Med. 2020;12(556):7075. https://doi.org/10.1126/SCITRANSLMED.ABC7075.
Tomita N, Mori Y, Kanda H, Notomi T. Loop-mediated isothermal amplification (LAMP) of gene sequences and simple visual detection of products. Nat Protoc. 2008;3(5):877–82. https://doi.org/10.1038/nprot.2008.57.
Ushikubo H. The principle of LAMP method-A simple and rapid gene amplification method. Uirusu. 2004;54(1):107–12. https://doi.org/10.2222/jsv.54.107.
Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, De Paepe A, Speleman F. Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol. 2002;3(7):1–12. https://doi.org/10.1186/gb-2002-3-7-research0034.
Wei S, Kohl E, Djandji A, Morgan S, Whittier S, Mansukhani M, Hod E, D’Alton M, Suh Y, Williams Z. Direct diagnostic testing of SARS-CoV-2 without the need for Prior RNA extraction. Sci Rep. 2021. https://doi.org/10.1038/s41598-021-81487-y.
Wise J. Covid-19: lateral flow tests miss over half of cases, liverpool pilot data show. BMJ (Clinical Research Ed). 2020;371:m4848. https://doi.org/10.1136/bmj.m4848.
Yamazaki W, Matsumura Y, Thongchankaew-Seo U, Yamazaki Y, Nagao M. Development of a point-of-care test to detect SARS-CoV-2 from saliva which combines a simple RNA extraction method with colorimetric reverse transcription loop-mediated isothermal amplification detection. J Clin Virol. 2021;136:104760. https://doi.org/10.1016/j.jcv.2021.104760.
Yan C, Cui J, Huang L, Du B, Chen L, Xue G, Li S, Zhang W, Zhao L, Sun Y, Yao H, Li N, Zhao H, Feng Y, Liu S, Zhang Q, Liu D, Yuan J. Rapid and visual detection of 2019 novel coronavirus (SARS-CoV-2) by a reverse transcription loop-mediated isothermal amplification assay. Clin Microbiol Infect. 2020;26(6):773–9. https://doi.org/10.1016/j.cmi.2020.04.001.
Zhang Y, Tanner NA. Development of multiplexed RT-LAMP for detection of SARS-CoV-2 and influenza viral RNA Doi: MedRxiv preprint. MedRxiv. 2020;10(26):20219972. https://doi.org/10.1101/2020.10.26.20219972.
Zhang Y, Odiwuor N, Xiong J, Sun L, Nyaruaba RO, Wei H, Tanner NA. Rapid molecular detection of SARS-CoV-2 (COVID-19) virus RNA using colorimetric LAMP. MedRxiv. 2020. https://doi.org/10.1101/2020.02.26.20028373.
Zhou P, Yang XL, Wang XG, Hu B, Zhang L, Zhang W, Si HR, Zhu Y, Li B, Huang CL, Chen HD, Chen J, Luo Y, Guo H, Di Jiang R, Liu MQ, Chen XY, Shen R, Wang X, Zheng XS, Zhao K, Chen QJ, Deng F, Liu LL, Yan B, Zhan FX, Wang YY, Xiao GF, Shi ZL. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature. 2020;579(7798):270–3. https://doi.org/10.1038/s41586-020-2012-7.
LB would like to acknowledge Fiocruz and Fundação para o Desenvolvimento Científico e Tecnológico em Saúde (FIOTEC) for the grant VPPIS-005-FIO-20-2-19 and the National Council for Scientific and Technological Development (CNPq) for the grant PROEP-ICC/CNPQ 442329/2019-9. MNA would like to acknowledge Fiocruz and Fundação para o Desenvolvimento Científico e Tecnológico em Saúde (FIOTEC) for the grant VPPCB-008-FIO-18-2-38, and the National Council for Scientific and Technological Development (CNPq) for the grant PROEP-ICC/CNPQ 442331/2019-3. We would like to acknowledge Andreia Lubas and Maria Eduarda Alencar Migliorini for samples logistics and organization.
Fiocruz, Fundação para o Desenvolvimento Científico e Tecnológico em Saúde (FIOTEC) and National Council for Scientific and Technological Development (CNPq).
Ethics approval and consent to participate
The project was conducted after Local Ethics Committee approval (CAAE 31592620.4.3001.5248 and 31592620.4.1001.0098). All samples collection and experimental conduction were carried out in accordance with relevant guidelines and Brazilian regulations. All recruted patients have written a consent.
Consent for publication
The authors declare that they have no competing interests.
Set of primes designed by Rabe and Cepko (2020) to detect SARS-CoV-2 by RT-LAMP.
Detection of SARS-CoV-2 by RT-qPCR in clinical samples, showing cycle threshold for 216 positive samples by E-gene detection (black dots) and for RNAse P internal controls detection for all 466 samples (red squares). Horizontal lines in both clusters represent the mean cycle threshold.
Correlation between the number of days after symptoms onset.
About this article
Cite this article
de Oliveira Coelho, B., Sanchuki, H.B.S., Zanette, D.L. et al. Essential properties and pitfalls of colorimetric Reverse Transcription Loop-mediated Isothermal Amplification as a point-of-care test for SARS-CoV-2 diagnosis. Mol Med 27, 30 (2021). https://doi.org/10.1186/s10020-021-00289-0
- Point of Care