Comparative Evaluation of SARS-CoV-2 Rapid Immunochromatographic Test Assays with Chemiluminescent Immunoassay for the Diagnosis of COVID-19
DOI:
https://doi.org/10.3889/oamjms.2021.7076Keywords:
Coronavirus disease 2019, Severe acute respiratory syndrome coronavirus-2, Antibody, Chemiluminescence, Lateral flow immunochromatographyAbstract
Background
To date, the molecular assay is the gold-standard method for COVID-19 diagnosis. However, they are expensive and complex. There is a pressing necessity for developing other effective diagnostics for SARS‐CoV‐2 patients. Therefore, serological detection of antibodies against SARS‐CoV‐2 might provide a good alternative.
Aim
We aimed to compare and evaluate seven rapid diagnostic tests with Mindray chemiluminescent automated immunoassay as a reference method for SARS-CoV-2 antibodies detection.
Methods:
This study included the serum of a total of 49 attendees to the Reference Laboratory of Egyptian university hospitals during the period from April 2021 to May 2021. Anti-Covid-19 antibodies detection in serum samples was performed by Mindray fully automated system as our reference method and seven rapid antibody tests; Wondfo, Vazyme, Dynamiker, Panbio, Artron Maccura and Roche.
Results:
The chemiluminescent assay revealed 30 (61.2%) positive samples and 19 (38.8%) negative samples for COVID-19 IgG. For COVID-19 IgM, 11 (22.4%) samples were positive and 38 (77.6%) samples were negative. Anti-SARS-CoV-2 antibodies were not detected in any of the PCR negative individuals. The best diagnostic performance was demonstrated by Roche IgG and IgM, and Vazyme IgG and IgM antibody tests followed by Panbio. For Roche, the sensitivity and specificity for IgG and IgM were (83.3%, 89.5%) and (72.7%, 81.6%) respectively. Vazyme showed sensitivity and specificity for IgG and IgM were (77.8%, 85.7%) and (75%, 91.7%) respectively. Regards Panbio, the sensitivity and specificity for IgG and IgM were (63.6%, 87.5%) and (50%, 86.7%) respectively. Cohen’s Kappa values revealed a substantial agreement for Roche IgG, Vazyme IgG and IgM of (0.7076, 0.6250, 0.6667) respectively. The worst agreement was reported for Maccura IgG, Wondfo, and Dynamiker IgM with Cohen’s Kappa values of (0.2508, 0.1893, 0.0313) respectively.
Conclusions:
Rapid tests in our study exhibited heterogeneous diagnostic performances. Roche, Vazyme, and Panbio antibody tests showed promising results in concordance with our reference method with the best-reported results. On the other hand, the other tests were inferior and failed in providing valid and reliable results. Further studies are necessary to determine the practicality of these tests in different settings and communities.
Downloads
Metrics
Plum Analytics Artifact Widget Block
References
Whitman JD, Hiatt J, Mowery CT, Shy BR, Yu R, Yamamoto TN, et al. Test performance evaluation of SARS-CoV-2 serological assays. MedRxiv. 2020. https://doi:10.1101/2020.04.25.20074856 PMid:32511497
Chan JF, Yuan S, Kok KH, To KK, Chu H, Yang J, et al. A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster. Lancet. 2020;395(10223):514-23. https://doi.org/10.1016/s0140-6736(20)30154-9 PMid:31986261
Long QX, Liu BZ, Deng HJ, Wu GC, Deng K, Chen YK, et al. Antibody responses to SARS-CoV-2 in patients with COVID-19. Nat Med. 2020;26(6):845-8. https://doi.org/10.1038/ s41591-020-0897-1
Ismail G, Mostafa MS, Abdelghaffar H, Halim RA, Omar NN, Fahim NAE. Current Status and a Future Perspective of COVID- 19 in Egypt: Egyptian Reference Laboratory Experience. J Pure Appl Microbiol. 2021;15(3):1257-65. https://doi.org/10.22207/JPAM.15.3.15
Coronaviridae Study Group of the International Committee on Taxonomy of Viruses. The species Severe acute respiratory syndrome-related coronavirus: Classifying 2019-nCoV and naming it SARS-CoV-2. Nat Microbiol. 2020;5:536-44. https://doi.org/10.1038/s41564-020-0695-z
Lijia S, Lihong S, Huabin W, Xiaoping X, Xiaodong L, Yixuan Z, et al. Serological chemiluminescence immunoassay for the diagnosis of SARS-CoV-2 infection. J Clin Lab Anal. 2020;34(10):e23466. https://doi.org/10.1002/jcla.23466 PMid:32671890
Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497-506. https://doi.org/10.1016/S0140-6736(20)30183-5
Wang P. Combination of serological total antibody and RT-PCR test for detection of SARS-COV-2 infections. J Virol Methods. 2020;283:113919. https://doi.org/10.1016/j.jviromet.2020.113919 PMid:32554043
Sheridan C. Fast, portable tests come online to curb coronavirus pandemic. Nat Biotechnol. 2020;38(5):515-8. https://doi.org/10.1038/d41587-020-00010-2 PMid:32203294
Corman VM, Albarrak AM, Omrani AS, Albarrak MM, Farah ME, Almasri M, et al. Viral shedding and antibody response in 37 patients with middle east respiratory syndrome coronavirus infection. Clin Infect Dis. 2016;62(4):477-83. https://doi.org/10.1093/cid/civ951 PMid:26565003
Racine R, Winslow GM. IgM in microbial infections: Taken for granted? Immunol Lett. 2009;125(2):79-85. https://doi.org/10.1016/j.imlet.2009.06.003 PMid:19539648
Liu W, Liu L, Kou G, Zheng Y, Ding Y, Ni W, et al. Evaluation of nucleocapsid and spike protein-based enzyme-linked immunosorbent assays for detecting antibodies against SARS-CoV-2. J Clin Microbiol. 2020;58(6):e00461-20. https://doi.org/10.1128/JCM.00461-20 PMid:32229605
Infantino M, Grossi V, Lari B, Bambi R, Perri A, Manneschi M, et al. Diagnostic accuracy of an automated chemiluminescent immunoassay for anti-SARS-CoV-2 IgM and IgG antibodies: An Italian experience. J Med Virol. 2020;92(9):1671-5. https://doi.org/10.1002/jmv.25932 PMid:32330291
Xu Y, Xiao M, Liu X, Xu S, Du T, Xu J, et al. Significance of serology testing to assist timely diagnosis of SARS-CoV-2 infections: Implication from a family cluster. Emerg Microbes Infect. 2020;9(1):924-7. https://doi.org/10.1080/22221751.20201752610 PMid:32286155
Vashist SK. In vitro diagnostic assays for COVID-19: Recent advances and emerging trends. Diagnostics (Basel). 2020;10(4):202. https://doi.org/10.3390/diagnostics10040202 PMid:32260471
Findeisen P, Stiegler H, Lopez-Calle E, Schneider T, Urlaub E, Hayer J, et al. Clinical performance evaluation of a SARS-CoV-2 Rapid Antibody Test for determining past exposure to SARS-CoV-2. Int J Infect Dis. 2021;103:636-41. https://doi. org/10.1016/j.ijid.2020.11.164 PMid:33227517
Borges LP, De Oliveira MGB, de Souza DRV, Dos Santos KA, Heimfarth L, et al. Can the Wondfo® SARS-CoV-2 IgM/IgG antibodies be used as a rapid diagnostic test? Arch Biotechnol Biomed. 2020;4:13-7.
Valdivia A, Torres I, Latorre V, Francés-Gómez C, Ferrer J, Forqué L, et al. Suitability of two rapid lateral flow immunochromatographic assays for predicting SARS-CoV-2 neutralizing activity of sera. J Med Virol. 2021;93(4):2301-6. https://doi.org/10.1002/jmv.26697 PMid:33236799
Chen SY, Lee YL, Lin YC, Lee NY, Liao CH, Hung YP, et al. Multicenter evaluation of two chemiluminescence and three lateral flow immunoassays for the diagnosis of COVID-19 and assessment of antibody dynamic responses to SARS-CoV-2 in Taiwan. Emerg Microbes Infect. 2020;9(1):2157-68. https://doi.org/10.1080/22221751.2020.1825016 PMid:32940547
Plebani M, Parčina M, Bechri I, Zehender G, Terkeš V, Abdel Hafith B, et al. Performance of the COVID19SEROSpeed IgM/IgG rapid test, an immunochromatographic assay for the diagnosis of SARS-CoV-2 infection: A multicenter European study. J Clin Microbiol. 2021;59(2):e02240-20. https://doi.org/10.1128/JCM.02240-20 PMid:33218990
Ko JH, Joo EJ, Kim SH, Kim YJ, Huh K, Cho SY, et al. Clinical application of rapid diagnostic test kit for SARS-CoV-2 antibodies into the field of patient care. J Microbiol Immunol Infect. 2021;54(1):97-100. https://doi.org/10.1016/j.jmii.2020.07.003 PMid:32684340
Ghaffari A, Meurant R, Ardakani A. COVID-19 serological tests: How well do they actually perform? Diagnostics (Basel). 2020;10(7):453. https://doi.org/10.3390/diagnostics10070453 PMid:32635444
Guedez-López GV, Alguacil-Guillén M, González-Donapetry P, Bloise I, Tornero-Marin C, González-García J, et al. Evaluation of three immunochromatographic tests for rapid detection of antibodies against SARS-CoV-2. Eur J Clin Microbiol Infect Dis. 2020;39(12):2289-97. https://doi.org/10.1007/s10096-020-04010-7 PMid:32808111
Younes S, Al-Jighefee H, Shurrab F, Al-Sadeq DW, Younes N, Dargham SR, et al. Diagnostic efficiency of three fully automated serology assays and their correlation with a novel surrogate virus neutralization test in symptomatic and asymptomatic SARS-COV-2 individuals. Microorganisms. 2021;9(2):245. https://doi.org/10.3390/microorganisms9020245 PMid:33504067
Pieri M, Nuccetelli M, Nicolai E, Sarubbi S, Grelli S, Bernardini S. Clinical validation of a second generation anti-SARS-CoV-2 IgG and IgM automated chemiluminescent immunoassay. J Med Virol. 2021;93(4):2523-28. PMid:33463719
Wakita M, Idei M, Saito K, Horiuchi Y, Yamatani K, Ishikawa S, et al. Comparison of the clinical performance and usefulness of five SARS-CoV-2 antibody tests. PLoS One. 2021;16(2):e0246536. https://doi.org/10.1371/journal.pone.0246536 PMid:33556086
Morshed M, Sekirov I, McLennan M, Levett PN, Chahil N, Mak A, et al. Comparative analysis of capillary vs venous blood for serologic detection of SARS-CoV-2 antibodies by RPOC lateral flow tests. Open Forum Infect Dis. 2021;8(3):ofab043. https://doi.org/10.1093/ofid/ofab043 PMid:33723509
Stein DR, Osiowy C, Gretchen A, Thorlacius L, Fudge D, Lang A, et al. Evaluation of commercial SARS-CoV-2 serological assays in Canadian public health laboratories. Diagn Microbiol Infect Dis. 2021;101(3):115412. https://doi.org/10.1016/j.diagmicrobio.2021.115412
Imai K, Tabata S, Ikeda M, Noguchi S, Kitagawa Y, Matuoka M, et al. Clinical evaluation of an immunochromatographic IgM/ IgG antibody assay and chest computed tomography for the diagnosis of COVID-19. J Clin Virol. 2020;128:104393. https://doi.org/10.1016/j.jcv.2020.104393 PMid:32387968
Xie X, Nielsen MC, Muruato AE, Fontes-Garfias CR, Ren P. Evaluation of a SARS-CoV-2 lateral flow assay using the plaque reduction neutralization test. Diagn Microbiol Infect Dis. 2021;99(2):115248. https://doi.org/10.1016/j.diagmicrobio.2020.115248 PMid:33130510
Fujigaki H, Takemura M, Osawa M, Sakurai A, Nakamoto K, Seto K, et al. Reliability of serological tests for COVID-19: Comparison of three immunochromatography test kits for SARS-CoV-2 antibodies. Heliyon. 2020;6(9):e04929. https://doi.org/10.1016/j.heliyon.2020.e04929 PMid:32984615
Haguet H, Douxfils J, Eucher C, Elsen M, Cadrobbi J, Tré- Hardy M, et al. Clinical performance of the Panbio assay for the detection of SARS-CoV-2 IgM and IgG in COVID-19 patients. J Med Virol. 2021;93(5):3277-81. https://doi.org/10.1002/jmv.26884 PMid:33599299
Paiva KJ, Grisson RD, Chan PA, Huard RC, Caliendo AM, Lonks JR, et al. Validation and performance comparison of three SARS-CoV-2 antibody assays. J Med Virol. 2021;93(2):916-23. https://doi.org/10.1002/jmv.26341 PMid:32710669
Montolio Breva S, Molina Clavero C, Gómez Bertomeu F, Picó- Plana E, Serrat Orús N, Palau Sánchez I, et al. Evaluation of five immunoassays and one lateral flow immunochromatography for anti-SARS-CoV-2 antibodies detection. Enferm Infect Microbiol Clin (Engl Ed). 2021. https://doi.org/10.1016/j.eimc.2020.12.002 PMid:33558047
Lau CS, Hoo SP, Liang YL, Phua SK, Aw TC. Performance of two rapid point of care SARS-COV-2 antibody assays against laboratory-based automated chemiluminescent immunoassays for SARS-COV-2 IG-G, IG-M and total antibodies. Pract Lab Med. 2021;24:e00201. https://doi.org/10.1016/j.plabm.2021.e00201 PMid:33501369
La Marca A, Capuzzo M, Paglia T, Roli L, Trenti T, Nelson SM. Testing for SARS-CoV-2 (COVID-19): A systematic review and clinical guide to molecular and serological in-vitro diagnostic assays. Reprod Biomed Online. 2020;41(3):483-99. https://doi.org/10.1016/j.rbmo.2020.06.001 PMid:32651106
Swadźba J, Bednarczyk M, Anyszek T, Martin E. A comparison of 7 commercial anti-SARS-CoV-2 antibody immunoassays. Arch Med Sci. 2020. https://doi.org/10.5114/aoms.2020.98361
Mouliou DS, Gourgoulianis KI. False-positive and false-negative COVID-19 cases: Respiratory prevention and management strategies, vaccination, and further perspectives. Expert Rev Respir Med. 2021;15(8):993-1002. https://doi.org/10.1080/17476348.2021.1917389 PMid:33896332
Gambino CM, Lo Sasso B, Colomba C, Giglio RV, Agnello L, Bivona G, et al. Comparison of a rapid immunochromatographic test with a chemiluminescence immunoassay for detection of anti-SARS-CoV-2 IgM and IgG. Biochem Med (Zagreb). 2020;30(3):030901. PMid:33071558
Augustine R, Das S, Hasan A, Abhilash S, Abdul Salam S, Augustine P, et al. Rapid antibody-based COVID-19 mass surveillance: Relevance, challenges, and prospects in a pandemic and post-pandemic world. J Clin Med. 2020;9(10):3372. https://doi.org/10.3390/jcm9103372 PMid:33096742
Jia X, Xiao L, Liu Y. False negative RT-PCR and false positive antibody tests-Concern and solutions in the diagnosis of COVID- 19. J Infect. 2021;82(3):414-51. https://doi.org/10.1016/j.jinf.2020.10.007 PMid:33039501
Pegoraro M, Militello V, Salvagno GL, Gaino S, Bassi A, Caloi C, et al. Evaluation of three immunochromatographic tests in COVID-19 serologic diagnosis and their clinical usefulness. Eur J Clin Microbiol Infect Dis. 2021;40(4):897-900. https://doi.org/10.1007/s10096-020-04040-1 PMid:33078222
Downloads
Published
How to Cite
License
Copyright (c) 2021 Ghada Ismail, Rania Abdel Halim, Marwa Salah Mostafa, Dalia H Abdelhamid, Hossam Abdelghaffar, Nashwa Naguib Omar, Noha Alaa Eldin Fahim (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0)
