Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022

Diya Surie; Levi N. Bonnell; Jennifer DeCuir; Manjusha Gaglani; Tresa McNeal; Shekhar Ghamande; Jay S. Steingrub; Nathan I. Shapiro; Laurence W. Busse; Matthew E. Prekker; Ithan D. Peltan; Samuel M. Brown; David N. Hager; Harith Ali; Michelle N. Gong; Amira Mohamed; Akram Khan; Jennifer G. Wilson; Nida Qadir; Steven Y. Chang; Adit A. Ginde; David Huynh; Nicholas M. Mohr; Christopher Mallow; Emily T. Martin; Adam S. Lauring; Nicholas J. Johnson; Jonathan D. Casey; Kevin W. Gibbs; Jennie H. Kwon; Adrienne Baughman; James D. Chappell; Kimberly W. Hart; Carlos G. Grijalva; Jillian P. Rhoads; Sydney A. Swan; H. Keipp Talbot; Kelsey N. Womack; Yuwei Zhu; Mark W. Tenforde; Katherine Adams; Wesley H. Self; Meredith L. McMorrow

doi:10.1016/j.vaccine.2023.05.028

Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022

Diya Surie, Levi N. Bonnell, Jennifer DeCuir, Manjusha Gaglani, Tresa McNeal, Shekhar Ghamande, Jay S. Steingrub, Nathan I. Shapiro, Laurence W. Busse, Matthew E. Prekker, Ithan D. Peltan, Samuel M. Brown, David N. Hager, Harith Ali, Michelle N. Gong, Amira Mohamed, Akram Khan, Jennifer G. Wilson, Nida Qadir, Steven Y. ChangAdit A. Ginde, David Huynh, Nicholas M. Mohr, Christopher Mallow, Emily T. Martin, Adam S. Lauring, Nicholas J. Johnson, Jonathan D. Casey, Kevin W. Gibbs, Jennie H. Kwon, Adrienne Baughman, James D. Chappell, Kimberly W. Hart, Carlos G. Grijalva, Jillian P. Rhoads, Sydney A. Swan, H. Keipp Talbot, Kelsey N. Womack, Yuwei Zhu, Mark W. Tenforde, Katherine Adams, Wesley H. Self, Meredith L. McMorrow

Medicine

Research output: Contribution to journal › Article › peer-review

2 Scopus citations

Abstract

Background: Accurate determination of COVID-19 vaccination status is necessary to produce reliable COVID-19 vaccine effectiveness (VE) estimates. Data comparing differences in COVID-19 VE by vaccination sources (i.e., immunization information systems [IIS], electronic medical records [EMR], and self-report) are limited. We compared the number of mRNA COVID-19 vaccine doses identified by each of these sources to assess agreement as well as differences in VE estimates using vaccination data from each individual source and vaccination data adjudicated from all sources combined. Methods: Adults aged ≥18 years who were hospitalized with COVID-like illness at 21 hospitals in 18 U.S. states participating in the IVY Network during February 1–August 31, 2022, were enrolled. Numbers of COVID-19 vaccine doses identified by IIS, EMR, and self-report were compared in kappa agreement analyses. Effectiveness of mRNA COVID-19 vaccines against COVID-19-associated hospitalization was estimated using multivariable logistic regression models to compare the odds of COVID-19 vaccination between SARS-CoV-2-positive case-patients and SARS-CoV-2-negative control-patients. VE was estimated using each source of vaccination data separately and all sources combined. Results: A total of 4499 patients were included. Patients with ≥1 mRNA COVID-19 vaccine dose were identified most frequently by self-report (n = 3570, 79 %), followed by IIS (n = 3272, 73 %) and EMR (n = 3057, 68 %). Agreement was highest between IIS and self-report for 4 doses with a kappa of 0.77 (95 % CI = 0.73–0.81). VE point estimates of 3 doses against COVID-19 hospitalization were substantially lower when using vaccination data from EMR only (VE = 31 %, 95 % CI = 16 %–43 %) than when using all sources combined (VE = 53 %, 95 % CI = 41 %–62%). Conclusion: Vaccination data from EMR only may substantially underestimate COVID-19 VE.

Original language	English (US)
Pages (from-to)	4249-4256
Number of pages	8
Journal	Vaccine
Volume	41
Issue number	29
DOIs	https://doi.org/10.1016/j.vaccine.2023.05.028
State	Published - Jun 29 2023

Keywords

COVID-19
SARS-CoV-2
Test-negative study design
Vaccine effectiveness
mRNA vaccines

ASJC Scopus subject areas

Molecular Medicine
General Immunology and Microbiology
General Veterinary
Public Health, Environmental and Occupational Health
Infectious Diseases

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1016/j.vaccine.2023.05.028

Fingerprint

Dive into the research topics of 'Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022'. Together they form a unique fingerprint.

Cite this

Surie, D., Bonnell, L. N., DeCuir, J., Gaglani, M., McNeal, T., Ghamande, S., Steingrub, J. S., Shapiro, N. I., Busse, L. W., Prekker, M. E., Peltan, I. D., Brown, S. M., Hager, D. N., Ali, H., Gong, M. N., Mohamed, A., Khan, A., Wilson, J. G., Qadir, N., ... McMorrow, M. L. (2023). Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022. Vaccine, 41(29), 4249-4256. https://doi.org/10.1016/j.vaccine.2023.05.028

Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022. / Surie, Diya; Bonnell, Levi N.; DeCuir, Jennifer et al.
In: Vaccine, Vol. 41, No. 29, 29.06.2023, p. 4249-4256.

Research output: Contribution to journal › Article › peer-review

Surie, D, Bonnell, LN, DeCuir, J, Gaglani, M, McNeal, T, Ghamande, S, Steingrub, JS, Shapiro, NI, Busse, LW, Prekker, ME, Peltan, ID, Brown, SM, Hager, DN, Ali, H, Gong, MN , Mohamed, A, Khan, A, Wilson, JG, Qadir, N, Chang, SY, Ginde, AA, Huynh, D, Mohr, NM, Mallow, C, Martin, ET, Lauring, AS, Johnson, NJ, Casey, JD, Gibbs, KW, Kwon, JH, Baughman, A, Chappell, JD, Hart, KW, Grijalva, CG, Rhoads, JP, Swan, SA, Keipp Talbot, H, Womack, KN, Zhu, Y, Tenforde, MW, Adams, K, Self, WH & McMorrow, ML 2023, 'Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022', Vaccine, vol. 41, no. 29, pp. 4249-4256. https://doi.org/10.1016/j.vaccine.2023.05.028

Surie D, Bonnell LN, DeCuir J, Gaglani M, McNeal T, Ghamande S et al. Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022. Vaccine. 2023 Jun 29;41(29):4249-4256. doi: 10.1016/j.vaccine.2023.05.028

@article{d33a51934f654347be6bea1dec6d1be3,

title = "Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022",

abstract = "Background: Accurate determination of COVID-19 vaccination status is necessary to produce reliable COVID-19 vaccine effectiveness (VE) estimates. Data comparing differences in COVID-19 VE by vaccination sources (i.e., immunization information systems [IIS], electronic medical records [EMR], and self-report) are limited. We compared the number of mRNA COVID-19 vaccine doses identified by each of these sources to assess agreement as well as differences in VE estimates using vaccination data from each individual source and vaccination data adjudicated from all sources combined. Methods: Adults aged ≥18 years who were hospitalized with COVID-like illness at 21 hospitals in 18 U.S. states participating in the IVY Network during February 1–August 31, 2022, were enrolled. Numbers of COVID-19 vaccine doses identified by IIS, EMR, and self-report were compared in kappa agreement analyses. Effectiveness of mRNA COVID-19 vaccines against COVID-19-associated hospitalization was estimated using multivariable logistic regression models to compare the odds of COVID-19 vaccination between SARS-CoV-2-positive case-patients and SARS-CoV-2-negative control-patients. VE was estimated using each source of vaccination data separately and all sources combined. Results: A total of 4499 patients were included. Patients with ≥1 mRNA COVID-19 vaccine dose were identified most frequently by self-report (n = 3570, 79 %), followed by IIS (n = 3272, 73 %) and EMR (n = 3057, 68 %). Agreement was highest between IIS and self-report for 4 doses with a kappa of 0.77 (95 % CI = 0.73–0.81). VE point estimates of 3 doses against COVID-19 hospitalization were substantially lower when using vaccination data from EMR only (VE = 31 %, 95 % CI = 16 %–43 %) than when using all sources combined (VE = 53 %, 95 % CI = 41 %–62%). Conclusion: Vaccination data from EMR only may substantially underestimate COVID-19 VE.",

keywords = "COVID-19, SARS-CoV-2, Test-negative study design, Vaccine effectiveness, mRNA vaccines",

author = "Diya Surie and Bonnell, {Levi N.} and Jennifer DeCuir and Manjusha Gaglani and Tresa McNeal and Shekhar Ghamande and Steingrub, {Jay S.} and Shapiro, {Nathan I.} and Busse, {Laurence W.} and Prekker, {Matthew E.} and Peltan, {Ithan D.} and Brown, {Samuel M.} and Hager, {David N.} and Harith Ali and Gong, {Michelle N.} and Amira Mohamed and Akram Khan and Wilson, {Jennifer G.} and Nida Qadir and Chang, {Steven Y.} and Ginde, {Adit A.} and David Huynh and Mohr, {Nicholas M.} and Christopher Mallow and Martin, {Emily T.} and Lauring, {Adam S.} and Johnson, {Nicholas J.} and Casey, {Jonathan D.} and Gibbs, {Kevin W.} and Kwon, {Jennie H.} and Adrienne Baughman and Chappell, {James D.} and Hart, {Kimberly W.} and Grijalva, {Carlos G.} and Rhoads, {Jillian P.} and Swan, {Sydney A.} and {Keipp Talbot}, H. and Womack, {Kelsey N.} and Yuwei Zhu and Tenforde, {Mark W.} and Katherine Adams and Self, {Wesley H.} and McMorrow, {Meredith L.}",

note = "Publisher Copyright: {\textcopyright} 2023",

year = "2023",

month = jun,

day = "29",

doi = "10.1016/j.vaccine.2023.05.028",

language = "English (US)",

volume = "41",

pages = "4249--4256",

journal = "Vaccine",

issn = "0264-410X",

publisher = "Elsevier BV",

number = "29",

}

TY - JOUR

T1 - Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source

T2 - Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022

AU - Surie, Diya

AU - Bonnell, Levi N.

AU - DeCuir, Jennifer

AU - Gaglani, Manjusha

AU - McNeal, Tresa

AU - Ghamande, Shekhar

AU - Steingrub, Jay S.

AU - Shapiro, Nathan I.

AU - Busse, Laurence W.

AU - Prekker, Matthew E.

AU - Peltan, Ithan D.

AU - Brown, Samuel M.

AU - Hager, David N.

AU - Ali, Harith

AU - Gong, Michelle N.

AU - Mohamed, Amira

AU - Khan, Akram

AU - Wilson, Jennifer G.

AU - Qadir, Nida

AU - Chang, Steven Y.

AU - Ginde, Adit A.

AU - Huynh, David

AU - Mohr, Nicholas M.

AU - Mallow, Christopher

AU - Martin, Emily T.

AU - Lauring, Adam S.

AU - Johnson, Nicholas J.

AU - Casey, Jonathan D.

AU - Gibbs, Kevin W.

AU - Kwon, Jennie H.

AU - Baughman, Adrienne

AU - Chappell, James D.

AU - Hart, Kimberly W.

AU - Grijalva, Carlos G.

AU - Rhoads, Jillian P.

AU - Swan, Sydney A.

AU - Keipp Talbot, H.

AU - Womack, Kelsey N.

AU - Zhu, Yuwei

AU - Tenforde, Mark W.

AU - Adams, Katherine

AU - Self, Wesley H.

AU - McMorrow, Meredith L.

PY - 2023/6/29

Y1 - 2023/6/29

N2 - Background: Accurate determination of COVID-19 vaccination status is necessary to produce reliable COVID-19 vaccine effectiveness (VE) estimates. Data comparing differences in COVID-19 VE by vaccination sources (i.e., immunization information systems [IIS], electronic medical records [EMR], and self-report) are limited. We compared the number of mRNA COVID-19 vaccine doses identified by each of these sources to assess agreement as well as differences in VE estimates using vaccination data from each individual source and vaccination data adjudicated from all sources combined. Methods: Adults aged ≥18 years who were hospitalized with COVID-like illness at 21 hospitals in 18 U.S. states participating in the IVY Network during February 1–August 31, 2022, were enrolled. Numbers of COVID-19 vaccine doses identified by IIS, EMR, and self-report were compared in kappa agreement analyses. Effectiveness of mRNA COVID-19 vaccines against COVID-19-associated hospitalization was estimated using multivariable logistic regression models to compare the odds of COVID-19 vaccination between SARS-CoV-2-positive case-patients and SARS-CoV-2-negative control-patients. VE was estimated using each source of vaccination data separately and all sources combined. Results: A total of 4499 patients were included. Patients with ≥1 mRNA COVID-19 vaccine dose were identified most frequently by self-report (n = 3570, 79 %), followed by IIS (n = 3272, 73 %) and EMR (n = 3057, 68 %). Agreement was highest between IIS and self-report for 4 doses with a kappa of 0.77 (95 % CI = 0.73–0.81). VE point estimates of 3 doses against COVID-19 hospitalization were substantially lower when using vaccination data from EMR only (VE = 31 %, 95 % CI = 16 %–43 %) than when using all sources combined (VE = 53 %, 95 % CI = 41 %–62%). Conclusion: Vaccination data from EMR only may substantially underestimate COVID-19 VE.

AB - Background: Accurate determination of COVID-19 vaccination status is necessary to produce reliable COVID-19 vaccine effectiveness (VE) estimates. Data comparing differences in COVID-19 VE by vaccination sources (i.e., immunization information systems [IIS], electronic medical records [EMR], and self-report) are limited. We compared the number of mRNA COVID-19 vaccine doses identified by each of these sources to assess agreement as well as differences in VE estimates using vaccination data from each individual source and vaccination data adjudicated from all sources combined. Methods: Adults aged ≥18 years who were hospitalized with COVID-like illness at 21 hospitals in 18 U.S. states participating in the IVY Network during February 1–August 31, 2022, were enrolled. Numbers of COVID-19 vaccine doses identified by IIS, EMR, and self-report were compared in kappa agreement analyses. Effectiveness of mRNA COVID-19 vaccines against COVID-19-associated hospitalization was estimated using multivariable logistic regression models to compare the odds of COVID-19 vaccination between SARS-CoV-2-positive case-patients and SARS-CoV-2-negative control-patients. VE was estimated using each source of vaccination data separately and all sources combined. Results: A total of 4499 patients were included. Patients with ≥1 mRNA COVID-19 vaccine dose were identified most frequently by self-report (n = 3570, 79 %), followed by IIS (n = 3272, 73 %) and EMR (n = 3057, 68 %). Agreement was highest between IIS and self-report for 4 doses with a kappa of 0.77 (95 % CI = 0.73–0.81). VE point estimates of 3 doses against COVID-19 hospitalization were substantially lower when using vaccination data from EMR only (VE = 31 %, 95 % CI = 16 %–43 %) than when using all sources combined (VE = 53 %, 95 % CI = 41 %–62%). Conclusion: Vaccination data from EMR only may substantially underestimate COVID-19 VE.

KW - COVID-19

KW - SARS-CoV-2

KW - Test-negative study design

KW - Vaccine effectiveness

KW - mRNA vaccines

UR - http://www.scopus.com/inward/record.url?scp=85162160960&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85162160960&partnerID=8YFLogxK

U2 - 10.1016/j.vaccine.2023.05.028

DO - 10.1016/j.vaccine.2023.05.028

M3 - Article

C2 - 37301704

AN - SCOPUS:85162160960

SN - 0264-410X

VL - 41

SP - 4249

EP - 4256

JO - Vaccine

JF - Vaccine

IS - 29

ER -

Comparison of mRNA vaccine effectiveness against COVID-19-associated hospitalization by vaccination source: Immunization information systems, electronic medical records, and self-report—IVY Network, February 1–August 31, 2022

Abstract

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this