Literature DB >> 35795262

Can administrative health data be used to estimate population level birth and child mortality estimates? A comparison of India's Health Information Management System data with nationally representative survey data.

Pritha Chatterjee1, Aashish Gupta2, S V Subramanian1,2.   

Abstract

•HMIS covers a large proportion of births, but a smaller fraction of child deaths compared to estimates from surveys.•Birth and death coverage in HMIS, while incomplete, has been improving nationally and for many states.•States that have improved HMIS reporting, should be studied for replicating best practices.•HMIS can provide signals for real time policy decisions, if used with due consideration of its limitations.•Including patient socioeconomic and demographic traits in HMIS, could further bolster its utility in population health.
© 2022 The Authors.

Entities:  

Year:  2022        PMID: 35795262      PMCID: PMC9251721          DOI: 10.1016/j.ssmph.2022.101148

Source DB:  PubMed          Journal:  SSM Popul Health        ISSN: 2352-8273


Introduction

In the absence of complete civil registration systems, birth and death rates in Low- and- Middle-Income-Countries (LMICs) including India, are estimated from nationally representative surveys like the Sample Registration System (SRS) and the National Family Health Surveys (NFHS) (Alkema & You, 2012). The right to birth registration is pledged in the United Nations Convention on the Rights of the Child. Establishment of robust civil registration systems is also enlisted under the Sustainable Development Goals (SDGs). As the COVID-19 pandemic has illustrated only too well, reliable and timely statistics on birth and mortality rates can inform both population health policies and public discussion on social priorities, often in real time (AbouZahr et al., 2021; Banaji & Gupta, 2021; Jha et al., 2022). However, registration of births and deaths in India like many other LMICs, is incomplete, often delayed, and marked by widespread social inequities (Bhatia et al., 2019). Can administrative datasets maintained by health systems overcome some limitations of incomplete and delayed data on vital registration in LMICs? India's Health Management Information System (HMIS) was established in 2008 under India's Ministry of Health and Family Welfare (Bodavala, n.d.). In the HMIS, sub-centers, primary health centers, and hospitals provide three types of data- 1) monthly counts of a spectrum of health service delivery indicators including reproductive, maternal, and child health indicators including facility reported births and deaths, immunization, family planning, among others, 2) quarterly trainings for health professionals, 3) annual infrastructure including staff strength, equipment and services like diagnostics and surgeries among others (Krishnan et al., 2010). These data are made available on a centralized online portal. Importantly, since the HMIS includes data from all reporting health facilities; these indicators are counts, unlike estimates from sample-based surveys (Rajesh Kumar, n.d.). With the potential to generate monthly updates, HMIS also provides the most updated available numbers on the health indicators it covers (Bodavala, n.d.). Furthermore, HMIS includes data from all states and union territories, including the north-eastern states, which are omitted from India's Sample Registration System (SRS) (Bodavala, n.d.), (Rajesh Kumar, n.d.), (Baviskar et al., 2020). It is also more granular, with data collated and available at the sub-district level (Bodavala, n.d.), (Rajesh Kumar, n.d.) (Baviskar et al., 2020; Goli et al., 2021),. HMIS data are also easily accessible via the public portal maintained by India's health ministry (S, 2021). Like other countries, India has multiple systems to measure and track health related indicators and outcomes, with varying strengths and limitations (Saikia & Kulkarni, 2016). Vital registration, although incomplete, is improving, and is embedded in a statutory identity framework (Gupta, 2020). In the absence of reliable mortality and fertility indicators from the Civil Registration System, the Sample Registration system provides annual estimates of vital rates at the state and national level (Mahapatra, 2010). This is supplemented by other periodic but intermittent surveys, such as the National Family Health Surveys, which collect richer contextual information, allowing scientific examination of the determinants of health (Gupta & Sudharsanan, 2020). Compared to these existing individual level data sources, the HMIS is a facility based administrative database, compiled in the course of service and healthcare delivery. The HMIS is finer in both geographic and periodic scales: data are compiled at the monthly frequency, and since they cover all facilities, can be aggregated to any geographic level. This key strength, helpful for internal planning as well as overall use for monitoring population health (Rajpal et al., 2021), is offset by the concern that vital events may be missed in this facility-based survey. Our paper examines the extent to which this concern is true, by comparing the levels of births and child deaths in the HMIS to those of nationally representative surveys such as the Sample Registration System and the National Family Health System. We do this following a large literature in the population and social science which seeks to understand the reliability of data sources by comparing them against multiple well-regarded sources (Brown et al., 2019; Hendi, 2017; Somanchi, 2021; Warren et al., 2017). Our goal is to examine the extent to which the HMIS misses births and child deaths. Because the HMIS is a facility-based survey, we expect the HMIS to miss births and deaths that were not in facilities. However, given that access to public health facilities has increased, we expect that the coverage of the HMIS, particularly of births and deaths close to births would have increased (Bhatia et al., 2019). We also expect the HMIS to have greater coverage in states with better functioning public health systems. A small body of recent studies from India, restricted to some states and for service delivery indicators, has considered the quality of HMIS data for a range of health-service related indicators. Immunization data from HMIS in Haryana state in north India, had an average completeness record of 88.5%, ranging from 73% for ‘DPT1 vaccination date’ to 94.6% for ‘date of delivery’, compared to a cross-sectional survey in the state (Rajesh Kumar, n.d.). A temporal analysis of HMIS data from 2008 to 2018 in West Bengal's South 24 Parganas district in eastern India identified discrepancies between HMIS, District Leddy Household and Facility Survey (DLHS) in immunization data ( and Child Health Indicators from Health Management and Information System of a Vulnerable District of India_ Tracking the Road toward the Sustainable Development Goal-3.Html, n.d.). A cross-sectional study comparing immunization trends across districts in Maharashtra in HMIS and NFHS (2015–16) found that immunization coverage reported by HMIS was 94.13%, against NFHS's total estimated state level coverage of 56.3% during the same time, with high between district discrepancies in HMIS data within the same state (Baviskar et al., 2020). A study from a single district in Odisha state interviewed local health workers managing HMIS, while also comparing records in HMIS and the state's Mother and Child Tracking System (MCTS), and identified underreporting as well as discrepant reporting in the HMIS (Suhita Chopra Chatterjee, n.d.). Inadequate infrastructure, weak surveillance, poor reporting of risk factors during pregnancy were identified as shortcomings in HMIS (Suhita Chopra Chatterjee, n.d.). HMIS data has also been referenced by Indian policy makers to monitor trends in key health service indicators. The National Institution for Transforming India (NITI) Aayog, the policy think-tank of the Government of India since 2014, used HMIS data for its 2019 report on overall and incremental health performances of states and UTs. Using five upweighted indicators from HMIS for its analysis, the NITI Aayog identified over-reporting of antenatal care registrations in the first trimester by 53.5% in Jharkhand, 42.4% in West Bengal, 25.9% in Chhattisgarh, 18.4% in Rajasthan, Chhattisgarh, Madhya Pradesh, Andhra Pradesh, and Uttar Pradesh over-reported institutional deliveries by 22%–36% (Kole, 2019). Importantly, the NITI Aayog acknowledged “huge disparities in the data integrity measures across states and UTs” (Kole, 2019). More recently, HMIS has emerged as an important source of monitoring gaps in routine maternal, newborn and child health services like immunization, during the national lockdown for COVID-19 in India (Dreze & Paikra, 2020; Rukmini, 2020). It has also been used for assessing the overall mortality impact of the pandemic (Jha et al., 2022) and levels of maternal mortality at the district level (Goli et al., 2021). Briefly, international assessments of HMIS data quality have also considered health-service indicators. For Rwandan districts, an evaluation of HMIS data for a three-month period found variable data quality, with some indicators showing better quality and consistency across districts (Nshimyiryo et al., 2020). Importantly, the study noted that over-reporting was observed for indicators with more complex calculations, including gestational age, scheduling to determine antenatal care visits (Nshimyiryo et al., 2020). In Nigeria, studies have identified paucity of professional training, and, lack of policies and inadequate technological infrastructure as concerns with HMIS data (Ojo, 2018). However, comparisons of HMIS data with population level outcomes are lacking. Importantly, several concerns have also been raised about the fidelity of HMIS data in India. Some of these include delays in reporting, over-reporting, inter-state variability on reporting, inadequate data management infrastructure, and lack of trained personnel for data entry (Rajesh Kumar, n.d.) (Baviskar et al., 2020) (Suhita Chopra Chatterjee, n.d.). HMIS data from its public platform (https://nrhm-mis.nic.in/hmisreports/frmstandard_reports.aspx) also requires considerable cleaning and wrangling for analysis (Rajesh Kumar, n.d.),(Suhita Chopra Chatterjee, n.d.),( and Child Health Indicators from Health Management and Information System of a Vulnerable District of India_ Tracking the Road toward the Sustainable Development Goal-3.Html, n.d.). Furthermore, indicators and their definitions are not consistent over time, making time series analysis difficult (Baviskar et al., 2020),7,(Rajesh Kumar, n.d.). Since HMIS provides count data, it does not allow for data to be disaggregated by social group characteristics, which inhibits its direct application for monitoring of disadvantaged social groups (Suhita Chopra Chatterjee, n.d.). Identifying a denominator or an estimate of the total population in a given area to calculate prevalence estimates is another “inherent difficulty” in HMIS ( and Child Health Indicators from Health Management and Information System of a Vulnerable District of India_ Tracking the Road toward the Sustainable Development Goal-3.Html, n.d.). While there has been considerable discourse on HMIS data quality in recent years, it has largely focused on health-service delivery indicators. Besides recent work by Jha et al., 2022 and Goli et al., 2021, very little attention has been given to the institutional births and deaths data being collated on this platform. According to HMIS training manuals, for births in addition to monthly facility reporting, HMIS also includes lists of births and births attended by skilled birth attendants, entered by Auxiliary Nursing Midwives from the community (Government of India, 2021). Therefore, we analyze the completeness and reliability of India's HMIS specifically for birth and child mortality rates as important population health indicators, relative to two nationally representative datasets in India-the NFHS and the SRS. Given the differing objectives, geographies of representation, and sampling techniques, we compare selected vital statistics for annual periods at the national and sub-national level, over a five-year period when data across at least two of these sources are available. First, we estimate annual birth and mortality rates from counts provided in HMIS. We then compare annual rates and counts of births, neonatal, post-neonatal, infant and child deaths across HMIS, SRS and NFHS, nationally and across states. Given that HMIS is based on data reported from health facilities, we hypothesized that HMIS would be better at capturing institutional births. So, we also compare institutional births separately, across HMIS, SRS and NFHS.

Methods

Data: This analysis is based on four data sources. The HMIS provides monthly reporting of key reproductive, maternal, neonatal and child health outcomes from 2008 to 2020. Data from 2014 to 20 have been used in this analysis. The NFHS is a nationally representative cross-sectional survey of population health and nutrition in India. The NFHS was fielded in 1992–93, 1998–98, 2005–06, and 2015–16(International Institute for Population Sciences, 2007). We use data from NFHS-4, which follows a multi-stage sampling procedure and has emerged as a reliable nationally representative dataset for monitoring population health trends (International Institute for Population Sciences, 2007). The NFHS follows a multi-stage sampling procedure and has emerged as a reliable nationally representative dataset for monitoring population health trends. NFHS-4 (2015–16) provides retrospective birth history for 699,686 women (aged 15–49 years) and is representative at the district level(International Institute for Population Sciences, 2007). The SRS, conducted by the Office of the Registrar General and Census Commissioner of India, provides estimates of key demographic indicators from a nationally representative panel of unban blocks and villages(Mahapatra, 2010). SRS estimates collated from SRS summary reports from 2014 to 2018, have been used in this analysis. Finally, the USAID and DHS's spatial data repository (https://spatialdata.dhsprogram.com/home/) which provides district level annual estimates of total population and population between 0 and 5 years estimated by Leddy Jr (Leddy, n.d.) has been used to calculate the birth and mortality estimates. We use these data instead of India's official population projections because the official projections do not provide state- and age-specific estimates of population for all the years we consider in our analysis. Previous work has shown that using the official estimates or those by the DHS makes little difference to demographic estimates (Gupta & Mani, 2022). Outcomes: We estimated the following indicators from HMIS, SRS and NFHS in 2014 and 2018: Crude Birth Rate, defined as the number of live births during the year per 1,000 population Neonatal mortality rate (NMR), defined as the number of deaths of at age less than 29 days during the year per 1,000 live births Post neonatal mortality Rate, or the number of deaths between ages 29 days to one year during the year per 1,000 live births Infant mortality rate or the number of infant deaths during the year (0–1 years) per 1,000 live births Child mortality Rate (0–4 years) or the age-specific mortality rate between ages 0 and 4, defined as the number of deaths among children aged 0–4 years per 1,000 population aged 0-4 Child mortality Rate (1–4 years): the life table age-specific mortality rate between ages 1 to 4, defined as the number of deaths among children aged 1–4 per 1,000 population aged 1–4. Given the objectives of the study to compare average trends in administrative and survey data on their capturing of births and deaths, we did not include any covariates in this analysis. Statistical Analysis: For HMIS, we used state level counts of total live births, neonatal, infant and child deaths to estimate outcomes at 0–4 and 1–4 years for all years from 2014 to 2020. For ease of comparison with NFHS and SRS, HMIS data before 2014 was not included in the analysis. To estimate birth rates from HMIS, the total live births reported under HMIS were divided by the annual district level total population estimates from the Spatial Data Repository Program of the DHS and USAID(Leddy, n.d.). For neonatal, post-neonatal, and infant mortality, total deaths in each population group from HMIS were divided by the total number of births from HMIS. These rates are case-fatality rates. For child mortality (0–4 years), the total number of deaths in this age group from HMIS were divided by population estimates of total children in this age group from DHS/USAID for each year of comparison. To estimate child mortality (1–4 years), we divided the difference between the child mortality (0–4 years) count and the infant mortality count with difference between DHS estimates of total child deaths (0–4 years) count and total live births as estimated under SRS. We used birth estimates from SRS instead of HMIS since HMIS underestimates total births based on comparisons of birth rates across HMIS, NFHS and SRS. We use birth rates from Table 3 of the SRS annual reports (Mahapatra, 2010). Infant, neonatal, and post-neonatal mortality rates are from Table 9 of the SRS annual reports, and age-specific mortality rates between 0-4 and 1–4 years are from Table 8 of the SRS annual reports (Mahapatra, 2010). The proportion of births in institutional facilities is from Table 17 of the same report (Mahapatra, 2010).
Table 3b

State-wise comparison of estimates of live and institutional births, 2018

State2018
HMIS Live BirthsHMIS Institutional BirthsSRSInstitutional Births
India20,666,30719,388,41121,397,762
A & N Islands4,0163,727
Andhra Pradesh757,911752,248778,759
Arunachal Pradesh18,47416,826
Assam579,503525,160580,895
Bihar2,048,7821,681,2192,150,292
Chandigarh29,00829,186
Chhattisgarh483,992473,943488,054
Dadra & Nagar Haveli9,1069,090
Daman & Diu3,8673,865
Delhi277,984267,726258,490
Goa18,18518,143
Gujarat1,141,5311,122,8561,216,926
Haryana500,854476,915477,775
Himachal Pradesh86,77878,65788,220
Jammu & Kashmir198,117190,705190,729
Jharkhand734,933703,595506,681
Karnataka907,016907,6681,082,584
Kerala479,334474,983455,130
Lakshadweep836839
Madhya Pradesh1,346,6021,284,5171,614,710
Maharashtra1,720,7601,712,7781,799,448
Manipur37,75831,134
Meghalaya82,82548,261
Mizoram19,21917,269
Nagaland19,45515,994
Odisha634,660616,888646,615
Puducherry43,36943,643
Punjab370,467362,717384,493
Rajasthan1,356,2321,339,1311,592,883
Sikkim7,1467,147
Tamil Nadu920,658920,0241,074,755
Telangana630,063607,434583,685
Tripura50,34347,329
Uttar Pradesh3,686,4643,180,5653,757,899
Uttarakhand149,298129,600132,642
West Bengal1,310,7611,286,6291,230,231

Note: 95% CIs for NFHS rates are available in the appendix.

For NFHS, we use standard procedures to estimate age-specific mortality rates and child mortality rates. It was not possible to estimate the birth rate from the NFHS birth history module. All other rates were calculated using the birth history module (International Institute for Population Sciences, 2007). For infant, neonatal, and post-neonatal mortality rates, we used live births as the denominator. For age-specific mortality rates between ages 0–4 and 1–4, we calculated mortality rates by calculating person-years lived in these ages. These approaches follow standard demographic procedures for birth history data (Moultrie et al., 2013;. We also calculated accurate 95% Confidence Intervals for NFHS indicators, accounting for the clustering of observations within primary sampling units. In 2014, rates from HMIS, the SRS, and the NFHS were available (Table 1). For 2018, rates from the SRS and the HMIS were available.
Table 1

Comparison of birth and mortality indicators in 2014 and 2018 at the national level, based on the Health Management Information System (HMIS), the National Family Health Survey (NFHS) and the Sample Registration Survey (SRS).


2014
2018
IndicatorHMISNFHSSRSHMISNFHSSRS
Birth Rate16.8NA21.015.9NA20.0
Neo-Natal Mortality Rate4.431.526.08.6NA23.0
Post Neo-Natal Mortality Rate1.88.613.03.3NA9.0
Infant Mortality Rate6.140.139.011.9NA32.0
Child Mortality Rate ages 0-41.29.611.02.4NA9.0
Child Mortality Rate ages 1-40.22.01.70.4NA1.1
Proportion of Institutional Births (%)68*817994NA83

Note: All rates are per 1,000. The proportion of institutional births in the HMIS is calculated using the total number of births estimated from the SRS. For NFHS, which is a multi-stage sample surveys, 95% CIs were calculated using a cluster-bootstrap procedure. For the NFHS, the 95% CI for the proportion of births that are institutional is [0.8069 - 0.8189], for the neonatal mortality rate is [27.062–30.864], for the post-neonatal mortality rate is [9.156–11.321], for the infant mortality rate is [37.001–41.394], for the age-specific mortality rate between ages 0 and 4 was [9.103–10.136], and for the age specific mortality rate between ages 1 and 4 was [1.708–2.310]. Like the NFHS, the SRS is also a sample survey, but 95% CIs cannot be calculated because microdata from the SRS are not available to researchers.

Comparison of birth and mortality indicators in 2014 and 2018 at the national level, based on the Health Management Information System (HMIS), the National Family Health Survey (NFHS) and the Sample Registration Survey (SRS). Note: All rates are per 1,000. The proportion of institutional births in the HMIS is calculated using the total number of births estimated from the SRS. For NFHS, which is a multi-stage sample surveys, 95% CIs were calculated using a cluster-bootstrap procedure. For the NFHS, the 95% CI for the proportion of births that are institutional is [0.8069 - 0.8189], for the neonatal mortality rate is [27.062–30.864], for the post-neonatal mortality rate is [9.156–11.321], for the infant mortality rate is [37.001–41.394], for the age-specific mortality rate between ages 0 and 4 was [9.103–10.136], and for the age specific mortality rate between ages 1 and 4 was [1.708–2.310]. Like the NFHS, the SRS is also a sample survey, but 95% CIs cannot be calculated because microdata from the SRS are not available to researchers. State wise comparison of India's birth and mortality indicators in 2014 and 2018 in Health Management Information System (HMIS), National Family Health Survey (NFHS) and Sample Registration Survey (SRS). Note: 95% CIs for NFHS rates are available in the appendix.

Results

National level: HMIS estimated birth rates of 16.8 and 15.9 per 1,000 in 2014 and 2018, compared to the SRS's estimates of 21.0 and 20.0 births per 1,000 in 2014 and 2018- a difference of 4.2 and 4.1 percentage points respectively (Table 1). For mortality rates, in 2014, the HMIS recorded 6.1 infant deaths per 1,000 births as compared to 39.2 and 39 infant deaths per 1,000 births in the NFHS and SRS, respectively (Table 1). By 2018, the HMIS recorded 11.9 as compared to 32.0 infant deaths per 1,000 births in the SRS (Table 1). The levels of under-reporting in infant deaths in HMIS compared to the other data sources were slightly lower than that in the 1–4 age-group. Similar trends are observed for neonatal deaths (Table 1). In 2014, the HMIS recorded 4.4 neonatal deaths per 1,000 births as compared to 29.0 in the NFHS and 26.0 in the SRS (Table 1). In 2018, the HMIS recorded 8.6 neonatal deaths per 1,000 births, in contrast to 23.0 in the SRS (Table 1). Among the mortality indicators, neonatal mortality showed the highest discordance between HMIS, NFHS and SRS. Among the mortality indicators, neonatal mortality showed the highest discordance between HMIS, NFHS and SRS. Barring child mortality (1–4 years), all other infant and child mortality indicators increased between 2014 and 2018 in HMIS (Table 1). State level: State specific analysis presents five important insights. First, similar to national trends, in most states, HMIS under-reported birth and death rates, with under-reporting higher for deaths than births (Table 2). Second, as with the national estimates, we see improvement in the performance of the HMIS over time. Third, we observe a small number of states, such as Kerala in the south and Himachal Pradesh in the north, where the HMIS performs relatively well (Table 2). In Himachal Pradesh, the HMIS estimated the IMR to be 17 deaths per 1,000 births in 2018, while the SRS estimated an infant mortality rate of 19 deaths per 1,000 births (Table 2d). Fourth, in some states, most notably in Bihar and Uttar Pradesh, the HMIS recorded very few deaths compared to the number of estimated deaths NFHS and SRS (Table 2). However, in many states, by 2018, the HMIS recorded about half of the estimated infant deaths (Table 2d). This was true even in some poorer states with a high mortality burden, such as Madhya Pradesh, Orissa, and Rajasthan. Finally, we found some inconsistencies between NFHS and SRS. For example, in Bihar, neonatal mortality rates in 2014 were 39.9 deaths per 1000 children in NFHS, compared to 27.0 deaths per 1000 children in SRS (Table 2b). In Uttar Pradesh, neonatal mortality rates in 2014 were 49.9 deaths per 1000 children in NFHS, compared to 32.0 deaths per 1000 children in SRS (Table 2b). In states like Gujarat, Haryana, Rajasthan and Punjab, among others, the discrepancies between NFHS and SRS were relatively smaller (Table 2). Confidence Intervals for state-wise NFHS rates are provided in the appendix.
Table 2

State wise comparison of India's birth and mortality indicators in 2014 and 2018 in Health Management Information System (HMIS), National Family Health Survey (NFHS) and Sample Registration Survey (SRS).

(a): Birth Rates
20142018
StateHMISSRSHMISSRS
India16.821.015.920.0
A & N Islands14.110.6
Andhra Pradesh10.417.015.216.0
Arunachal Pradesh11.111.9
Assam19.222.417.421.1
Bihar18.625.917.526.2
Chandigarh24.125.8
Chhattisgarh19.123.417.222.5
Dadra & Nagar Haveli19.220.1
Daman & Diu13.912.2
Delhi14.816.815.114.7
Goa11.912.4
Gujarat18.820.617.519.7
Haryana19.621.218.220.3
Himachal Pradesh13.516.412.215.7
Jammu & Kashmir14.816.814.215.4
Jharkhand18.923.820.222.6
Karnataka14.314.117.2
Kerala15.214.814.613.9
Lakshadweep10.213.1
Madhya Pradesh18.225.717.024.6
Maharashtra15.316.514.515.6
Manipur13.711.4
Meghalaya27.024.5
Mizoram19.115.8
Nagaland11.710.4
Odisha16.619.414.518.2
Puducherry31.430.5
Punjab14.615.412.814.8
Rajasthan20.225.018.124.0
Sikkim12.711.3
Tamil Nadu13.415.412.114.7
Telangana12.218.017.216.9
Tripura13.913.0
Uttar Pradesh17.527.017.025.6
Uttarakhand15.218.213.716.7
West Bengal
15.6
15.6
13.8
15.0
(b) Neonatal Mortality Rates

2014
2018
StateHMISNFHSSRSHMISSRS
India4.429.026.08.623.0
A & N Islands2.519.512.7
Andhra Pradesh1.815.526.09.221.0
Arunachal Pradesh1.112.26.1
Assam4.728.626.013.721.0
Bihar0.039.927.04.325.0
Chandigarh43.627.125.9
Chhattisgarh5.938.228.09.629.0
Dadra & Nagar Haveli15.60.018.8
Daman & Diu8.70.010.6
Delhi8.56.013.013.310.0
Goa1.00.05.7
Gujarat5.225.724.013.419.0
Haryana5.819.923.013.522.0
Himachal Pradesh6.522.525.012.613.0
Jammu & Kashmir0.824.826.08.617.0
Jharkhand1.330.425.04.321.0
Karnataka4.916.120.09.016.0
Kerala0.83.06.03.05.0
Lakshadweep1.555.64.8
Madhya Pradesh6.337.335.017.035.0
Maharashtra4.912.016.07.513.0
Manipur0.512.21.3
Meghalaya9.824.414.2
Mizoram6.518.79.3
Nagaland1.919.96.3
Odisha14.922.436.015.031.0
Puducherry0.37.38.5
Punjab1.614.314.04.813.0
Rajasthan7.725.932.013.926.0
Sikkim5.98.59.5
Tamil Nadu7.214.414.05.610.0
Telangana0.829.525.05.419.0
Tripura4.014.310.7
Uttar Pradesh0.149.932.02.532.0
Uttarakhand2.234.626.05.222.0
West Bengal
11.0
17.5
19.0
14.4
16.0
(c) Post- Neonatal Mortality Rates

2014
2018
StateHMISNFHSSRSHMISSRS
India1.810.213.03.39.0
A & N Islands3.00.02.2
Andhra Pradesh1.110.013.02.58.0
Arunachal Pradesh0.812.51.6
Assam2.713.423.06.620.0
Bihar0.012.715.01.47.0
Chandigarh7.90.025.9
Chhattisgarh3.010.515.04.212.0
Dadra & Nagar Haveli5.538.29.1
Daman & Diu1.90.02.3
Delhi3.74.67.05.73.0
Goa2.10.02.4
Gujarat1.54.211.05.29.0
Haryana2.88.013.06.28.0
Himachal Pradesh3.510.67.04.56.0
Jammu & Kashmir0.511.28.01.55.0
Jharkhand1.08.99.01.79.0
Karnataka1.610.09.03.07.0
Kerala0.20.06.01.02.0
Lakshadweep3.119.48.4
Madhya Pradesh2.714.017.06.313.0
Maharashtra1.56.36.02.66.0
Manipur0.75.10.8
Meghalaya14.913.712.3
Mizoram29.638.110.2
Nagaland2.212.84.1
Odisha6.514.313.06.69.0
Puducherry0.10.02.1
Punjab1.79.410.02.77.0
Rajasthan2.99.814.07.111.0
Sikkim8.612.98.1
Tamil Nadu2.77.66.02.45.0
Telangana0.88.610.01.28.0
Tripura4.628.77.2
Uttar Pradesh0.114.216.01.011.0
Uttarakhand0.810.47.02.09.0
West Bengal
2.8
4.4
9.0
4.1
6.0
(d) Infant Mortality Rate

2014
2018
StateHMISNFHSSRSHMISSRS
India6.139.239.011.932.0
A & N Islands5.519.514.9
Andhra Pradesh3.025.539.011.729.0
Arunachal Pradesh1.924.77.6
Assam7.442.049.020.341.0
Bihar0.052.642.05.732.0
Chandigarh51.527.151.8
Chhattisgarh8.948.743.013.841.0
Dadra & Nagar Haveli21.238.227.9
Daman & Diu10.60.012.9
Delhi12.210.520.018.913.0
Goa3.20.08.1
Gujarat6.729.935.018.628.0
Haryana8.627.936.019.730.0
Himachal Pradesh9.933.132.017.019.0
Jammu & Kashmir1.335.934.010.122.0
Jharkhand2.339.234.06.030.0
Karnataka6.526.129.012.023.0
Kerala1.03.012.04.07.0
Lakshadweep4.675.013.2
Madhya Pradesh9.051.352.023.348.0
Maharashtra6.418.322.010.119.0
Manipur1.217.32.1
Meghalaya24.738.226.5
Mizoram36.156.819.5
Nagaland4.132.710.4
Odisha21.436.749.021.640.0
Puducherry0.47.310.5
Punjab3.323.724.07.520.0
Rajasthan10.635.746.021.037.0
Sikkim14.421.317.6
Tamil Nadu9.922.120.08.015.0
Telangana1.538.135.06.727.0
Tripura8.743.017.9
Uttar Pradesh0.264.048.03.643.0
Uttarakhand3.145.033.07.131.0
West Bengal
13.8
21.9
28.0
18.5
22.0
(e) Child Mortality Rate (0–4 years)

2014
2018
StateHMISNFHSSRSHMISSRS
India1.29.611.02.49.0
A & N Islands1.24.32.9
Andhra Pradesh0.56.010.02.99.0
Arunachal Pradesh0.27.41.1
Assam1.510.115.03.911.0
Bihar0.013.112.00.98.0
Chandigarh16.94.721.4
Chhattisgarh1.912.912.03.011.0
Dadra & Nagar Haveli4.513.76.3
Daman & Diu2.20.02.4
Delhi2.68.45.04.24.0
Goa0.60.01.6
Gujarat1.57.710.04.28.0
Haryana2.16.89.04.59.0
Himachal Pradesh1.76.111.03.26.0
Jammu & Kashmir0.28.68.01.45.0
Jharkhand0.510.710.01.38.0
Karnataka1.26.67.02.47.0
Kerala0.21.03.01.02.0
Lakshadweep0.815.72.3
Madhya Pradesh1.812.616.04.714.0
Maharashtra1.44.35.02.14.0
Manipur0.34.30.4
Meghalaya5.89.56.1
Mizoram6.613.43.5
Nagaland0.58.61.4
Odisha4.59.313.04.311.0
Puducherry0.31.75.3
Punjab0.85.16.01.55.0
Rajasthan2.29.912.04.210.0
Sikkim2.84.13.1
Tamil Nadu1.95.04.01.74.0
Telangana0.36.11.01.78.0
Tripura1.58.63.1
Uttar Pradesh0.015.816.00.714.0
Uttarakhand0.511.26.01.35.0
West Bengal
2.8
5.2
6.0
3.7
6.0
(f) Child Mortality Rate (1–4 years)

2014
2018
StateHMISNFHSSRSHMISSRS
India0.22.01.70.41.1
A & N Islands0.0
Andhra Pradesh0.10.70.30.41.1
Arunachal Pradesh2.7
Assam0.11.84.60.41.5
Bihar0.02.42.90.11.2
Chandigarh0.0
Chhattisgarh0.32.81.70.61.1
Dadra & Nagar Haveli7.8
Daman & Diu0.0
Delhi0.64.90.30.71.5
Goa0.0
Gujarat0.11.61.60.50.8
Haryana0.41.81.00.71.5
Himachal Pradesh0.10.70.40.51.8
Jammu & Kashmir0.02.00.10.10.2
Jharkhand0.13.32.70.31.1
Karnataka1.90.70.31.3
Kerala0.00.40.40.20.7
Lakshadweep0.0
Madhya Pradesh0.42.53.41.02.0
Maharashtra0.30.70.40.40.6
Manipur1.4
Meghalaya1.1
Mizoram1.4
Nagaland2.5
Odisha0.51.32.80.71.1
Puducherry0.0
Punjab0.20.50.80.20.5
Rajasthan0.33.31.30.70.8
Sikkim0.0
Tamil Nadu0.12.40.40.30.6
Telangana0.10.30.50.20.8
Tripura0.0
Uttar Pradesh0.02.92.40.10.9
Uttarakhand0.11.50.70.2
West Bengal0.20.60.40.51.1

Note: 95% CIs for NFHS rates are available in the appendix.

Comparison over time: Trends from 2014 to 2018 show that the difference in birth rates between HMIS and SRS remained consistent over time (Fig. 2). For neonatal, post neonatal and child mortality rates, HMIS and SRS rates seem to converge with time, for most states including Tamil Nadu, Uttarakhand, West Bengal, Himachal Pradesh, Bihar, Rajasthan, and Punjab (Fig. 2). This shows that while there continues to be discordance in mortality data in 2018, the parity in reporting between HMIS and SRS has improved over time. Uttar Pradesh is an exception here. The figures also show increases in child mortality in some states according to the SRS(Drèze et al., 2020). Correlation between SRS and HMIS on birth rates was high in both 2014 and 2018 (Fig. 1 (a) and (b)). Poor correlation was observed between all the three data sources for the mortality indicators in 2014. However, this correlation improved by 2018. Between SRS and HMIS comparison, correlation for neonatal mortality improved from −0.13 in 2014 to 0.27 in 2018, -0.33 to 0.44 for post-neonatal mortality, and −0.22 to 0.36 for age specific mortality rates between 2014 and 2018, respectively (Fig. 1(a) and (b)). Importantly, HMIS provides birth and mortality estimates for states such as those in the north-east, for which estimates from the SRS are not available. HMIS also provides information on mortality for recent years. Estimates for mortality rates up to 2020 can already be calculated from the HMIS (Fig. 2b and c).
Fig. 2

Trends over time: Comparing SRS and HMIS for all indicators between 2014 and 20.

Fig. 1a

Correlation plot of all indicators across states in 2014 and 2018 between HMIS, NFHS and SRS

*Birth Rates not available for NFHS

Birth Rates, Neonatal Mortality Rate, Post-Neonatal Mortality Rate, Child Mortality Rate (0–4), Child Mortality Rate (1–4).

Fig. 1b

Correlation plot of all indicators across states in 2018 between HMIS and SRS.

Correlation plot of all indicators across states in 2014 and 2018 between HMIS, NFHS and SRS *Birth Rates not available for NFHS Birth Rates, Neonatal Mortality Rate, Post-Neonatal Mortality Rate, Child Mortality Rate (0–4), Child Mortality Rate (1–4). Correlation plot of all indicators across states in 2018 between HMIS and SRS. Trends over time: Comparing SRS and HMIS for all indicators between 2014 and 20. Institutional births: Differences between the number of institutional births in SRS and HMIS seemed to be closing over time, moving from 6,193,934 to 2,009,351 births from 2014 to 2018 (Table 3a). Similar trends were observed for comparisons with NFHS. Thus, in 2018, the total number of institutional births recorded in the HMIS is very close to the estimated number of institutional births in the SRS (Table 3b).
Table 3a

State-wise comparison of estimates of live and institutional births, 2014


2014
StateHMIS Live BirthsHMIS Institutional BirthsNFHSInstitutional BirthsSRSInstitutional Births
India20,801,01014,187,20721,030,22220,381,141
A & N Islands5,295
Andhra Pradesh513,180271,962776,821792,692
Arunachal Pradesh16,0305,614
Assam610,021499,193526,963553,311
Bihar2,024,498461,8291,940,2821,799,682
Chandigarh25,933
Chhattisgarh504,307315,652439,238444,187
Dadra & Nagar Haveli7,4157,321
Daman & Diu3,7823,729
Delhi255,926241,646238,413268,360
Goa17,26817,454
Gujarat1,162,2611,117,2401,161,6241,162,901
Haryana509,116435,437474,718443,806
Himachal Pradesh93,22576,80588,37184,066
Jammu & Kashmir192,726123,869186,310
Jharkhand646,624455,116527,879460,473
Karnataka886,369877,928
Kerala498,114495,522485,208483,752
Lakshadweep648
Madhya Pradesh1,357,117832,3731,593,1701,522,149
Maharashtra1,748,2941,714,5031,713,5461,792,633
Manipur41,62428,390
Meghalaya84,25837,480
Mizoram21,68914,515
Nagaland22,23612,660
Odisha704,932418,083698,874634,742
Puducherry41,09742,831
Punjab408,614371,250405,326371,693
Rajasthan1,428,4501,347,4161,519,7381,516,204
Sikkim7,8254,442
Tamil Nadu982,891986,1251,115,7981,070,715
Telangana433,321144,792606,804578,699
Tripura51,64917,929
Uttar Pradesh3,602,8561,386,4953,937,7603,449,700
Uttarakhand157,295108,200139,087127,810
West Bengal1,434,1651,183,8741,120,7531,175,353

Note: 95% CIs for NFHS rates are available in the appendix.

State-wise comparison of estimates of live and institutional births, 2014 Note: 95% CIs for NFHS rates are available in the appendix. State-wise comparison of estimates of live and institutional births, 2018 Note: 95% CIs for NFHS rates are available in the appendix.

Discussion

Our study has several important findings. We provide what is to the best of our knowledge, the first systematic estimates of vital statistics indicators from HMIS data in an LMIC at national and state levels, over a four-year period. Second, we compare these estimates with those from two publicly available, nationally representative surveys in India, at national and state levels – the NFHS and SRS, to systematically consider the possibility of using such administrative datasets for population health analysis in India and other LMICs, where civil registration remains incomplete and delayed. We find that while the Indian HMIS is performing relatively well on birth indicators for most states, and has been improving across states in infant and child mortality estimates over time, there is still considerable room to further improve reporting in the HMIS. State level analysis reveals that nationally and at state levels, while the HMIS under-estimates birth and death rates in India, the degree of under-estimation is much less for births compared to deaths. Additionally, for a small number of states, HMIS captures similar mortality levels as the SRS and the NFHS. Nationally and at state level, HMIS provides better concordance with institutional births from SRS and NFHS (Table 2). We also find variation between states, with some states such as Kerala and Himachal Pradesh having higher coverage in the HMIS than others (Table 2). These states are also among the better performing states on other national health indicators (Government of India, 2021). Based on time trends from 2014 to 2018 birth estimates from HMIS and SRS (the two datasets for which data are available for this period), have shown high concordance which has remained consistent over time, with the exception of Uttar Pradesh in north India. This is especially true of institutional births. Trends on institutional births are especially important to underscore, since HMIS as an administrative dataset, primarily captures facility level births and deaths (Government of India, 2021). For births, HMIS also includes data reported by community health workers (Government of India, 2021). While all infant and child mortality estimates from HMIS and SRS continued to be discordant in the same period, the gap in estimates seems to have reduced over time (Fig. 2). It is important to underscore that the three datasets we compare have very differing objectives, scope of representation and sampling techniques. While the HMIS is a collation of facility level counts of outcomes and service variables and therefore does not involve any sampling, the other two sources are nationally representative surveys. The NFHS is conducted every 5 years, is part of the Demographic Health Surveys, which are nationally representative household surveys on common health and societal indicators across births, deaths, nutrition, maternal and child health, among others, across many countries. It is based on multi-stage sampling design, in which villages or urban blocks are sampled based on decennial censuses. Households are then randomly selected within villages. The SRS, on the other hand, is a survey focused on annual, nationally representative estimates of vital statistics. It follows a sampling strategy similar to NFHS, except that it covers all households within a village. Our analysis reveals some potential strengths of HMIS. HMIS unit-level data are available publicly, unlike the SRS, and even the CRS. As a high frequency dataset that is updated monthly on most indicators, the HMIS is timelier, compared to SRS, an annual survey, the last publicly released estimates for which are for 2018; and the 2015–16 iteration of NFHS, a five yearly survey. Furthermore, HMIS provides facility level counts for all states and Union Territories of India. While iterations of the NFHS before 2015–16 were representative at the state and national levels, in 2015–16, for the first time, the NFHS was also representative at the district level. The SRS, also a survey, omits smaller states, including states in the north-east, but is representative at the state level for the larger Indian states. However, HMIS has many limitations which are important to underscore. First, as this analysis elucidates, in addition to the inconsistencies in definitions of indicators in HMIS over time, levels of births and deaths are underestimated in HMIS. Furthermore, given that HMIS relies largely on facility level reporting, reporting discrepancies could be conflated with actual change in indicator values. While we focus on states, analysis at more granular levels, particularly assessments of time trends should be wary of administrative changes in district boundaries and the making of new districts. For example, in Uttar Pradesh state, Shamli spilt from Muzaffarnagar in 2012 and was included in HMIS as an independent district only from 2014. Third, given the discordance in counts between HMIS, SRS and NFHS, for the mortality indicators even in 2018, for now, HMIS might be useful to study trends in select states. Importantly, in a comparison of datasets of this nature, it is important to acknowledge that transparency in sampling methods is desirable. Of the available sources, NFHS provides the most detail about its sampling strategy and design, as well as ease of use and accessibility of the data (International Institute for Population Sciences & ICF, 2017). It is also desired in SRS which despite being considered a standard source of demographic data in India, does not make its raw data available for analysis and interpretation (Mahapatra, 2017). More transparency in its sampling methods as well as estimation strategy for confidence interval estimates would be helpful. Our analysis lends itself to some key policy implications. Since we find the degree of underreporting in HMIS is lower for births compared to deaths, HMIS is probably able to better capture births and incidents around births, compared to deaths. This could be due to poor reporting of deaths in health facilities, and/or inadequate capturing of death related data under HMIS. Thus, first, there is a need for facilities to better monitor and document deaths and events around deaths. Second, HMIS infrastructure needs to be augmented to better capture death related data more robustly. Importantly, we find that trends in reporting of births and deaths under HMIS have improved with time for some states but lagged for others. This demonstrates that while there may be important limitations in HMIS, it is possible to invest in infrastructure, training, and monitoring to improve data collection around deaths in HMIS. Exemplar states that have improved their reporting of deaths under HMIS over the years, should be studied as case studies, to see if their practices can be replicated in other states. Furthermore, if the mandate of HMIS could be expanded to include individual level data on key socioeconomic variables from facility level data, population health metrics could be monitored from an equity perspective and similarly targeted in policy. Thus, HMIS has the potential to develop into a data source to improve our understanding of patterns of inequities in births and deaths reporting in India, in a relatively timely manner. Finally, despite its limitations, our analysis shows that given the wide geographic coverage and relative timeliness of HMIS reporting compared to periodical national surveys, HMIS could be utilized for pragmatic, real time policy monitoring and decisions, provided it is used after accounting for important limitations highlighted in this paper. We saw a fleeting exemplification of this to some extent, around the COVID-19 outbreak in India in 2021, when HMIS data were increasingly used by journalists and practitioners to report on trends in deaths (Rukmini S, 2020). Our analysis has important limitations. First, we use estimated population numbers, as reported by the USAID/DHS. To our knowledge, these are the only estimates of age-specific annual population counts for each of India's states. Second, since HMIS data are aggregated from facility level counts of births and deaths, with no information on individual socioeconomic or demographic characteristics of patients, we are unable to do more granular analyses of trends in births and deaths across important social strata, or explore trends in how HMIS captures different social groups compared to national surveys. Third, as noted previously, since HMIS comprises of facility level births and deaths, births and deaths that occurred outside of facilities are not captured in the dataset, leading us to hypothesize that HMIS underestimates national births and deaths. Fourth, we note that our HMIS estimates are case-fatality rates, where the denominators are HMIS births, rather than total births. If total births are used as the denominator, the HMIS under-reporting would be even more severe. However, given that the HMIS does not under-estimate births considerably, this should not affect our conclusions. We also note other limitations of HMIS data. For instance, HMIS counts can change, especially if data-entry is delayed. Similarly, we have not used civil registration estimates, because for our purposes, it does not serve as a useful comparison. This is because civil registration data in India themselves may under-report mortality, and the extant literature already provides estimates of coverage in the CRS (Rao & Gupta, 2020). Finally, we are also unable to provide confidence intervals (CIs) for the SRS since CIs that account for clustering of observations within primary sampling units are not currently available from the SRS. Our study also has several strengths. We provide the first analytic assessment of HMIS as a source to estimate timely population health data, by using it to estimate national and state level birth and mortality indicators over time. In comparing these to two commonly used national level population health surveys in India, we elucidate that while HMIS underestimates births and deaths data compared to surveys, as may be expected from a database which collates largely facility reported data to the exclusion of home births and deaths, this underestimation is much less in the case of vital birth statistics data. Future research should also study whether state reporting trends for births and mortality indicators in HMIS seen in this study, are reflected in other outcomes, particularly health service-related variables. Extending this analysis to include additional years, particularly years after the COVID-19 pandemic, would also be valuable. In strengthening the HMIS, learning from better performing states and capturing non-institutional demographic events may also be a priority. The HMIS could also be augmented by making available more information on the characteristics of births and deaths at the individual level, to better understand service access and disparities thereof. Ultimately, given that the HMIS records data from health facilities, improving access to health, especially after birth, and encouraging record keeping of deaths in health facilities may be the most important tools to help the HMIS become a continuous mortality surveillance tool.

Conclusion

While Indian HMIS is performing relatively well on birth indicators for most states, and has been improving across states in infant and child mortality estimates over time, there is still room to further improve reporting in the HMIS. Without due intervention, the HMIS cannot serve as a robust monitoring tool for routine public health statistics. However, with some diligence in accounting for its limitations, HMIS can still provide signals for real time policy analysis, especially in case of shocks or outbreak events, when regularly updated administrative data can provide important insights about deviations from routine trends. With efforts to address the limitations of HMIS underlined in previous sections, the administrative dataset can emerge as a treasure trove of publicly available, real-time data to understand population level vital statistics in a timely manner in India. As initial steps towards this overhaul, future research should examine why the HMIS performs relatively better in some states over others, and pilot interventions to improve the coverage of the HMIS in underperforming states. Finally, expanding HMIS data to include key socioeconomic variables at individual or aggregated levels from facility data could allow for more policy relevant comparisons of birth and mortality trends across social groups in India.

Funding source

None.

Author statement

Conceptualization and Design: PC, AG, SVS. Data Acquisition and Analysis: PC, AG. Data Interpretation: PC, AG, SVS. Drafting of the Manuscript: PC, AG. Critical revisions to Manuscript: PC, AG, SVS. Overall Supervision: SVS.

Declaration of competing interest

None.

2014
2018
IndicatorHMISNFHSSRSHMISSRS
Live births20,801,01025,963,23720,666,30725,936,681
Institutional Births14,187,20721,030,22220,381,14119,388,41121,397,762
Neonatal deaths90,539751,974675,044177,082596,544
Post neonatal deaths36,511265,823337,52269,176233,430
Infant deaths127,0501,017,7961,012,566246,258829,974
Child deaths (0–4)142,3541,132,6881,295,253281,5541,050,149
Child deaths (1–4)15,304114,892282,68735,296220,175
  16 in total

1.  The COVID-19 Pandemic: Effects on Civil Registration of Births and Deaths and on Availability and Utility of Vital Events Data.

Authors:  Carla AbouZahr; Martin W Bratschi; Emily Cercone; Anushka Mangharam; Don de Savigny; Irina Dincu; Anette Bayer Forsingdal; Olga Joos; Montasser Kamal; Doris Ma Fat; Gloria Mathenge; Fatima Marinho; Raj Gautam Mitra; Jeff Montgomery; William Muhwava; Remy Mwamba; James Mwanza; Alvin Onaka; Tanja Brøndsted Sejersen; Maletela Tuoane-Nkhasi; Lynn Sferrazza; Philip Setel
Journal:  Am J Public Health       Date:  2021-04-15       Impact factor: 9.308

2.  Comparability of Mortality Estimates from Social Surveys and Vital Statistics Data in the United States.

Authors:  Dustin C Brown; Joseph T Lariscy; Lucie Kalousová
Journal:  Popul Res Policy Rev       Date:  2018-12-15

3.  Trends in Education-Specific Life Expectancy, Data Quality, and Shifting Education Distributions: A Note on Recent Research.

Authors:  Arun S Hendi
Journal:  Demography       Date:  2017-06

4.  COVID mortality in India: National survey data and health facility deaths.

Authors:  Prabhat Jha; Yashwant Deshmukh; Chinmay Tumbe; Wilson Suraweera; Aditi Bhowmick; Sankalp Sharma; Paul Novosad; Sze Hang Fu; Leslie Newcombe; Hellen Gelband; Patrick Brown
Journal:  Science       Date:  2022-01-06       Impact factor: 47.728

5.  Assessment of health management information system for monitoring of maternal health in Jaleswar Block of Balasore District, Odisha, India.

Authors:  Ranjit Kumar Dehury; Suhita Chopra Chatterjee
Journal:  Indian J Public Health       Date:  2018 Oct-Dec

6.  Evaluation of computerized health management information system for primary health care in rural India.

Authors:  Anand Krishnan; Baridalyne Nongkynrih; Kapil Yadav; Satyavir Singh; Vivek Gupta
Journal:  BMC Health Serv Res       Date:  2010-11-16       Impact factor: 2.655

7.  Quality of Health Management Information System for Maternal & Child Health Care in Haryana State, India.

Authors:  Atul Sharma; Saroj Kumar Rana; Shankar Prinja; Rajesh Kumar
Journal:  PLoS One       Date:  2016-02-12       Impact factor: 3.240

8.  Temporal Analysis of Infant and Child Health Indicators from Health Management and Information System of a Vulnerable District of India: Tracking the Road toward the Sustainable Development Goal-3.

Authors:  Rekha Dutt; Monalisha Sahu
Journal:  Indian J Community Med       Date:  2019 Oct-Dec

9.  Health management information system (HMIS) data verification: A case study in four districts in Rwanda.

Authors:  Alphonse Nshimyiryo; Catherine M Kirk; Sara M Sauer; Emmanuel Ntawuyirusha; Andrew Muhire; Felix Sayinzoga; Bethany Hedt-Gauthier
Journal:  PLoS One       Date:  2020-07-17       Impact factor: 3.240

10.  The civil registration system is a potentially viable data source for reliable subnational mortality measurement in India.

Authors:  Chalapati Rao; Mamta Gupta
Journal:  BMJ Glob Health       Date:  2020-08
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.