The burden of misclassification of antepartum stillbirth in Nepal.

BACKGROUND: Globally, every year 1.1 million antepartum stillbirths occur with 98% of these deaths taking place in countries where the health system is poor. In this paper we examine the burden of misclassification of antepartum stillbirth in hospitals of Nepal and factors associated with misclassification.
METHOD: A prospective observational study was conducted in 12 hospitals of Nepal for a period of 6 months. If fetal heart sounds (FHS) were detected at admission and during the intrapartum period, the antepartum stillbirth (fetal death ≥22 weeks prior labour) recorded in patient's case note was recategorised as misclassified antepartum stillbirth. We further compared sociodemographic, obstetric and neonatal characteristics of misclassified and correctly classified antepartum stillbirths using bivariate and multivariate analysis. RESULT: A total of 41 061 women were enrolled in the study and 39 562 of the participants' FHS were taken at admission. Of the total participants whose FHS were taken at admission, 94.8% had normal FHS, 4.7% had abnormal FHS and 0.6% had no FHS at admission. Of the total 119 recorded antepartum stillbirths, 29 (24.4%) had FHS at admission and during labour and therefore categorised as misclassified antepartum stillbirths. Multivariate analysis performed to adjust the risk of association revealed that complications during pregnancy resulted in a threefold risk of misclassification (adjusted OR-3.35, 95% CI 1.95 to 5.76).
CONCLUSION: Almost 25% of the recorded antepartum stillbirths were misclassified. Improving quality of data is crucial to improving accountability and quality of care. As the interventions to reduce antepartum stillbirth differ, accurate measurement of antepartum stillbirth is critical. TRIAL REGISTRATION NUMBER: ISRCTN30829654. © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

The trackers of Global Burden of Disease, WHO and International Health Metric and Evaluation, do not measure and monitor antepartum stillbirth, despite the fact that an estimated 1.1 million occur annually. Granular data on antepartum stillbirth is lacking.

Examining the true burden of antepartum stillbirth is important to track quality of antenatal care.

We used an algorithm of assess the misclassification of antepartum stillbirth in hospitals of Nepal.

Almost one fourth of the antepartum stillbirths were found to be misclassified. Complications during pregnancy increased the risk of misclassification.

As the interventions to reduce antepartum stillbirth differ, accurate measurement of antepartum stillbirth is critical.

Poor recording of antepartum stillbirth in medical records is common and may reflect a devaluing of clinical records, misinterpretation of clinical data or misunderstanding of terminology or protecting themselves when complication have occurred during labour.

Introduction

In 2015, an estimated 2.6 million stillbirths occurred worldwide, representing a 47.0% decrease from estimates of 4.0 million in 1990.1 Globally, data suggest that 49.1% of these stillbirths occur during the antepartum period, that is, before the start of the labour1 (antepartum stillbirth). Efforts to reduce the burden of antepartum stillbirths include high quality pregnancy care and management of high-risk pregnancies, potentially including continuous monitoring in a hospital setting. In high income settings with quality intrapartum care, antepartum stillbirths estimate to account for ninety percent of the stillbirths.1 The average annual rate of reduction of stillbirths varies by region, countries and health system settings.2 The global annual rate of reduction of stillbirth was 1.9% between 1990 and 2015, a decline which was well behind rates of reduction of maternal or under-five mortality.1

To accelerate the reduction in stillbirths globally, the World Health Assembly in 2014 initiated Every Newborn Action Plan (ENAP). 194 countries committed to reduce stillbirth rates, with a target of 12 or less per 1000 births in all countries by 2030.3 4 Among the five strategies placed forward to reduce and track deaths, improving data accountability was highlighted.3

The ENAP measurement improvement roadmap (2015–2020) outlined the tools to be developed to improve data accountability at each tier of the health system.5 The roadmap provided guidance to strengthen routine health information systems, crosslinking these data with civil registration and vital statistics (CRVS).5 A set of 10 core indicators was proposed to track the progress in birth outcome (maternal mortality ratio, stillbirth rate, neonatal mortality rate) as well as coverage of care (including skilled attendance at birth, early postnatal care, essential newborn care, antenatal corticosteroids, neonatal resuscitation, kangaroo mother care, treatment of severe neonatal infection) through the routine information system.5 The coverage of care indicators is currently being validated through a multicountry study.6 Measurement of stillbirth and neonatal mortality rates in CRVS, health survey and routine health information systems was designated as a priority action for change in the ENAP measurement roadmap. This action would require recording of stillbirths in the hospital register, tracking and compiling these data in the hospital periodic reports and reported them in the national Health Management Information System. The ENAP measurement roadmap did not outline reporting of antepartum stillbirths. Key data gaps have been identified in the process of estimating the global burden of stillbirth. Notably, countries that have highest burden of stillbirth have poor vital registration systems to track both stillbirth and neonatal deaths.7–9

Despite limitations of poor data measurement systems, there has been remarkable changes in healthcare seeking.10 The past two decades have seen a fourfold increase in rates of health facility delivery, resulting in more than two-thirds of deaths now occurring in these facilities.11 Improving documentation of these births and deaths will be key to evaluating progress in care and outcomes.7 12 In this paper, we examined the burden of misclassification of antepartum stillbirth in low resource healthcare settings in Nepal, and factors associated with misclassification.

Methods

We performed a prospective observational study nested within a randomised control trial in 12 public hospitals of Nepal to evaluate the scaling up of a neonatal resuscitation Quality Improvement Cycle.13 For this study, we used data from the baseline period of 6 months (January to July 2017) prior to the implementation. The study has been reported as per the guidelines for Strengthening the Reporting of Observational Studies in Epidemiology.14 15

All 12 hospitals were referral level hospitals and provided Comprehensive Emergency Obstetric and Neonatal Care Services16 17 (parental antibiotics, parental uterotonic drugs, parenteral anticonvulsants for pre-eclampsia and eclampsia (ie, magnesium sulfate), manual removal of placenta, removal of retained products, assisted vaginal delivery, basic neonatal resuscitation, caesarean section and blood transfusion).

The hospitals had two different units for providing delivery and immediate newborn care service. In the labour unit, spontaneous and assisted vaginal delivery were attended by nurse-midwives. In these units, information on the delivery care and maternal and neonatal outcomes were recorded in an obstetric register and medical records. The fetal heart rate monitoring was performed using stethoscope or pinard fetal heart rate monitor. Hospital standards included all pregnant women admitted in the hospital to have fetal heart sounds (FHS) checked at the time of admission and monitoring of FHS every half an hour during labour. In the operation theatre, caesarean sections were performed by obstetricians with resuscitation provided by medical doctors and nursing staff. Maternal and neonatal outcomes were recorded in the operation theatre register and medical records.

Patient and public involvement

This research question aims to assess the burden of misclassification was based on the patient’s experience on stillbirth. The improved care and monitoring for high risk mother will reduce stillbirth. The results of the study will be disseminated to the study participants through local and national news media.

Eligibility criteria for enrolment included women with pregnancy of 22 weeks or more who were admitted in the hospital and consented to participation. Exclusion criteria women whose FHS was not measured at the time of admission.

​Data collection and management

Independent data collectors were placed in each hospital throughout the study period to collect demographic, obstetric and neonatal information. A data quality coordinator was placed in each hospital to ensure the quality of data collection. The independent data collectors were trained on how to collect data and adhere to standard research protocol. The women who were admitted in the hospital were assessed by the health worker for eligibility to take part in the study. Informed consent was obtained for enrolment in the study. Interviews were conducted with women before discharge from the hospital to assess the demographic characteristics such as education and parity (online supplementary file 1). Extraction of the obstetric and neonatal data were completed from the patient case note after discharge from the hospital (online supplementary file 2). Data extraction sheets and interviews were reviewed by the coordinator daily to assure quality. At the end of each week, the filled forms were sealed in an opaque envelop and sent to central office in Kathmandu, Nepal. In the central office, the data entry officers reviewed each form for data completeness and coded the open-ended responses. The data entry officers then entered the data in the Census and Survey Processing System (CS-PRO) database. The data manager conducted weekly data cleaning in the CS-PRO database and transferred the data in SPSS V.23.0 each week in a secured server. After the completion of study, all data were extracted for data analysis.

For this study, the following variables of interest were extracted from the baseline database.

Obstetric complications during antepartum period 18—Complications that a woman had during the intrapartum period including:

Hypertensive disorder: classified by maternal diastolic blood pressure greater than or equal to 90 mm Hg in two separate recordings.

Antepartum haemorrhage: vaginal bleeding before onset of labour.

Infection: clinical signs of infection.

Multiple gestation-more than one pregnancy.

FHS at admission: presence of FHS by auscultation at admission, categorised as normal (>110 and <160 beats per minute), abnormal (<110 or >160 beats per minute), absent or not recorded.

FHS during labour: FHS during labour, categorised as normal (>110 and <160 beats per minute), abnormal FHS (<110 or >160 beats per minute), absent or not recorded.

Gestational age: estimated from the last menstrual period in weeks. The variable was categorised into preterm (<37 weeks) and term (≥37 weeks) gestation.

Birth weight: weight of the baby was taken on an analogue scale within 1 hour after birth. The variable was categorised into low birth weight (<2500 g) and normal birth weight (≥2500 g).

Stillbirth: delivery of a fetus occurring after 22 weeks of gestation or with a birth weight more than 500 g that never breathed spontaneously after birth or after 10 min of resuscitation.

True antepartum stillbirth: delivery of a fetus occurring after 22 weeks of gestation or with a birth weight more than 500 g, who had no FHS at admission and no FHS present at labour. Since, absence of FHS at admission does not necessarily mean antepartum stillbirth, as the women might not be in labour. So, absence of FHS both at admission and during labour has been defined as antepartum stillbirth.

Misclassified antepartum stillbirth: if the fetus was documented as an antepartum stillbirth in the patient case note who had FHS at admission and during labour, we categorised it as a misclassified antepartum stillbirth.

​Birth outcome

Sociodemographic variables

Mother’s age was categorised as 15–19 years, 20–34 years and ≥35 years. Maternal education was categorised as no education and primary education or more for those who had no formal education and formal education, respectively. Ethnicity was categorised as disadvantageous group (Dalit, Janjati and Muslim) and relatively advantageous group (Madhesi, Chettri/Brahmin and other castes) based on hierarchical caste system of Nepal.19

​Data analysis

Among cases documented as antenatal stillbirth in the patient case note, we analysed the presence of FHS at admission and FHS during labour. We built three different flow diagrams based on the FHS at admission, FHS during labour and birth outcome (figures 1–3). We compared the background characteristics (demographic, obstetric and neonatal) among misclassified antepartum stillbirths and true antepartum stillbirth. We assessed the risk factors for misclassification by comparing the obstetric characteristics (obstetric complication during antepartum period, gestational age, multiple gestation, birth weight) in the cohort of misclassified antepartum stillbirths with the cohort of true antepartum stillbirths. A Pearson χ2 test was utilised if the number of cases was more than five and Fischer’s exact test if the number of cases was five or less. Obstetric characteristics which showed association were then considered for bivariate and multivariate logistic regression. Variables with more than 10% missing values were excluded from the analysis.

Results

Among the 41 061 women who were enrolled in the study, 39 562 had FHS taken at admission. Of the total participants whose FHS was taken at admission, 37 481 (94.8%) had normal FHS, 1845 (4.7%) had abnormal FHS and 233 (0.6%) had no FHS at admission. Among the 37 481 women who had normal FHS at admission, 62 (0.2%) were diagnosed as antepartum stillbirth in the patient case note while 44 of the 1845 (2.2%) women who had abnormal FHS at admission were diagnosed as antepartum stillbirth. Among the 233 women who had absent FHS at admission, only 16 (6.9%) were diagnosed as antepartum stillbirth in the patient case note, with a total of 119 documented antenatal stillbirths in the cohort of 39 562 (figure 4).

Figure 4

Participant flow figure. FHS, fetal heart sounds.

Among the women who had normal FHS at admission and normal FHS during labour (N-32 229), 20 of the birth were recorded antepartum stillbirth. Among the women who had normal FHS at admission and abnormal FHS during labour (N-5217), seven of the birth were recorded antepartum stillbirth (figure 1). Among the women who had abnormal FHS at admission and abnormal FHS during labour (N-558), two of the births were recorded as antepartum stillbirth (figure 2). Based on our operational definition of misclassified antepartum stillbirth, these 29 antepartum stillbirths who had FHS at admission and during labour was categorised as misclassified, which accounted 24.4% of the 119 recorded antepartum stillbirths (figures 1–3).

Figure 1

Birth outcome among babies who had normal fetal heart sounds (FHS) at admission.

Figure 2

Birth outcome among babies who had abnormal fetal heart sounds (FHS) at admission.

Among the remaining 90 recorded antepartum stillbirths, 35 of them had normal FHS at admission and absent FHS before birth (figure 1), 39 of them had abnormal FHS at admission and absent FHS during labour (figure 2) and 16 of them had absent FHS at admission and absent FHS during labour (figure 3). Based on the operational definition, these were categorised as correctly classified antepartum stillbirths.

Figure 3

Birth outcome among women who had no fetal heart sounds (FHS) at admission.

We compared the sociodemographic, obstetric and neonatal characteristics between the misclassified (N-29) and correctly classified antepartum stillbirths (N-90). We found that complications during pregnancy were more common among misclassified antepartum stillbirth than true antepartum stillbirth (27.6% vs 8.9%, p value-0.01). The proportion of low birthweight babies were higher among the misclassified antepartum stillbirths than true antepartum stillbirth (31.0% vs 11.1%, p value-0.01). There was no difference in other sociodemographic (education and ethnicity), obstetric (parity, antenatal care (ANC) check-up and delivery preparation) and neonatal characteristics (preterm birth and sex) (table 1).

Table 1

Background characteristics of misclassified and true antepartum stillbirth

	Misclassified antepartum stillbirth (N-29)	True antepartum stillbirth (N-90)	Total (N-119)	P value
Formal education
Formal education	1 (3.4%)	7 (7.8%)	8 (6.7%)
No formal education	28 (96.6%)	83 (92.2%)	111 (93.3%)	0.678*
Ethnicity
Advantaged group	17 (58.6%)	38 (42.2%)	55 (46.2%)
Disadvantaged group	12 (41.4%)	52 (57.8%)	64 (53.8%)	0.123†
Parity
Nullipara	12 (41.4%)	37 (41.1%)	49 (41.2%)
Primi	5 (17.2%)	29 (32.2%)	34 (28.6%)
Multipara	12 (41.4%)	24 (26.7%)	36 (30.3%)
Antenatal care (ANC)
At least one ANC	1 (3.4%)	7 (7.8%)	8 (6.7%)
No ANC	28 (96.6%)	83 (92.2%)	111 (93.3%)	0.678*
Delivery preparations
Yes	1 (3.4%)	7 (7.8%)	8 (6.7%)
No	28 (96.6%)	83 (92.2%)	111 (93.3%)	0.678*
Complication during pregnancy
No	21 (72.4%)	82 (91.1%)	103 (86.6%)
Yes	8 (27.6%)	8 (8.9%)	16 (13.4%)	0.01†
Low birth weight
2500 g or more	20 (69.0%)	80 (88.9%)	100 (84.0%)
Less than 2500 g	9 (31.0%)	10 (11.1%)	19 (16.0%)	0.01†
Preterm
37 week or more	22 (75.9%)	79 (87.8%)	101 (84.9%)
Less than 37 weeks	7 (24.1%)	11 (12.2%)	18 (15.1%)	0.119†
Sex
Boy	14 (48.3%)	44 (48.9%)	58 (48.7%)
Girl	15 (51.7%)	46 (51.1%)	61 (51.3%)	0.954†

*Fischer’s exact test.

†Pearson’s χ2 test.

We performed a multivariate analysis to adjust the risk of association between the complication during pregnancy and low birthweight babies. After the multivariate analysis, complication during pregnancy had threefold-risk of misclassification (aOR-3.35, 95% CI 1.95 to 5.76) but there was no significant association between low birth weight and misclassification (aOR-0.97, 95% CI 0.59 to 1.60) (table 2).

Table 2

Multivariate analysis on the risk factor for misclassification

	Misclassified antepartum stillbirth		Total	P value	cOR (95% CI)	aOR (95% CI)*
	Yes (N-29)	No (N-90)	Total (N-119)
Complication during pregnancy
No	21 (72.4%)	82 (91.1%)	103 (86.6%)
Yes	8 (27.6%)	8 (8.9%)	16 (13.4%)	<0.001	3.33 (1.96 to 5.65)	3.35 (1.95 to 5.76)
Low birth weight
2500 g or more	20 (69.0%)	80 (88.9%)	100 (84.0%)
Less than 2500 g	9 (31.0%)	10 (11.1%)	19 (16.0%)	0.627	1.13 (0.69 to 1.85)	0.97 (0.59 to 1.60)

*Adjusted for complication during pregnancy and low birth weight.

aOR, adjusted OR; cOR, crude OR.

Discussion

Almost 25% of recorded antepartum stillbirths in public hospitals in Nepal were misclassified antepartum stillbirth. The proportion of low birth weight was higher among the misclassified antepartum stillbirths compared with true antepartum stillbirths, but the association failed to meet significance in the multivariate analysis. Neither was there any significant difference in sociodemographic (education and ethnicity), obstetric (parity, ANC check-up and delivery preparation) and neonatal characteristics (preterm birth and sex). Complications during pregnancy were, however, three times more common among misclassified than among true antepartum stillbirths.

​Methodological consideration

The study conducted rigorous surveillance to collect data on the demographic, obstetric and neonatal characteristics of the women who participated in the study. One of the major strengths of this study is inclusion of large sample from 12 public hospitals located in different geographical locations in Nepal. Further, another strength of this study is inclusion of all in-born babies and stillbirths.

However, we acknowledge limitations in the study. First, there was an independent data collection team stay and recorded the clinical events from the case notes. The presence of an independent team might have caused changes in routine care and recording as a Hawthrone effect.20 Second, the record of clinical events and birth outcomes was assessed from the patient case notes and data could have been missing. Third, we conducted an interview at the time of discharge to gather information regarding sociodemographic and antenatal care. Women’s responses to some of the questions, such as education and antenatal care, might not be reliable and result in biases. In addition, we were not able to interview all mothers enrolled in the study, which might have resulted in missing information. Fourth, we did not conduct an in-depth review of the underlying cause of misclassification and the value of the birth outcome. Fifth, the quality of the fetal heart rate monitoring might have been variable. Sixth, the quality of fetal heart rate measurement at admission and before birth might not have been of highest standard as evident from figure 3, wherein among the 136 women who had absent FHS at admission and before birth, 129 of them gave birth to a live born baby. Finally, since, the number of misclassified antepartum stillbirth was not adequate enough to show the association between low birth weight and misclassification there might be a type 2 error occurring with respect to the lack of association.

There are different reasons for a clinical staff for misclassification of antepartum stillbirth. First, lack of knowledge among clinical staffs on the standard definition of antepartum stillbirth. Second, clinical staff might misclassify intrapartum stillbirth as antepartum stillbirth to avoid the accountability of poor intrapartum care. Third, the clinical staff might not value identifying and recording true antepartum stillbirth.

Measurement of health process and outcome of women and children has social, political and contextual nature.21 Socially, measurement of any service is used by the general public to assess the quality of care. Politicians and policy maker may also use the same data measurement to showcases the change in service delivery. In the hospital context, it is used for quality improvement. Prioritising any measurement outcome of maternal and neonatal health in a hospital or health system depends on the governance of data and information by the leadership, health worker and healthcare recipient. A review of data quality in the National Health Service showed a lack of participation in the management and use of data is one of the key issues to resolve.22 The audit report cites that ‘the perception that hospital episode statistics cannot support the needs of the individual health workers results in mistrust and disinterest. This leads to a poor data generation and recording by health workers. This in turn leads to under-development of such data from a clinical perspective, and the cycle continues’.

The other critical underlying factor for poor data quality is lack of understanding among frontline staff of the reasons for, and benefits of, the information they are collecting. The information generated is not client centred for improving care.23

A randomised study in National Health Service to evaluate participation of physicians in improvement of data validity and use showed that the current measurement system on episode statistics, that is, mortality, is not fit to monitor the performance of individual physicians.24

An observational cross-sectional study was conducted in three hospitals in Afghanistan to validate the accuracy of health events and outcome in the patient case note. For the indicators of asphyxia, postpartum hemorrhage (PPH) and laceration, for which sensitivity was low, failing to accurately identify cases may have a detrimental effect on clinical decision making. This could potentially lead to an increase in the risk of adverse outcomes for resuscitated neonates or mothers because they miss follow-up observation and care indicated by these diagnoses. Specificity and proportion of cases correctly classified were generally higher in records taken from registers compared with those take from medical charts, while sensitivity was lower in the registers. This could be because the registers are generally used to record low-frequency events and clinicians may think it is more important to capture the occurrence of those events than their absence.25

Another study in Afghanistan showed the recording of information on obstetric events and outcomes in caesarean section was poor.26 A study conducted by Kim and colleagues on the quality of caesarean section documentation showed poor recording in the case notes which also lead to misclassification of clinical events, such as FHS and birth outcome including stillbirths.27

Our Nepal study from the same cohort has found that more than 45% of the intrapartum stillbirth were potentially misclassified who would have been a liveborn if resuscitated at birth.28

Conclusion

Almost 25% of recorded antepartum stillbirths in public hospitals in Nepal were misclassified antepartum stillbirth. Women who had complications during pregnancy were at increased risk of being misclassified antepartum stillbirth. Accurate classification of the timing of stillbirth is critical as strategies to prevent these outcomes would vary significantly. Improving fetal heart rate monitoring and its correct recording is crucial to reduce misclassification. With 10 years remaining for countries to report on their progress made in stillbirth rate reduction, high-quality routine information of antepartum stillbirth is an urgent need to track progress.