| Literature DB >> 34590144 |
Jef L Leroy1, Bastien Koch1, Shalini Roy1, Daniel Gilligan1, Marie Ruel1.
Abstract
BACKGROUND: Poor birth outcomes are an important global public health problem. Social assistance programs that provide cash or in-kind transfers, such as food or vouchers, hold potential to improve birth outcomes but the evidence on their effectiveness has not been reviewed.Entities:
Keywords: birth outcomes; lower birth weight; pregnancy; small-for-gestational age; social assistance; systematic review
Mesh:
Year: 2021 PMID: 34590144 PMCID: PMC8643580 DOI: 10.1093/jn/nxab292
Source DB: PubMed Journal: J Nutr ISSN: 0022-3166 Impact factor: 4.798
Characteristics of the studies evaluating the impact of social assistance on birth outcomes[1]
| Country, name of program, reference trial registration | Program objectives, eligibility and targeting, pregnancy focus | Program description[ | Evaluation design, sample characteristics, analysis | Implementation issues[ | Descriptive statistics and study impact[ | Concerns |
|---|---|---|---|---|---|---|
| India |
|
|
|
Goal of reaching poorest women only partly reached: odds of receiving cash tended to be higher for scheduled castes and tribes and other backward groups, but also for educated women, young women, and women in the 3 middle wealth quintiles. Lower uptake by poorest and least educated women partly explained by hard-to-reach populations, restricted access to health facilities, cultural barriers and financial incentives to deliver at home. Differential uptake by state partly due to variation in program awareness and access to infrastructure.
% of women receiving JSY payment ranged from 7% to 44% at the state level, but participation among those eligible not reported. No data on whether women who reported receipt of cash were, in fact, aware of the program or had been encouraged to deliver in a facility. |
BL: 42. 0Impact: matching: –3.7 (
BL: 33.6 Impact: matching: –2.3 ( (effect largest in non–high focus states)
BL: 45.7% Impact: matching: +10.7 pp (
BL: 41.0% Impact: matching: +43.5 pp (
BL: 48.7% Impact: matching: +36.6 pp ( |
Unobserved confounding due to nonexperimental nature of study cannot be ruled out. Reports show that some women may have been encouraged to use JSY (and thus incentivized to deliver in a health facility) but did not receive the transfer after in-facility delivery. They were, hence, incorrectly classified as comparison group (potential downward bias of treatment effect). Reverse causality cannot be excluded as women received cash because of an in-facility birth (and did not deliver there because of the cash), i.e., they were not aware of the incentive. It cannot be ruled out that the accuracy of the mortality reporting was systematic, i.e., related to program uptake. Potential underestimation of program effects due to financial incentive for home deliveries (more women might have delivered in an accredited facility in the absence of this incentive). |
| India |
| See above [Lim et al. 2010 ( |
|
No information provided.
JSY coverage by district ranged from <10% to >50%. |
BL: 31 Impact w/o covariates: coverage 10%–25% vs. <10%: NS; 25%–50% vs. <10%: NS; >50% vs. <10%: –3.1 ( With covariates: NS
BL: 15 Impact w/o covariates: coverage 10%–25% vs. <10%: NS; 25%–50% vs. <10%: NS; >50% vs. <10%: –2.0 (
BL: 39% - Impact w/o covariates: coverage >50% vs. <10%: +7.5 pp (
BL: 20% - Impact w/o covariates: coverage >50% vs. <10%: +11 pp (
BL: 46% - Impact w/o covariates: coverage >50% vs. <10%: +5.6 pp (
BL: 45% - Impact: NS
BL: 8.6% - Impact w/o covariates: coverage >50% vs. <10%: +0.7 pp ( |
Unobserved confounding due to nonexperimental nature of study cannot be ruled out. Coverage used as the Tx variable. Coverage defined as women who gave birth in a public facility & received JSY cash/all women who delivered in a public facility. If the program encouraged noneligible women to deliver in a health facility, the treatment variable would be attenuated. Only Tx defined in % coverage categories (<10%, 10%–25%, 25%–50%, >50%) results in significant impact findings. When treatment was defined as binary variable (more than 10% coverage) or as a continuous variable (proportion between 0 and 1), no significant impact was found. Coverage may be determined by factors (other than the actual program) that also determine mortality. It cannot be ruled out that the accuracy of the mortality reporting was systematic, i.e., related to program uptake. |
| Nepal |
|
|
|
Food and cash distribution were delayed during monsoons due to road access problems. Cash transfers were not delivered in October 2014 because of security concerns.
PLA group attendance: PLA only: 2 times (49% of pregnant women attended); PLA + food: 5 times (97% of pregnant women attended); PLA + cash: 4 times (94% of pregnant women attended) Food: 4 to 5 transfersCash: 4 to 5 transfersHome visits were limited and not conducted as planned. Women in food or cash arms enrolled earlier in pregnancy and had on average 1.5 mo longer to be exposed to groups than in the PLA-only arm. |
Nonbeneficiaries: 2756 g Impact: PLA only: NS; PLA + cash: NS; PLA + food: +78 g (
Nonbeneficiaries: 22.5% Impact: NS
Nonbeneficiaries: 2770 g Impact: PLA only: NS; PLA + cash: +69 g (P < 0.05); PLA + food: +72 g (
Nonbeneficiaries: 4.2 Impact: PLA only: NS, PLA + cash: +0.55 (
Nonbeneficiaries: 3.3 Impact: PLA only: NS; PLA + cash: +0.3 (
Nonbeneficiaries: 34.8% Impact: PLA only: NS, PLA + cash: NS, PLA + food: OR, 1.45 ( |
Trial disrupted due to ethnic conflict in field team leading to very low capture rates for many outcomes [e.g., only 22% of necessary BW (<72 h) assessments made], causing a drop in statistical power. Potential limited internal validity due to nonrandom attrition: women whose infants’ BW was captured were older, had more children, were more often Hindu, and had less education. Loss to follow-up appears similar across arms, but no formal analyses of differential attrition (and thus risk of selection bias) presented. Authors revised analysis plan and decided to drop certain outcomes (e.g., mortality) and to add new secondary outcomes. Lack of endpoint data for mortality prevented analysis of these outcomes. The finding that the BW effect was not sustained (as measured in the impact on WAZ at endpoint; child age 0 to 16 mo, mean: ∼9 mo) suggests that the intervention had no overall BW effect. Lack of WAZ effect may be due to endpoint data collection occurring during monsoon when levels of diarrheal disease and child underweight were high. |
| Mexico |
|
Government-implemented conditional cash transfer program. Cash transfer (∼USD 15/mo, irrespective of HH composition) conditional on participating in |
|
An estimated 1% of HHs were denied the cash transfer due to noncompliance.
97% of eligible HHs participated in program. Women in the sample participated in the program for 2.8 y before delivery, on average. |
Nonbeneficiaries: 3167 g Impact: RE: +127 g (
Nonbeneficiaries: 10.3% Impact: RE probit: –0.323 (log odds,
Nonbeneficiaries: 94.3% Impact: NS
Nonbeneficiaries: 74.2% Impact: NS
Nonbeneficiaries: 6.4 Impact: NS
Nonbeneficiary: 0.00 (by construction) Impact: RE: +0.36 SD ( |
BW based on maternal recall; recall time longer for control than for treatment, possibly introducing differential recall bias. Data analysis did not follow original randomized design: control births included from the 1997 start of the program to the time these control areas were enrolled in the program (1.5 y later, i.e., in 1999); treatment births from 1997 to 2003 in treatment areas. Differences in outcomes may thus be due to factors other than the treatment. Last birth was observed in 2003 survey included in study. This implies that, by design, control women had higher parity than in the treatment arm. This may have affected outcomes. |
| Mexico |
| See above [Barber & Gertler, 2008 ( |
Impact estimated for all municipalities and by pre-program NMR and other municipality characteristics. |
No information provided.
No information provided. |
Sample mean: 8.8 to 9.0 (depending on specification). Impact: main specification: NS; alternative specifications: -0.64 ( Effect by municipality characteristics: effect limited to municipalities with above-median NMR levels: –2.50 (
N/A |
Unobserved confounding due to nonexperimental nature of study cannot be ruled out Author states that program impact is potentially underestimated because of financial intervention for beneficiaries to report deaths (missing an obligatory health appointment would lead to not receiving cash). Reporting deaths could therefore be intervention with the program. It is unlikely, however, that this would affect the estimates for NMR, as children are expected to die before the birth has been registered. Even though controlled for in 1 of the models by adding it as a covariate, it remains unclear to what extent the expansion in health-care supply in treatment areas may be driving the results. |
| Colombia |
|
Large-scale, government-implemented conditional cash transfer program since 2001. Nutritional subsidy (USD 15.38/mo irrespective of HH composition) for families with child 0 to 6 y, conditional on meeting basic preventive health-care intervention; school subsidy (USD 4.61 to USD 9.23 depending on age) conditional on children attending school. |
|
No information provided.
No information provided. |
Rural: NS Urban: +578 g (
N/A |
Not clear how matching of municipalities was done. Analytic approach lacks detailed explanation. No robustness checks shown. Unobserved confounding due to nonexperimental nature of study cannot be ruled out. Size of the impact on BW biologically implausible since women were not severely undernourished prior to intervention. BW was obtained through self-report, introducing potential recall bias. Pregnant women only eligible if they had a child under 7 years of age. Impact estimates do not include first-born children. |
| Uruguay |
|
Cash transfers (∼$56 per month, irrespective of HH composition) and electronic food card introduced midway through program (valued at 25%–50% of the cash transfer depending on HH size and composition); conditionalities (health checks for pregnant women and children) not enforced. Additional program components: public works program, training and educational activities, medical checks (including ANC visits, surgery, dental care, etc.), home improvement materials, public utilities connectivity support, assistance for small businesses, and housing for homeless families. Enrollment started in April 2005; program ended December 2007. |
All models controlled for conception month and BL month. Sensitivity analysis includes additional covariates (newborn, maternal, and HH dwelling characteristics; geographic indicators) and estimates within a narrower range of the discontinuity threshold. |
Transfer conditionalities such as attending health check-ups de facto not enforced.Transfer for food (food card) not started until mid-2006.
97% of eligible households received cash transfers at some point during study period, yet only 63% during mother's pregnancy;80% of eligible households received food card at some point during study period, yet only 41% during mother's pregnancy. |
Impact: +31 g (
BL: 10.2% Impact: –1.9 pp to –2.5 pp (
BL: 38.5 wk Impact: NS
BL: 10.1% Impact: NS
BL: 8.48 (1 min), 9.60 (5 min) Impact: +0.09 (1 min,
BL: 6.5 Impact: NS
BL: 17.5 wk Impact: NS
BL: 77% Impact: +3.1 pp ( |
BW obtained from hospital records.Possible unobserved confounding due to nonexperimental nature of study. Impact estimated close to the threshold may not be generalizable to the entire eligible population. Some beneficiary households received additional program components (trainings, services, health care, etc.), i.e., program impact cannot be solely attributed to the cash transfer. Numerous robustness checks confirm results, suggesting high internal validity. |
Outcome definitions: perinatal mortality was defined as a stillbirth after 28 weeks of pregnancy or death of a child within the first week after a live birth; stillbirth was defined as a baby born with no signs of life at or after 28 weeks of gestation. Abbreviations used: ANC, antenatal care; BL, baseline; BW, birth weight; C, control; DLHS, District Level Health Survey; DID, difference-in-difference; FE, fixed effects; FU, follow-up; HH, household; ITT, intent-to-treat; JSY, Janani Suraksha Yojana; LAZ, length-for-age z-score; N/A, not applicable; NMR, neonatal mortality rate; NS, not significant; LBW, low birth weight; LBWSAT, Low Birth Weight in South Asia Trial; OLS, ordinary least squares; PANES, Plan de Atención Nacional a la Emergencia Social; PLA, participatory learning and action; pp, percentage point; RE, random effects; SISBEN, Sistema de Identificación de Potenciales Beneficiarios para Programas; Tx, treatment; WAZ, weight-for-age z-score.
Program components included to improve birth outcomes are underlined.
Implementation issues refer to any information reported by the authors on implementation fidelity, quality of service delivery, perceptions of users and implementers, workload, and so forth.
Exposure refers to the utilization of services or products, frequency and duration of use, and adoption of recommended practices as reported by the authors.
Authors reported 95% CIs but not exact P values. Perinatal death was defined as a stillbirth after 28 weeks of pregnancy or death within 1 week after a live birth; neonatal death was defined as death within 1 week after a live birth.
Impact estimates were reported as percentages in the article, but based on an email exchange with authors, these estimates should have been pp.
Neonatal death was defined as death within 28 d after a live birth; 1-d death was defined as death within 24 h after a live birth.
Effects larger for premature children, children of unmarried mothers, and teen mothers.
FIGURE 1PRISMA flow diagram of studies evaluating the impact of social assistance on birth outcomes. Abbreviation: PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analysis.
Assessment of certainty of evidence using the GRADE approach of studies evaluating the impact of social assistance on birth outcomes[1]
| Outcome ( | Limitations | Consistency | Directness | Precision | Publication bias | Overall certainty of evidence[ |
|---|---|---|---|---|---|---|
| Birth weight(2 RCTs, 2 quasi-experimental studies) | Very serious limitations
Severe loss to follow-up ( Differences in recall periods between treatment and control may have biased findings ( Confounding due to health-care expansion ( Missing details on design and methods ( | Serious inconsistency
Impact estimates ranged from 31 to 578 g Largest effect is biologically implausible ( | No serious indirectness | No serious imprecision | Likely publication bias
Primary outcome (registered) in only 1 study ( Decision to publish the results of secondary impact analyses possibly influenced by significance of the estimates. | Very low |
| Neonatal mortality(3 quasi-experimental studies) | Very serious limitations
Confounding due to health-care expansion ( Challenge of defining treatment, possible reverse causality, accuracy of the mortality measure possibly associated with program uptake ( | Serious inconsistency
Impact estimates ranged from not significant to 15% Statistical power calculations not provided | No serious indirectness | Serious imprecision | Likely publication bias
Not a primary or registered outcome in any of the studies Decision to publish the results of secondary impact analyses possibly influenced by significance of the estimates. | Very low |
Additional details are provided in the text. Abbreviations: GRADE, Grading of Recommendations, Assessment, Development and Evaluations; RCT, randomized controlled trial.
GRADE Working Group grades of evidence are as follows. High quality indicates that we are very confident that the true effect lies close to that of the estimate of the effect. Moderate quality indicates that we are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different. Low quality indicates that our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect. Very low quality indicates that we have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect.