An evaluation of the quantity and quality of empirical research in three pastoral care and counseling journals, 1990-1999: has anything changed?

This article summarizes a review of all articles published in Pastoral Psychology, The Journal of Rleigion and Health, and The Journal of Pastoral Care between 1900 and 1999, identifying a total of 737 scholarly articles, of which 165 (22.4%) were research studies. The proportion of research studies, especially quantitative studies, increased significantly between the first and second half of the study period (p < .05). There was a significant positive correlation between compliance with three out of four criteria of internal validity. Three of five criteria of external validity were also positively related to one another. Compared to previous research using identical criteria to assess quantitative studies in the same journals in 1980-1989, the 1990-1999 sample showed improved compliance with respect to specifying the sampling method (p < .001), reporting the response rate (p < .05), and discussing the limitations of research studies (p < .001). However, the overall findings suggest that many researchers in the field do not have a sophisticated knowledge of statistical sampling, statistical analysis, or research design. Several recommendations for increasing the quality of quantitative research are offered.