Open Access Short report

Comparing validity of Edinburgh scale and SRQ20 in screening for post-partum depression

Iná S Santos1*, Alicia Matijasevich1, Beatriz F Tavares2, Andrey C da Cruz Lima1, Rafael E Riegel2 and Bruna C Lopes2

Author Affiliations

1 Department of Social Medicine, Faculty of Medicine, Federal University of Pelotas, Pelotas, Brazil

2 Department of Mental Health, Faculty of Medicine, Federal University of Pelotas, Pelotas, Brazil

For all author emails, please log on.

Clinical Practice and Epidemiology in Mental Health 2007, 3:18  doi:10.1186/1745-0179-3-18


The electronic version of this article is the complete one and can be found online at: http://www.cpementalhealth.com/content/3/1/18


Received:7 February 2007
Accepted:28 September 2007
Published:28 September 2007

© 2007 Santos et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

The Edinburgh Postnatal Depression Scale (EPDS) is the instrument most used worldwide for screening of Post-Partum Depression (PPD). The SRQ20 questionnaire has been largely used for screening of minor psychiatric disorders. This study aimed to compare the accuracy of the two instruments in screening for PPD. At the third-month follow-up home visit to infants of the 2004 Pelotas Birth Cohort, Southern Brazil, a sub-sample of 378 mothers was selected. Among other questions, EPDS and SRQ20 were applied by trained fieldworkers. Up to 15 days later, a mental health professional re-interviewed the mother (the gold standard interview). Sensitivity and specificity of each cutoff point were calculated for EPDS and SRQ20 and the results were plotted at a ROC curve. The areas under both curves were compared. Highest sensitivity and specificity cutoff were observed for EPDS ≥ 10 (sensitivity 82.7%, 95%CI 74.0 – 89.4; specificity 65.3%, 95%CI 59.4 – 71.0) and for SRQ20 ≥ 6 (sensitivity 70.5%, 95%CI 60.8 – 79.0%; specificity 75.5%, 95%CI 70.0 – 80.5%). Shape of ROC curves and areas under both curves were virtually identical (respectively, 0.8401 ± 0.02 for EPDS and 0.8402 ± 0.02 for SRQ20; p = 0.9). In conclusion SRQ20 showed to be as valid as EPDS as a screening tool for PPD at third month after delivery.

Background

Postpartum depression (PPD) can lead to maternal reduced interaction and irritability misdirected at the child [1]. PPD can impair adequate infant care and increase the risk for infant cognitive and emotional delay [2]. Some authors have recognized PPD as a public health problem and recommended the systematic screening of the condition, in both antenatal and postnatal periods [3,4]. In clinical settings, identification of PPD can be improved by increasing awareness and skills of health professionals in recognizing maternal depressive symptoms or by screening for PPD through the use of specific questionnaires [5].

The Edinburgh Postnatal Depression Scale (EPDS) [6] and the Self-Reporting Questionnaire 20 items (SRQ20) [7,8] are largely used in mental health research. The EPDS is the most widely accepted screening scale used worldwide in the perinatal period [9]. The SRQ20 was developed by the World Health Organization to screen for common mental disorders (depression and anxiety) in primary health care. Both questionnaires are not substitute for, or equivalent to, a clinical diagnosis. They indicate probable cases of mental disorder by identifying individuals who need further evaluation. Both tests are not of exclusive use among specific population groups. As sated by the authors, EPDS may be used for screening and diagnosis of depression at community level, indistinctly among men and women [6]. The SRQ20 questionnaire may be applied to identify in risk individuals, independently of sex and childbearing status.

This study was planned to compare the performance of SRQ20 and EPDS in screening for PPD in a sample of mothers from the 2004 Pelotas Birth Cohort, three months after delivery, having as gold standard an interview conducted by mental health professionals.

At age three months, all the infants from the cohort [10], a population-based study which included all children born in the city's five hospitals, were visited at home. At this occasion their mothers were interviewed and, among other questions the EPDS (Table 1) and the SRQ20 questionnaires were administered. The EPDS performance as a screening and diagnostic tool for post-partum depression was tested and the results are available in another publication [11].

Table 1. Edinburgh Test (Portuguese version)

For the purpose of the present study, mothers whose babies reached age three months between 1 January and 31 March 2005 (born, therefore, between 1 October and 31 December 2004) were included. The majority of the interviews were strictly paid in the time frame between one week before and one week after the day in which the infant completed his/her third month of life (between weeks 12 and 14 after birth, in average at week 13.1 (SD = 0.6). Only women who gave birth to singletons were eligible.

Questions of the two instruments were posed to mothers by a trained interviewer, as a single block and in the same order as in the original instrument. The decision to pose the questions to mothers verbally instead of self-administered was due to the high proportion of mothers with little schooling. The administration of SRQ20 and EPDS as an interview is accepted by the instrument's authors and has already been used previously [7,8].

To the present analysis, all mothers scoring 9 points or more in the EPDS were selected. Then, a systematic sample of mothers scoring < 9 was obtained by recruiting every fourth mother in this condition. All the selected mothers underwent a diagnostic interview (gold standard).

For the diagnostic interview (gold standard), mothers were re-visited at home by a mental health professional (psychiatrist, psychologist, or psychiatry resident), previously trained for the administration of a semi-structured interview, which was based on ICD-10 diagnostic criteria [12] to explored the presence of depressed mood most of the days of the last two consecutive weeks. It was a standardized semi-structured questionnaire containing major obligatory symptoms, accessory symptoms, as well as criteria for differential diagnosis to be fulfilled during the interview. For standardization purposes, interviewers were trained before data collection. Training included the reading and discussion of the instrument and role-playing sections headed by a Senior psychiatrist, who also reviewed and codified all records from interview with the mothers. The diagnostic interview was aimed at detecting the current or recent (last 15 days) depressive episodes. According to the result of this interview, mothers were classified as 'normal' or 'positive,' the latter including those with mild, moderate or severe episodes of depression. Mental health professionals were blinded as to the score obtained by mothers using EPDS or SRQ20. Average time interval between EPDS/SRQ20 application and the gold standard interview was 18.3 (SD = 9.6) days (median = 16 days; range = 5 – 60 days).

For each EPDS and SRQ20 cutoff point, sensitivity (proportion of depressed mothers according to ICD-10 criteria that were correctly identified) and specificity (proportion of non-depressed mothers correctly identified as such) were calculated. The cutoff point showing simultaneously the highest sensitivity and specificity was determined using a Receiver Operator Characteristic (ROC) curve for both, the EPDS and the SRQ20. Plotted in the same graphic, the ROC curves were used to compare accuracy of SRQ20 and EPDS as estimated through the size of the area under each curve. Stata 9.1 software was used for all analyses.

The research protocol was approved by the Research Ethics Committee of the University of Pelotas Medical School and written maternal consent was obtained before the interviews.

A total of 965 singleinfants were born between 1 October and 31 December 2004. There were 79 losses and refusals (8.2%). Of the 886 mothers for whom the SRQ20 and EPDS were administered, 219 presented EPDS ≥ 9 and 667 EPDS < 9. As a result 378 responded also to the diagnostic interview (219 with EPDS ≥ 9 and 159 with EPDS < 9). According to the gold standard, 105 mothers presented mild, moderate, or severe episodes of depression, and the remaining 273 were classified as normal.

The wide majority of the mothers (83.6%) came from families with monthly family income of up to three minimum wages. About 67% were aged 20–34 years, and over one-fifth (22.2%) were adolescents. Only two mothers had never attended school, whereas 15% had between one and four, and about 40%, nine or more years of schooling. The majority of women were white (70.9%), and 81.2% lived with a husband or partner. A little more than one-third of mothers (38.4%) worked outside home during pregnancy. The majority of pregnancies were unplanned (67.2%). The prevalence of babies with low birth weight (< 2,500 grams) and preterm births (< 37 gestational weeks) (10,8% and 16.4%, respectively), as well as the frequency of all maternal characteristics examined in the sample, with the exception of smoking during pregnancy, were statistically similar to those of the 2004 cohort as a whole (n = 4,287 alive and singleton births). The prevalence of maternal smoking was higher in the sample (33.6% versus 25.1%; p < 0.001).

Correlation coefficient between EPDS and SRQ20 as regard to true positive results was 0.7251. The two tests fully agreed for 295 mothers. Among 83 mothers the observed disagreement was for 44 who were positive to the EPDS and negative to the SRQ20, and the contrary for the remaining 39 mothers. Kappa statistics of the agreement between the two tests was 56% (95%CI 48–64%). As shown in Table 2 and Figure 1, for EPDS the cutoff point ≥ 10 was the best for screening PPD among that population with sensitivity 82.7% (74.0% – 89.4%) and specificity 65.3% (59.4% – 71.0%). For SRQ20 the correspondent best cutoff was ≥ 6 with sensitivity 70.5% (95%CI 60.8 – 79.0%) and specificity 75.5% (95%CI 70.0 – 80.5%). At those cutoffs, accuracy of both instruments was similar, respectively, 70.1% for EPDS and 74.1% for SRQ20. Figure 1 also shows that shape of ROC curves and areas under both curves were virtually identical, respectively, 0.8401 ± 0.02 for EPDS and 0.8402 ± 0.02 for SRQ20 (p = 0.9).

Table 2. Sensitivity, specificity of a Brazilian version of EPDS and of SRQ20.

thumbnailFigure 1. ROC curves for the SRQ20 and the EPDS for Post Partum Depression. Solid line: EPDS. Broken line: SRQ20

A potential source of criticism for the current analysis refers to the time after birth in which the screening was conducted. However, there is an incomplete knowledge regarding the natural history of PPD: while for the Diagnostic and Statistical Manual of Mental Disorders, 4th ed. (DSM-IV) PPD has its onset within four weeks post-partum, others define onset up to the three months post-partum [13,14]. Therefore, the ideal timeframe for screening has not yet been established [15]. Most PPD research has used the second and third post-partum months for screening [5]. Furthermore, most instruments used to screen PPD were tested and showed to be valid and reliable when applied in the second and third post-partum months [16].

A recent meta-analysis reviewing articles printed in English and published up to December 2004, identified eight self-report questionnaires currently used for assessing depressive symptoms within the first year postpartum [13]. The EPDS, but not the SRQ20, was among them. The present study showed that SRQ20 and EPDS are very similar in performance to screen for PPD when assessed against the psychiatric interview taken as the gold standard. A previous study had already described a good agreement rate between EPDS and SRQ20, with a Kappa statistics of 0.75 [17]. Such findings support the validity of SRQ20 as a screening tool for PPD.

It should be noted that the highest sensitivity and specificity for SRQ20 as a screening tool for Brazilian women in general population was obtained with a cutoff of ≥ 8 [18]. For PPD, the corresponding SRQ20 cutoff point was lower, ≥ 6.

Characteristics regarding area of application and type of administration are very similar for EPDS and SRQ20. Both were developed for use in clinical and research settings and have the advantage of being suitable for use by lay interviewers in a face-to-face interview. Although EPDS has a smaller number of items than the SRQ20, the last can typically be applied by trained interviewers in a ten minute time [8].

The results of this study may be relevant for primary health care services and for future research. As PPD gains growing recognition as a public health concern and evidence of benefit of early treatment accumulates, the number of studies to identify the group of mothers in higher risk of PPD will increase. Due to its large use and the evidence of its adequate accuracy, the use of the SRQ20 as a screening tool for detecting PPD should also be considered.

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

ISS conceived of the study, and participated in its design and drafted the manuscript. AM participated in its design and performed the statistical analyses. BFT participated in the design and coordination of the study and helped to draft the manuscript. ACCL participated in the design of the study and helped to draft the manuscript. RER and BCL participated in the coordination of the study. All authors read and approved the final manuscript.

Acknowledgements

The Pelotas 2004 Birth Cohort was supported by the World Health Organization (Department of Child and Adolescent Health and Development), the National Program for Centers of Excellence (Brazil), the National Research Council (Brazil), the Ministry of Health (Brazil), and the Children's Mission (Brazil). Funding body had any role in study design; collection, analysis, and interpretation of the data; in the writing of the manuscript; nor in the decision to submit the manuscript for publication.

The authors are thankful to the funding agencies, the mothers of all newborns in the cohort, the hospitals of the city of Pelotas, the Municipal Secretariat of Health and Welfare, and all those who collaborated in the different stages of the present study.

References

  1. Murray L, Cooper PJ, Wilson A, Romaniuk H: Controlled trial on the short- and long-term effect of psychological treatment of post-partum depression: 2. Impact on the mother-child relationship and child outcome.

    Br J Psychiatry 2003, 182:420-427. PubMed Abstract | Publisher Full Text OpenURL

  2. Muñoz RF, Le HN, Ghosh Ippen C: We should screen for major depression.

    Appl Prev Psychol 2000, 9:123-133. Publisher Full Text OpenURL

  3. Buist AE, Barnett BEW, Milgrom J, Pope S, Condon JT, Ellwood DA, Boyce PM, Austin MPV, Hayes BA: To screen or not to screen – that is the question in perinatal depression.

    Med J Aust 2002, (Suppl 177):S101-S105. OpenURL

  4. Chaudron LH, Szilagyi PG, Kitzman HJ, Wadkins HIM, Conwell Y: Detection of postpartum depressive symptoms by screening at well-child visits.

    Pediatrics 2004, 113:551-558. PubMed Abstract | Publisher Full Text OpenURL

  5. Lee DTS, Yip ASK, Chan SSM, Tsui MHY, Wong WS, Chung TKH: Postdelivery screening for postpartum depression.

    Psychosom Med 2003, 65:357-361. PubMed Abstract | Publisher Full Text OpenURL

  6. Cox JL, Holden JM, Sagovsky R: Detection of postnatal depression: development of the 10-item Edinburgh Postnatal Depression Scale.

    Br J Psychiatry 1987, 150:782-786. PubMed Abstract OpenURL

  7. World Health Organization: User's guide to the Self-Reporting Questionnaire – SRQ. Geneva: World Health Organization; 1994. OpenURL

  8. Harpham T, Reichenheim M, Oser R, Thomas E, Hamid N, Jaswal S, Ludermir A, Aidoo M: Measuring mental health in a cost-effective manner.

    Health Policy Plan 2003, 18:344-349. PubMed Abstract | Publisher Full Text OpenURL

  9. Dennis CL: Psychosocial and psychological interventions for prevention of postnatal depression: systematic review.

    BMJ 2005, 331:15. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Barros FC, Victora CG, Barros AJD, Santos IS, Albernaz E, Matijasevich A, Domingues MR, Sclowitz IK, Hallal PC, Silveira MF, Vaughan JP: The challenge of reducing neonatal mortality in middle-income countries: findings from three Brazilian birth cohorts in 1982, 1993, and 1994.

    Lancet 2005, 365:847-854. PubMed Abstract | Publisher Full Text OpenURL

  11. Santos IS, Matijasevich A, Tavares BF, Barros AJD, Botelho IP, Lapolli C, Magalhães PVS, Barbosa APPN, Barros FC: Validation of the Edinburgh Postnatal Depression Scale (EPDS) in a sample of mothers from the 2004 Pelotas Birth Cohort.

    Reports of Public Health, in press. OpenURL

  12. World Health Organization: The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines. Geneva: World Health Organization; 1992. OpenURL

  13. Wisner KL, Parry BL, Piontek CM: Clinical Practice. Postpartum depression.

    N Engl J Med 2002, 347:194-199. PubMed Abstract | Publisher Full Text OpenURL

  14. Cooper PJ, Murray L: Fortnightly review. Postnatal depression.

    BMJ 1998, 316:1884-1886. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Stewart DE, Robertson E, Dennis CL, Grace S: An evidence-based approach to post-partum depression.

    World Psychiatry 2004, 3:97-98. PubMed Abstract | PubMed Central Full Text OpenURL

  16. Lee DT, Yip AS, Chan SS, Tsui MH, Wong WS, Chung TK: Postdelivery screening for postpartum depression.

    Psychosom Med 2003, 65:357-361. PubMed Abstract | Publisher Full Text OpenURL

  17. Cruz EBS, Simões GL, Faisal-Cury A: Post-partum depression screening among women attended by the Family Health Program.

    Rev Bras Ginecol Obstet 2005, 27:181-188. Publisher Full Text OpenURL

  18. Mari JJ, Williams P: A validity of a psychiatric screening questionnaire (SRQ-20) in primary care in the city of Sao Paulo.

    Br J Psychiatry 1986, 148:23-26. PubMed Abstract OpenURL