Development and Validation of a Survey to Evaluate Mental Health Knowledge: The Case of Indonesian Pregnant Women

Yuli Kusumawati; Widyawati Widyawati; Fatwa Sari Tetra Dewi

doi:10.3889/oamjms.2021.5844

Authors

Yuli Kusumawati Doctoral Program, Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Yogyakarta, Indonesia; 2Public Health Program, Faculty of Health, Universitas Muhammadiyah Surakarta, Central Java, Indonesia https://orcid.org/0000-0002-4159-0284
Widyawati Widyawati Department of Pediatric and Maternity Nursing, Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Yogyakarta, Indonesia
Fatwa Sari Tetra Dewi Department of Health Behavior, Environment and Social Medicine, Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Yogyakarta, Indonesia

DOI:

https://doi.org/10.3889/oamjms.2021.5844

Keywords:

Pregnancy, Mental health knowledge, Validity, Reliability, Self-assessment tool

Abstract

BACKGROUND: Internationally, many instruments have been designed to evaluate mental health knowledge; however, in pregnant women is very limited.

AIM: Therefore, this study aimed to develop and validate a survey to measure the mental health knowledge of pregnant women.

METHODS: In this cross-sectional study, 13 midwives attended the FGD and 10 pregnant women were invited for in-depth interviews to develop an item pool. The content validity was carried out by a panel of 6 experts. The face validity was performed with 5 pregnant women. Next, the construct validity test involved 150 pregnant women who were selected by stratified sampling from 13 public health centers in Surakarta, Indonesia. Analyses were conducted to check content validity, face validity, construct validity, internal consistency reliability, difficulty index, and exploratory factor analysis.

RESULTS: A final 20-item Mental Health Knowledge Scale (MHKS) has a content validity index of 0.97 and a correlation value per item greater than the r-table (i.e., 0.1603). In addition, the MHKS has a Kuder–Richardson 20 reliability coefficient of 0.717. Furthermore, the difficulty index ranged from 0.39 to 0.82 which was considered in the good and acceptable category. Construct validity was confirmed using exploratory factor analysis KMO = 0.713, Bartlett’s test p < 0.001.

CONCLUSION: Based on the findings, the final version of the MHKS was considered a valid and reliable tool. The instrument can be applied to measure the understanding of pregnant women about pregnancy depression. Further studies require adjustment items to other participants regarding mental health knowledge.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Plum Analytics Artifact Widget Block

References

World Health Organization. Maternal Health. Mental Health and Substance Use. Geneva: World Health Organization; 2018. Available from: https://www.who.int/teams/mental-health-and-substance-use/maternal-mental-health. https://doi.org/10.1037/e400972004-001. [Last accessed on 2019 Nov 01]. DOI: https://doi.org/10.1037/e400972004-001

Kingston DE, Mcdonald S, Austin MP, Hegadoren K, Lasiuk G, Tough S. The Public’s views of mental health in pregnant and postpartum women: A population-based study. BMC Pregnancy Childbirth. 2014;14(1):84. https://doi.org/10.1186/1471-2393-14-84 PMid:24564783 DOI: https://doi.org/10.1186/1471-2393-14-84

Highet NJ, Gemmill AW, Milgrom J. Depression in the perinatal period: Awareness, attitudes and knowledge in the Australian population. Aust N Z J Psychiatry. 2011;45(3):223-31. https://doi.org/10.3109/00048674.2010.547842 PMid:21438748 DOI: https://doi.org/10.3109/00048674.2010.547842

Ibanez G, Bernard JY, Rondet C, Peyre H, Forhan A, Kaminski M, et al. Effects of antenatal maternal depression and anxiety on children’s early cognitive development: A prospective Cohort study. PLoS One. 2015;10(8):e0135849. https://doi.org/10.1371/journal.pone.0135849 PMid:26317609 DOI: https://doi.org/10.1371/journal.pone.0135849

Fadzil A, Balakrishnan K, Razali R, Sidi H, Malapan T, Japaraj RP, et al. Risk factors for depression and anxiety among pregnant women in Hospital Tuanku Bainun, Ipoh, Malaysia. Asia Pac Psychiatry. 2013;5(Suppl 1):7-13. https://doi.org/10.1111/appy.12036 PMid:23857831 DOI: https://doi.org/10.1111/appy.12036

Saeed A, Raana T, Saeed AM, Humayun A. Effect of antenatal depression on maternal dietary intake and neonatal outcome: A prospective cohort. Nutr J. 2016;15(1):64. https://doi.org/10.1186/s12937-016-0184-7 PMid:27401187 DOI: https://doi.org/10.1186/s12937-016-0184-7

Bjørnsen HN, Eilertsen ME, Ringdal R, Espnes GA, Moksnes UK. Positive mental health literacy: Development and validation of a measure among Norwegian adolescents. BMC Public Health. 2017;17(1):717. https://doi.org/10.1186/s12889-017-4733-6 DOI: https://doi.org/10.1186/s12889-017-4733-6

Wei Y, McGrath PJ, Hayden J, Kutcher S. Measurement properties of tools measuring mental health knowledge: A systematic review. BMC Psychiatry. 2016;16(1):297. https://doi.org/10.1186/s12888-016-1012-5 PMid:27553955 DOI: https://doi.org/10.1186/s12888-016-1012-5

Baghestani AR, Ahmadi F, Tanha A, Meshkat M. Bayesian critical values for lawshe’s content validity ratio. Meas Eval Couns Dev. 2019;52(1):69-73. https://doi.org/10.1080/0748175 6.2017.1308227 DOI: https://doi.org/10.1080/07481756.2017.1308227

Hendryadi H. Validitas Isi Tahap awal pengembangan kuesioner. J Riset Manajemen Bis Fakult Ekon. 2012;2(2):169-78. https://doi.org/10.36226/jrmb.v2i2.47. DOI: https://doi.org/10.36226/jrmb.v2i2.47

Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975;28(4):563-75. DOI: https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best practices for developing and validating scales for health, social, and behavioral research: A primer. Front Public Heal. 2018;6:149. https://doi.org/10.3389/fpubh.2018.00149 PMid:29942800 DOI: https://doi.org/10.3389/fpubh.2018.00149

Kingston D, Austin MP, Heaman M, McDonald S, Lasiuk G, Sword W, et al. Barriers and facilitators of mental health screening in pregnancy. J Affect Disord. 2015;186:350-7. https://doi.org/10.1016/j.jad.2015.06.029 PMid:26281038 DOI: https://doi.org/10.1016/j.jad.2015.06.029

O’Connor M, Casey L. The mental health literacy scale (MHLS): A new scale-based measure of mental health literacy. Psychiatry Res. 2015;229(1-2):511-6. https://doi.org/10.1016/j.psychres.2015.05.064 PMid:26228163 DOI: https://doi.org/10.1016/j.psychres.2015.05.064

Austin MP, Middleton P, Reilly NM, Highet NJ. Detection and management of mood disorders in the maternity setting: The Australian clinical practice guidelines. Women Birth. 2013;26:2- 9. https://doi.org/10.1016/j.wombi.2011.12.001 PMid:22217978 DOI: https://doi.org/10.1016/j.wombi.2011.12.001

Spedding MF, Stein DJ, Naledi T, Sorsdahl K. Pregnant women’s mental health literacy and perceptions of perinatal mental disorders in the Western Cape, South Africa. Ment Health Prev. 2018;11:16-23. https://doi.org/10.1016/j.mhp.2018.05.002 DOI: https://doi.org/10.1016/j.mhp.2018.05.002

Madlala S, Kassier S. Antenatal and postpartum depression: Effects on infant and young child health and feeding practices. S Afr J Clin Nutr. 2018;31(1):1-7. https://doi.org/10.1080/16070658.2017.1333753 DOI: https://doi.org/10.1080/16070658.2017.1333753

Schuwirth LW, Van Der Vleuten CP. Different written assessment methods: What can be said about their strengths and weakness? Med Educ. 2004;38(9):974-9. https://doi.org/10.1111/j.1365-2929.2004.01916.x PMid:15327679 DOI: https://doi.org/10.1111/j.1365-2929.2004.01916.x

Widoyoko E. Teknik Penyusunan Instrumen Penelitian. Yogyakarta: Pustaka Pelajar; 2012.

Davis LL. Instrument review: Getting the most from a panel of experts. Appl Nurs Res. 1992;5(4):194-7. DOI: https://doi.org/10.1016/S0897-1897(05)80008-4

Azwar S. Reliabilitas dan validitas. 4th ed. Yogyakarta: Pustaka Pelajar; 2018. p. 181.

Tsai AC, Scott JA, Hung KJ, Zhu JQ, Matthews LT, Psaros C, et al. Reliability and validity of instruments for assessing perinatal depression in African settings: Systematic review and meta-analysis. PLoS One. 2013;8(12):e82521. https://doi.org/10.1371/journal.pone.0082521 PMid:24340036 DOI: https://doi.org/10.1371/journal.pone.0082521

Lynn MR. Determination and quantificatiom of conten validity. J Exp Psychol Gen. 1986;35(6):382-6. PMid:3640358 DOI: https://doi.org/10.1097/00006199-198611000-00017

Sartori R. Face validity in personality tests: Psychometric instruments and projective techniques in comparison. Qual Quant. 2010;44(4):749-59. https://doi.org/10.1007/s11135-009-9224-0 DOI: https://doi.org/10.1007/s11135-009-9224-0

Comrey A, Lee H. A First Course in Factor Analysis. 2nd ed. Hillside, NJ: Lawrence Erlbaum; 1992.

Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39(1):31-6. DOI: https://doi.org/10.1007/BF02291575

Costello AB, Osborne JW. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the most from your Analysis. Vol. 10. Massachusetts: Practical Assessment, Research, and Evaluation; 2005.

Cohen L, Manion L, Moriison K. Research methods in education. In: Professional Development in Education. 6th ed., Vol. 38. London, United Kingdom: Routledge; 2012. p. 507-9. DOI: https://doi.org/10.1080/19415257.2011.643130

Kuder G, Richardson M. The theory of the estimation of test reliability. Psychometrika. 1937;2(3):151-60. DOI: https://doi.org/10.1007/BF02288391

Aday L, Cornelius L. Designing and Conducting Health Surveys: A Comprehensive Guide. 3rd ed. San Francisco: Jossey-Bass; 2006.

Kheyami D, Jaradat A, Al-Shibani T, Ali FA. Item analysis of multiple choice questions at the department of paediatrics, Arabian gulf university, Manama, Bahrain. Sultan Qaboos Univ Med J. 2018;18(1):e68-74. https://doi.org/10.18295/squmj.2018.18.01.011 PMid:29666684 DOI: https://doi.org/10.18295/squmj.2018.18.01.011

Waltz C, Strickland O, Lenz E. Measurement Nursing and Health Research. 4th ed., Vol. 53. New York: Springer Publising Company; 2013. p. 1689-99.

Recto P, Champion JD. Assessment of mental health literacy among perinatal hispanic adolescents. Issues Ment Health Nurs. 2017;38(12):1030-8. https://doi.org/10.1080/01612840.2017.1349224 PMid:28766973 DOI: https://doi.org/10.1080/01612840.2017.1349224

Spiker DA, Hammer JH. Mental health literacy as theory: Current challenges and future directions. J Ment Health. 2019;28(3):238-42. https://doi.org/10.1080/09638237.2018.143 7613 PMid:29436864 DOI: https://doi.org/10.1080/09638237.2018.1437613

Daley AJ, Jolly K, Sharp DJ, Turner KM, Blamey RV, Coleman S, et al. The effectiveness of exercise as a treatment for postnatal depression: Study protocol. BMC Pregnancy Childbirth. 2012;12(1):45. https://doi.org/10.1186/1471-2393-12-45 PMid:22682671 DOI: https://doi.org/10.1186/1471-2393-12-45

Daley AJ, Foster L, Long G, Palmer C, Robinson O, Walmsley H, et al. The effectiveness of exercise for the prevention and treatment of antenatal depression: Systematic review with meta-analysis. BJOG. 2015;122(1)57-62. https://doi.org/10.1111/1471-0528.12909 PMid:24935560 DOI: https://doi.org/10.1111/1471-0528.12909

de Souza AC, Alexandre NM, de Guirardello EB. Psychometric properties in instruments evaluation of reliability and validity. Epidemiol Serv Saude. 2017;26(3):649-59. PMid:28977189 DOI: https://doi.org/10.5123/S1679-49742017000300022

Wei Y, McGrath PJ, Hayden J, Kutcher S. Mental health literacy measures evaluating knowledge, attitudes and help-seeking: A scoping review. BMC Psychiatry. 2015;15(1):291. https://doi.org/10.1186/s12888-015-0681-9 PMid:26576680 DOI: https://doi.org/10.1186/s12888-015-0681-9

Thorsteinsson EB, Loi NM, Moulynox AL. Mental health literacy of depression and postnatal depression: A community sample. Open J Depress. 2014;3(3):101-11. https://doi.org/10.4236/ojd.2014.33014 DOI: https://doi.org/10.4236/ojd.2014.33014

Jorm AF, Kelly CM. Improving the public’s understanding and response to mental disorders. Aust Psychol. 2007;42(2):81-9. DOI: https://doi.org/10.1080/00050060701280565

Guy S, Sterling BS, Walker LO, Harrison TC. Mental health literacy and postpartum depression: A qualitative description of views of lower income women. Arch Psychiatr Nurs. 2014;28(4):256-62. https://doi.org/10.1016/j.apnu.2014.04.001 DOI: https://doi.org/10.1016/j.apnu.2014.04.001

Evans-Lacko S, Little K, Meltzer H, Rose D, Rhydderch D, Henderson C, et al. Development and psychometric properties of the mental health knowledge schedule. Can J Psychiatry. 2010;55(7):440-8. https://doi.org/10.1177/070674371005500707 PMid:20704771 DOI: https://doi.org/10.1177/070674371005500707