Journal article · 2022 · Open access

WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries

Emanuelle Pessa Valente, Benedetta Covi, Ilaria Mariani, Sandra Morano, Marina Ruxandra Oțelea, Ioana Nanu, Micaela Iuliana Nanu, Helen Elden, Karolina Lindén, Mehreen Zaigham, Eline Skirnisdottir Vik, Sigrun Kongslien and 10 more

BMJ Open, 12(4), e056753 · Published 1 April 2022 · DOI 10.1136/bmjopen-2021-056753

Open PDFView at the publisherCite this paper

In brief

“WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries” is a 2022 journal article by Emanuelle Pessa Valente and 21 co-authors, published in BMJ Open. OpenAlex counts 18 citations as of 22 November 2026. It is open access under a CC BY-NC licence: the full text is free to read at BMJ Open.

Citations
18
Most cited in
2024 (10)
Field-weighted impact
2.97
References
53
Authors
22

Abstract

OBJECTIVES: Develop and validate a WHO Standards-based online questionnaire to measure the quality of maternal and newborn care (QMNC) around the time of childbirth from the health workers' perspective. DESIGN: Mixed-methods study. SETTING: Six countries of the WHO European Region. PARTICIPANTS AND METHODS: The questionnaire is based on lessons learnt in previous studies, and was developed in three sequential phases: (1) WHO Quality Measures were prioritised and content, construct and face validity were assessed through a Delphi involving a multidisciplinary board of experts from 11 countries of the WHO European Region; (2) translation/back translation of the English version was conducted following The Professional Society for Health Economics and Outcomes Research guidelines; (3) internal consistency, intrarater reliability and acceptability were assessed among 600 health workers in six countries. RESULTS: The questionnaire included 40 items based on WHO Standards Quality Measures, equally divided into four domains: provision of care, experience of care, availability of human and physical resources, organisational changes due to COVID-19; and its organised in six sections. It was translated/back translated in 12 languages: Bosnian, Croatian, French, German, Italian, Norwegian, Portuguese, Romanian, Russian, Slovenian, Spanish and Swedish. The Cronbach's alpha values were ≥0.70 for each questionnaire section where questions were hypothesised to be interrelated, indicating good internal consistence. Cohen K or Gwet's AC1 values were ≥0.60, suggesting good intrarater reliability, except for one question. Acceptability was good with only 1.70% of health workers requesting minimal changes in question wording. CONCLUSIONS: Findings suggest that the questionnaire has good content, construct, face validity, internal consistency, intrarater reliability and acceptability in six countries of the WHO European Region. Future studies may further explore the questionnaire's use in other countries, and how to translate evidence generated by this tool into policies to improve the QMNC. TRAIL REGISTRATION NUMBER: NCT04847336.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Valente, E. P., Covi, B., Mariani, I., Morano, S., Oțelea, M. R., Nanu, I., Nanu, M. I., Elden, H., Lindén, K., Zaigham, M., Vik, E. S., Kongslien, S., Nedberg, I. H., Costa, R. A., Rodrigues, C., Dias, H., Drandić, D., Kurbanović, M., Sacks, E., . . . Lazzerini, M. (2022). WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries. BMJ Open, 12(4), e056753. https://doi.org/10.1136/bmjopen-2021-056753

MLA 9

Valente, Emanuelle Pessa, et al. “WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries.” BMJ Open, vol. 12, no. 4, 2022, p. e056753. https://doi.org/10.1136/bmjopen-2021-056753.

Chicago

Valente, Emanuelle Pessa, Benedetta Covi, Ilaria Mariani, Sandra Morano, Marina Ruxandra Oțelea, Ioana Nanu, Micaela Iuliana Nanu, et al. 2022. “WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries.” BMJ Open 12 (4): e056753. https://doi.org/10.1136/bmjopen-2021-056753.

Harvard

Valente, E. P. et al. (2022) ‘WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries’, BMJ Open, 12(4), p. e056753. doi:10.1136/bmjopen-2021-056753.

IEEE

E. P. Valente et al., “WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries,” BMJ Open, vol. 12, no. 4, p. e056753, 2022, doi: 10.1136/bmjopen-2021-056753.

BibTeX

@article{valente2022standards,
  title     = {{WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries}},
  author    = {Valente, Emanuelle Pessa and Covi, Benedetta and Mariani, Ilaria and Morano, Sandra and Oțelea, Marina Ruxandra and Nanu, Ioana and Nanu, Micaela Iuliana and Elden, Helen and Lindén, Karolina and Zaigham, Mehreen and Vik, Eline Skirnisdottir and Kongslien, Sigrun and Nedberg, Ingvild Hersoug and Costa, Raquel Almeida and Rodrigues, Carina and Dias, Heloísa and Drandić, Daniela and Kurbanović, Magdalena and Sacks, Emma and Muzigaba, Moïse and Lincetto, Ornella and Lazzerini, Marzia},
  journal   = {BMJ Open},
  year      = {2022},
  volume    = {12},
  number    = {4},
  pages     = {e056753},
  doi       = {10.1136/bmjopen-2021-056753},
  url       = {https://doi.org/10.1136/bmjopen-2021-056753}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202255
202311
20241010
202622

Its field-weighted citation impact is 2.97: it has been cited 2.97 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Nursing › Research and Theory › Health Education and Validation

  • childbirth care
  • quality metrics
  • questionnaire validation
  • Delphi consensus
  • translation and back-translation
  • intra-rater reliability
  • COVID-19 impact on health services
  • WHO European Region

Work with this paper

Most-cited papers in Nursing

All highly cited Nursing papers

Questions about this paper

How do I cite this paper in APA style?

Valente, E. P., Covi, B., Mariani, I., Morano, S., Oțelea, M. R., Nanu, I., Nanu, M. I., Elden, H., Lindén, K., Zaigham, M., Vik, E. S., Kongslien, S., Nedberg, I. H., Costa, R. A., Rodrigues, C., Dias, H., Drandić, D., Kurbanović, M., Sacks, E., . . . Lazzerini, M. (2022). WHO Standards-based questionnaire to measure health workers’ perspective on the quality of care around the time of childbirth in the WHO European region: development and mixed-methods validation in six countries. BMJ Open, 12(4), e056753. https://doi.org/10.1136/bmjopen-2021-056753

How many times has this paper been cited?

18 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at BMJ Open: sign in and open the PDF from this page.

Who wrote this paper?

Emanuelle Pessa Valente, Benedetta Covi, Ilaria Mariani, Sandra Morano, Marina Ruxandra Oțelea, Ioana Nanu, Micaela Iuliana Nanu, Helen Elden, Karolina Lindén, Mehreen Zaigham, Eline Skirnisdottir Vik, Sigrun Kongslien and 10 more.

What is the DOI of this paper?

10.1136/bmjopen-2021-056753, permanently at https://doi.org/10.1136/bmjopen-2021-056753. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.