Quality care process metrics for nurses working in general practice, mapping the evidence: a scoping review protocol.

Background: Irish general practice nursing roles have developed and grown exponentially in response to changing policy, clinical and workforce demands, this is reflective of international primary healthcare nursing trends. However, as nursing care in general practice advances, comprehensive evaluation of the general practice nurse (GPN) role has not been undertaken. Therefore, processes which enable robust data collection to assess the role and facilitate development of services are required. Nursing quality care metrics are an established mechanism which evaluate quality of care. Nursing quality care process metrics (QCP-Ms) specifically refer to measurement of care delivered directly to patients by nurses, benchmarking these interventions adherence to best practice guidance. The use of nursing metrics has been adopted within seven distinct healthcare settings in Ireland but not general practice. This scoping review is the first stage of a project which aims to inform development and implementation of QCP-Ms by Irish GPNs. Aim: To explore and map the literature regarding the development and implementation of QCP-Ms within general practice settings.
Methods: The following five-stage methodological framework for scoping reviews proposed by Arksey and O'Malley will be used: (1) identifying the research question, (2) identifying relevant studies, (3) study selection, (4) charting/mapping the data and (5) collating, summarizing, and reporting results. The review will be conducted and reported in accordance with the PRISMA Extension for Scoping Reviews (PRISMA-ScR). Conclusions: The focus of this scoping review relates to QCP-Ms which specifically measure the work of general practice nurses. It is envisioned that synthesis of international literature will give a broad perspective about nursing QCP-Ms, their use in general practice or primary healthcare settings, enriching understanding regarding their development. It is anticipated that findings will provide key information to policy makers and health professionals interested in planning, strengthening, and delivering primary healthcare. Copyright:

Introduction

The World Health Organisation (WHO) Astana declaration affirmed the role of primary care as the mainstay of efficient, effective, equitable health systems internationally. This declaration advocated that primary care be strengthened and supported with enhanced infrastructure and workforce capacity to enable its important role in disease prevention and health promotion ( World Health Organisation, 2018). General practice is considered the cornerstone of primary healthcare delivery in most European countries ( Kringos ). In Ireland, healthcare policy, government and healthcare providers are advancing and adopting reorientation of service delivery into the community and primary care ( Houses of the Oireachtas, 2017). This change comes at a critical time for Irish general practice, which is positioned at the center of healthcare policy implementation. Currently demographic pressures, the rise of non-communicable diseases, multimorbidity, workforce capacity issues and the coronavirus disease 2019 (COVID-19) pandemic are contributing to increased pressure on general practice ( Crosbie ; McGlacken-Byrne ).

Primary care nursing worldwide is evolving in tandem with health policy reform, general practice nursing has emerged as a new generalist model of nursing positioned within primary care which is integral to the future delivery of healthcare. The World Health Organization (WHO) highlight the positive benefits of generalist nurse practitioners in family practice and recommends governments enable optimization of autonomous practice for nurses working in primary health care services ( World Health Organisation, 2021). The prominent, impactful and evolving role of nurses in primary care internationally was outlined by WHO in a recent ‘State of the world's nursing 2020’ report ( World Health Organisation, 2020). Furthermore, The Lancet (2019) in an editorial describes the inestimable value of nursing and the untapped potential which nursing offers to strengthen primary healthcare services. More recently Casey suggest that general practice nurses provide a valuable resource to general practice particularly in chronic disease management and indeed they may be practicing at an advanced nursing level. Primary healthcare workforce skill mix in six countries, USA, Canada, Australia, England, Germany, and Netherlands was examined by ( Freund ) who reported nurses as the major non physician workforce in primary care teams. A 2018 Cochrane systematic review ( Laurant ) demonstrated quality-of-care interventions by nurses in general practice to be at least as good as care from general practitioners. This systematic review analyzed a broad scope of research from UK, Netherlands, USA, Canada, Sweden, Spain, and South Africa, demonstrating the international experience and impact of nurses working within primary care settings. Australian studies by ( Desborough ; Halcomb & Ashley, 2019) demonstrate the evolving role and impact of GPNs, their importance to health promotion and chronic disease management care. These studies highlight increased patient satisfaction derived from continuity of care offered by GPNs. They find the high-quality care delivered by GPNs is associated with patient enablement, better outcomes, and that the role is underutilized. It is notable from preliminary searches of the literature that researchers have been working towards the development of standards for general practice nursing in many countries, including the UK, Australia, and Canada. ( Barrett ; Halcomb ; Lukewich ). This demonstrates an imperative internationally to measure the delivery of GPN care, and articulate the unique generalist aspects of the role. The recent Sonnet report published on behalf of NHS England and NHS Improvement evaluates the value which GPNs deliver to primary healthcare in the UK ( Clifford ), it describes nursing in general practice as a clear, identifiable discipline, which brings significant value to primary healthcare. This report stresses that without recognition, investment, training and establishment of a distinct career pathway for GPNs the role may flounder. In Canada Lukewich echoed these concerns and draw attention to obstacles to progression which general practice nursing faces emphasizing the need for research and support of leadership development among GPNs.

General practice is a core component of primary care services, led by general practitioners (GPs) it is the place of first contact for most patients in need of health services, and offers accessibility, continuity, and comprehensive, coordinated care. According to O’Dowd the distinct role of general practice within primary care is an important consideration as the terms ‘general practice’ and ‘primary care’ are often incorrectly used interchangeably. A more detailed definition of general practice or family medicine is further summarised as “General practice/family medicine is an academic and scientific discipline, with its own educational content, research, evidence base and clinical activity, and a clinical specialty orientated to primary care” ( Mola pp. 8). The World Organisation of Family Doctors (WONCA) represents a global workforce of over 500,000 general practitioner, family doctors. In 2019 WONCA endorsed and authored the Albuquerque Statement which specifically seeks to advance and advocate for nurses working within rural primary healthcare settings ( Kenkre & Wynn-Jones, 2020). The Albuquerque statement recognises the importance of generalism in nursing, it commits to supporting research and data collection which will enhance understanding of the work of family practice and rural community nursing roles.

Reflecting international trends Irish government health policy, Sláintecare, has embraced the concept of care reorientation from hospital-based models to primary care settings ( Houses of the Oireachtas, 2017). Fundamental to Sláintecare policy is implementation of a universal, single-tier health system, and delivery of high quality, safe care to patients in their own communities. Implementation of this policy is evident in recent agreements between healthcare authorities and general practice providers, including the introduction of entitlements to free general practice care for those aged under six and over seventy years of age ( Connolly & Wren, 2019; Health Service Executive, 2015b). In 2019, an agreement for reform and service development within general practice between government and general practice representatives, included a community-based structured chronic disease management programme (CDM) which became operational in 2020 ( Health Service Executive, 2019b). This is a first step in implementing an integrated approach to chronic disease care, and GPNs are established as critical to its successful rollout ( Collins & Homeniuk, 2021; Darker ; Irish College of General Practitioners, 2021).

Irish GPNs lead and deliver a broad range of the healthcare services, including primary infant and adult immunisation programmes, cervical screening, health promotion and education interventions, disease surveillance, acute and minor illness triage, and management, wound care, and a complex range of generalist nursing services ( Bury ; Casey ; McCarthy ). Furthermore, GPNs adapted to challenges in delivery of services resulting from the COVID-19 pandemic, and were integral to continuation of services, particularly the delivery of the COVID-19 vaccination programme in general practice ( Homeniuk & Collins, 2021; Health Service Executive, 2021; Lowry Lehnen, 2021). International research demonstrates that mobilisation of GPN workforce and advanced GPN roles can strengthen general practice, whilst providing benefits and safe care for patients ( Halcomb & Ashley, 2019; Laurant ; Norful ; Poghosyan ), additionally this research suggests that GPN roles may be underutilized.

Enabling the provision of high-quality healthcare is a core concern for healthcare authorities worldwide ( Health Information and Quality Authority (HIQA), 2012; World Health Organisation (WHO), 2006). In Ireland, Sláintecare policy endorses this drive towards accountability and performance within the health service. However, there is currently little evidence available on the quality of care and contribution of Irish GPNs to general practice. Nursing quality care process metrics is a mechanism which can simultaneously address the issue of the provision of quality nursing care and GPN role evaluation. By compiling quantifiable measurements applicable to nursing care in general practice, development and improvements in nursing services and patient outcomes can be facilitated ( Health Service Executive, 2015a). This data will also give more detailed information on the nursing activities of the general practice nurse.

Nursing Quality Care Process Metrics

Quality care metrics is a method of measuring quality of care, placing safety and quality at the heart of service provision, nursing metrics were first introduced the USA in the early 1990s and were subsequently developed for use in the UK in 2008 ( Foulkes, 2011). Maben report on the increasing use of initiatives which measure quality care in nursing both internationally and within the UK. They counsel that the development of nursing metrics should align with ‘what matters most’ to patients. Furthermore, they observed practitioner’s acceptance and participation in nursing metrics projects were enhanced through fostering understanding of the purpose and benefits of the process for nursing services, and patient care. The Office of the Nursing and Midwifery Services Director (ONMSD) has led QCP-Ms implementation and evaluation in Irish healthcare settings and define nursing QCP-Ms as “A measure of the quality of nursing and midwifery clinical care processes aligned to evidenced based standards and agreed through national consensus in healthcare settings in Ireland” ( Health Service Executive (2015a) pp.10).

The Irish national QCP-Ms project adopted the Donabedian (1988) framework of quality care evaluation based on the structure, process, and outcome triad within which each element has a direct effect on the overall quality of care delivered. Within the Donabedian model, structure refers to the attributes specific to the healthcare working environment and characteristics of those who work within it such as education or experience, process examines how direct care is provided to patients from a technical and interpersonal perspective, and outcomes assess the end points of care achieved such as immunisation rates or patient experiences ( Hanae Ibn El ). The focus of metrics implemented by the ONMSD national project is on care specific to nursing processes, in other words scrutinizing how nursing care is given, and how it is delivered. The areas which have adopted the use of metrics to date are acute care services, children’s services, intellectual disability services, older person services, mental health services, public health nursing services, and midwifery services ( Health Service Executive, 2019a).

In the UK, Griffiths observed that development of nursing metrics had been dominated by in-patient settings and this is reflected in the Irish experience. Notably, Griffiths conclude that metric themes and indicators developed for acute care and inpatient settings can be modified and applied to other care settings. According to Haycock-Stuart & Kean (2012) community settings are a care environment within which nursing plays a significant but often invisible role and they acknowledge the need for evidence of quality care delivery in this setting. In Ireland a report into the development process for a primary care setting, Public Health Nursing QCP-Ms published in 2018 demonstrates the feasibility of their implementation in a community setting ( Health Service Executive, 2018). Utilising a rigorous process consisting of an initial systematic literature review, a two-round Delphi survey on identified metrics, followed by a two-round Delphi survey on associated indicators, and culminating with a stakeholder consensus meeting, 14 quality care process metrics and 69 associated indicators were developed. Some metrics identified pertinent to public health nursing, which may be applicable to general practice nursing included wound assessment and health promotion. Central to the success of this project was establishment of a collaborative, participatory approach between key stakeholders, researchers, clinicians, and educators. This same process was used to determine the QCP-Ms for all other six settings (( O'Connor )

Development of nurse sensitive metrics specifically pertinent to ambulatory care, an equivalent of general practice, is being undertaken in the USA ( Alley ; Mastal ; Start ) The Primary Care and Ambulatory Specialty Institute (PCASI) established in 2016 within a New York area health system, spearheaded an initiative to identify nurse sensitive metrics and develop a data dashboard application to enable recording of ambulatory nurse care interventions. Examples of measures or metrics identified and integrated on the PCASI dashboard include Incidence of (hospital) readmissions, High blood pressure and follow up care screening, Pain assessment and follow up, BMI screening Adult and Paediatric, Controlled hypertension, Uncontrolled Hemoglobin A1c. A telehealth disposition metric was added in response to the implementation of remote nursing care via telephone during the COVID 19 pandemic. The range of metrics identified demonstrate the generalist nature of GPN, ambulatory care nurses.

Method

As outlined by Pollock , scoping reviews map and synthesize research, address broader topics and wide-ranging study designs, report on the depth and extent of the literature, identify knowledge gaps, and is an appropriate methodology to clarify nursing concepts. Given the broad nature of the question posed by this study and taking into consideration the little evidence which exists regarding QCP-Ms use in general practice nursing, a scoping review is deemed the most appropriate methodology. A key aspect of scoping review is the extensive range of literature from both published and grey sources which can be included in the review. This literature synthesis of general practice nursing and QCP-Ms will help to identify what is already known about the topic, it will reveal research deficits and knowledge gaps, informing and enabling future research.

This scoping review will adhere to the five stage framework first described by Arksey & O'Malley (2005) which are:

Stage 1: identifying the research question.

Stage 2: identification of relevant studies.

Stage 3: study selection.

Stage 4: charting the data.

Stage 5: collating, summarising, and reporting the result.

Stage 1: Identifying the research question

Joanna Briggs Institute (JBI) argues that development of the main research question is one of the most important steps to consider and advises using the Population-Concept-Context (PCC) framework to guide this ( Peters ). This review aims to establish a comprehensive understanding of how nursing QCP-Ms have been developed and implemented. It seeks to map the evidence and identify knowledge gaps focusing primarily on nursing in general practice. As usual, objectives will be used to demonstrate the relationship to the principal research question. This review will address the following question.

Research question

What is known about the use of nursing (Population) quality care process metrics (Concept) within general practice nursing (Context) settings?

Review objectives

To map the extent of evidence available regarding nursing QCP-Ms pertinent to general practice nursing, primary care settings within the literature.

To identify methods used to develop general practice nursing quality care metrics and other nursing metrics as appropriate

To ascertain the characteristics of general practice nursing QCP-Ms.

To determine if the literature demonstrates implementation of nursing QCP-Ms in general practice?

Stage 2: Identifying the relevant studies

In accordance with Peters , the PCC framework will be used to develop search terms and align the eligibility criteria with study selection, and the assistance of a research librarian will be enlisted during all stages of this review. This will ensure an appropriate search strategy and database selection is in place ( Pollock ).

This review will consider studies which focus on registered nurses working in general practice and primary care contexts. When discussing general practice nursing in an international perspective it is important to note there is some lack of uniformity in nomenclature ( Annells, 2007; Keleher ). Barrett caried out a comprehensive analysis of job titles and education requirements specific to registered nurses in primary care internationally, this analysis demonstrated the diversity of unofficial terms for GPNs. This lack of uniformity will be addressed by inclusion and recognition of the broad range of terms used internationally when referring to nurses working within general practice, alongside a general practitioner or within family practice and ambulatory care. As established by Barrett “registered nurse” is the most common protected title internationally, this scoping review will consider only GPNs who hold a ‘protected’ nursing title in their relevant country. The scope of this review will be limited to use of metrics in general practice nursing and relevant primary care settings, nurses practicing at all levels including advanced nurse practitioners will be considered.

Nursing quality care metrics are measurements of the quality of nurse performance when providing care to patients. Aligned with care, process metrics are indicators which give a framework within which nursing care can be measured ( Foulkes, 2011). For the purposes of this review, the definitions specific to QCP-Ms and associated process metrics are as follows, “Quality Care Process Metric: is a quantifiable measure that captures the quality in terms of how (or to what extent) nursing care is being done in relation to an agreed standard. Quality indicators associated with metrics are the tools or flags which demonstrate implementation of the nursing process.” ( Health Service Executive (2018) pp.15). Therefore, in the context of this proposed review, a QCP-Ms looks at how and what nursing care processes are being performed by GPNs and what associated indicators were used to measure this care.

Remaining cognisant of the distinctions between primary care and general practice, but to ensure a comprehensive synthesis of the literature, this review will aim to identify a broad scope of peer reviewed literature both published and grey which addresses implementation of nursing QCP-Ms in general practice, or equivalent primary care settings. Selection will be limited to publications in the English language. Conference abstracts will be excluded due to their limited data. The inception of Irish general practice nursing roles began in 1989 with the introduction of a subsidy from government to General Practitioners to support their employment therefore this study will limit itself to literature published since 1989 ( Department of Health, 1989). Table 1 details inclusion and exclusion criteria.

Table 1.

Inclusion and exclusion criteria.

GPN=general practice nurse.

Criterion	Inclusion Criteria	Exclusion Criteria	Rationale
Participants	Registered nurses working in general practice and/or equivalent primary healthcare settings	Non-registered nurses or midwives	The focus of the protocol is on nursing care
Types of articles	Peer reviewed empirical research; including Qualitative, Quantitative, Mixed methods and Action Research studies. Grey literature, academic theses, dissertations, reports. Guidelines and policy documents from Government and recognised professional nursing and medical bodies.	Conference abstracts. Editorials and commentary articles,	To ensure that an extensive search as is reasonable, of available literature has been carried out, in keeping with the ethos of scoping reviews.
Location	All geographical locations.	No restriction.	To examine information from a broad range of locations.
Time Period	Literature published since 1989.	Research published prior to 1989, the initiation of formalised GPN roles in Ireland.	To assess how developments in GPN care processes have evolved over time. This timescale also reflects the first reports of adaptation and introduction of metrics specific to the measurement of nursing quality care.
Language	English language.	Languages other than English.

A three-step process as recommended by JBI will be implemented to carry out a comprehensive search of electronic databases, bibliographic references, key author, relevant journals and grey literature in conjunction with a research librarian ( Peters ).

Step one - carry out a preliminary search of the PubMed to identify papers relevant to the research question. Key words and search terms will be developed from this initial search and adapted to inform the final search strategy.

Step two – a second search across all electronic databases will be carried out using the final search term strategy adopted for each specific database.

Step three - This will be followed by a secondary search of the bibliographic references cited in the included studies.

Utilising the advice and collaboration of a research librarian it is proposed this review will search the following databases. These databases have been selected in view of their extensive repertoire and relevancy to nursing.

Embase

PubMed, Biomedical and life sciences database

CINAHL, Nursing and Allied Health ( CINAHL Plus)

Web of Science

Stage 3: Study selection

An initial search of article titles and abstracts will be carried out by two researchers and a librarian to determine if the search criteria capture data pertinent to the review question. Following this, any modifications to the search strategy will be agreed. Once the search process is completed the identified citations will be imported into the reference management system Endnote X9, with duplicates removed. Covidence software tool will be utilized to carry out screening of citations, abstracts, full text studies and data extraction. Any discordance regarding article selection between initial researchers will be moderated by a third researcher who will review and advise on the article’s eligibility for inclusion.

As JBI ( Peters ) advises, pilot testing will be carried out prior to source selection the framework suggested is as follows.

Random sample of 25 titles/abstracts is selected.

The entire team screens these using the eligibility criteria and definitions/elaboration document.

Team meets to discuss discrepancies and make modifications to the eligibility criteria and definitions/elaboration document.

Team only starts screening when 75% (or greater) agreement is achieved.

In keeping with JBI guidance the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for scoping reviews checklist (PRISMA-ScR) will be used to report the process of study selection ( Tricco ).

Stage 4: Charting the data

In order to ensure selected articles are in keeping with inclusion and exclusion criteria charting of data will be undertaken using a data extraction document as recommended by JBI ( Peters ). This document will be created using Microsoft Excel software using the JBI data extraction tool template. It will be piloted for applicability to this study by two researchers and amended as necessary.

The proposed extraction document criteria for this study will include but will not be limited to the following: Article title; Authors; Journal; Publication date; Methodology; Location of Study; Population; Context; Concept and Key Findings applicable to review question identified? Examples of key finding would include, methods used to develop nursing process metrics, implementation and characteristics of identified general practice nursing metrics.

Stage 5: Collating, summarising, and reporting the results

Inconsistent approaches in reporting scoping review findings have been highlighted by Bradbury-Jones who have addressed this issue by developing the PAGER framework for improving the quality of scoping review reporting. The acronym PAGER refers to Patterns, Advances, Gaps, Evidence for Practice and Research recommendations. Therefore, to ensure careful and complete reporting of findings this methodology will be applied to reporting of this review. Initially a ‘Patterning chart’ outlining key themes discovered during this review will be generated. Following on from this, reflective questions posed for each domain will be utilised to amplify findings and strengthen the quality of reporting of this review. Extracted data will be described in a thematic narrative report also providing a numerical analysis of the extent and nature of the identified studies. Reporting of this scoping review will utilise the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for scoping reviews (PRISMA-ScR) ( Tricco ), and a flow diagram will also be produced to chart the process.

Study status

At the time of publication of this protocol the study is at Stage 2, piloting and refining of search terms have begun.

Discussion

The importance of reflecting on the rationale and motivation of any scoping study and not only the methodological process is highlighted by Levac . The key concept leading to this review is that nurses have an important, albeit hidden role in general practice. If the role is to be optimised analysis to clearly ascertain quality, value and outcomes is required. The literature on nurse metrics primarily focuses on inpatient or secondary care settings as Griffiths has indicated, this review will provide insights into the use of nursing QCP-Ms within general practice, a primary care setting. This evidence synthesis will inform the next part of a research study, which is identification, development, and refinement of relevant general practice nurse QCP-Ms. A limitation of this scoping review is that it does not include quality assessment of included studies but utilising the PAGER framework for reporting will ensure a consistent clear approach to analysis and reporting of the review. A strength of the review is its unique nature and potential value in enabling meaningful data to articulate the contribution of GPNs to quality patient care. Dissemination of findings will contribute to the literature, and will be of value to nursing authorities, general practitioners, policy makers and academics who seek to develop and strengthen primary care. Findings of this scoping review will be submitted for publication in a peer reviewed journal, made available electronically and presented at conferences.

Data availability

No data are associated with this article.

Revisions are appropriate.

Is the study design appropriate for the research question?

Partly

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Partly

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Primary care/family practice nursing

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

The authors have adequately addressed my comments and justified their reasoning. As always, resources determine what can and cannot be done with regard to research and choices must always be made. I believe the paper is much improved after peer review and am happy to recommend the paper be indexed in its current form.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Health services research, primary care, patient and public involvement, co-production, health experience

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

This work aims to inform the development of quality care metrics (QCM) to measure the work of general practice nurses in Ireland. This is a novel application of QCM in Ireland. It has been adopted for use in acute care services, children’s services, intellectual disability services, older person services, mental health services, public health nursing services, and midwifery services, but not for general practice.

This is a topic of value as primary care is the foundation of a successful healthcare system and general practice plays an important role in providing care and support to a diverse range of patients and their families and carers. The expanding scope of general practice nurses in line with increasing workforce demands requires monitoring and assessment to ensure the quality of care.

A scoping review is an appropriate first step to inform how to target future research on this topic and determine if it is needed. The introduction reads well, however, it could benefit from expansion to briefly consider the international situation (role of GPNs) as you will be drawing on their experiences in your literature search.

In the Methods, I suggest you use the version of Arksey and O'Malley enhanced by Levac  et al.  that adds a sixth step, consulting relevant stakeholders (e.g. GPNs), which adds to rigour. I find this can be valuable as it incorporates the expertise of stakeholders and aids validation of the findings. If you do this, you will need to identify stakeholders you plan to consult and how you will collect, analyse and integrate the data in your work.

There is no mention in the methods about the type of studies to be included (e.g qualitative, quantitative, mixed methods) and how you will determine whether to include a mixed-methods study. This needs further explanation in the manuscript.

Also, how will you assess the quality of included studies? For example, CASP for qualitative studies, MMAT for mixed-methods. There are many options. This needs further explanation in the manuscript.

I think it would be useful to reflect on the strengths and limitations of the study. For an example of a relevant protocol that incorporates this, see Jolley  et al. .

Stage 5: typo “methodology”.

As per Reviewer 1, you might like to consider using Covidence software if you have access to it for organising your results and screening as it enables multiple reviewers to work together https://www.covidence.org/.

Study status: I find it a little odd that the study has begun as it is a protocol. I respect your honesty but it is confusing because you now have search terms finalised, etc.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Health services research, primary care, patient and public involvement, co-production, health experience

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

We are very grateful for your time and expertise in reviewing this scoping review protocol. Amendments have been made in view of your insight and suggestions. We have replied to your comments, numbered below.

1. The introduction reads well, however, it could benefit from expansion to briefly consider the international situation (role of GPNs) as you will be drawing on their experiences in your literature search.

Thank you for highlighting this, discussion and references regarding international studies have been included in the Introduction section of the review. We agree that this gives a broader understanding of the importance of the role and its relevance to changing healthcare policy focus worldwide. As outlined in a response to a previous review, international research draws attention to the positive impact and potential of the role, but also identifies barriers to progress and the need for research to inform the future of nursing in general practice.

2. In the Methods, I suggest you use the version of Arksey and O'Malley enhanced by Levac et al.1 that adds a sixth step, consulting relevant stakeholders (e.g. GPNs), which adds to rigour. I find this can be valuable as it incorporates the expertise of stakeholders and aids validation of the findings. If you do this, you will need to identify stakeholders you plan to consult and how you will collect, analyse and integrate the data in your work.

This is a very important aspect of the review that the research team considered at length. As the primary reviewer is self-funded and limited by resources and time due to clinical work commitments, it was agreed to continue with the 5 stage model for the protocol. This may be open to reevaluation when advancing to the full scoping review.

3. There is no mention in the methods about the type of studies to be included (e.g qualitative, quantitative, mixed methods) and how you will determine whether to include a mixed-methods study.

We propose to include the following types of study designs. Peer-reviewed empirical research, including qualitative, quantitative, mixed methods, and action research studies. This is appropriate to the broad nature of scoping reviews within which study quality or methodological limitations are usually not appraised 1. This is outlined in Table 1. Inclusion and exclusion criteria.

4. How will you assess the quality of included studies?

It is our understanding that scoping reviews do not seek to report on the quality of evidence as reported by Munn 1 and referred to in point 3 above. However, the PAGER framework for improving the quality of scoping review reporting will be used to ensure a consistent clear approach to analysis and reporting of the review findings 2.

5. It is useful to reflect on the strengths and limitations of the study.

We have included reflections on the strengths and limitations of this protocol in the discussion section of the document.

6. Stage 5: typo “methodology”.

Thank you – this is corrected.

7. Consider using Covidence software?

We have now proposed the use of Covidence, this is referenced in the ‘ Stage 3: Study selection’ section of the document.

8. I find it a little odd that the study has begun as it is a protocol. I respect your honesty, but it is confusing because you now have search terms finalised, etc

Apologies for any confusion caused regarding the stage of the study. The review is currently in a preliminary phase; to date refinement of the scoping document based on reviewer commentary is being undertaken. Liaison is taking place with a librarian and piloting of search terms is being carried out to ensure an appropriate search strategy is in place for the full review.

References.

1.  Munn, Z., et al., Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 2018. 18(1): p. 143.

2.  Bradbury-Jones, C., et al., Scoping reviews: the PAGER framework for improving the quality of reporting. International Journal of Social Research Methodology, 2021: p. 1-14.

This is a novel and important scoping review which aims to inform development of quality care metrics (QCM) within Irish general practice settings.

This is a topic that will be attractive to an international reader. Within your Introduction, please broaden the discussion beyond Irish general practice/GPNs, e.g. what about this role in other countries such as Australia, Canada, New Zealand?

Within abstract, if there is space within journal guidelines/word restrictions, additional details regarding the methods should be provided, e.g. anticipated date of search.

Is there a difference between ‘quality care process metrics’ and ‘QCM’? These are both used interchangeably in the manuscript. I recommend being consistent.

With respect to your search strategy, did you consider search PsycINFO, Embase, Joanna Briggs Institute (JBI) Library of Systematic Reviews, and/or ProQuest Dissertations and Theses? It is possible that relevant nursing literature might be located within these databases. Will you conduct key author/journal searches?

Under ‘Eligibility of population or types of participants’, Barret et al.'s (2021 )  article may be useful when discussing lack of uniformity in nomenclature.

What types of study designs are considered for inclusion? You mention broad scope of peer reviewed literature and that conference abstracts will be excluded. However, I do not see anything specifically referring to study type/design.

Are you able to provide examples of quality care metrics?

Please clarify if advanced practice nurses/nurse practitioners or other classes of registered nursing are included/excluded within your review.

One of your objectives is to examine the use of QCM in providing advantages for patient outcomes and/or service delivery – however, your inclusion/exclusion criteria do not include anything related to reporting of outcomes within studies. Also, wouldn't this objective lend itself to a systematic review rather then a scoping review?

Have you considered using Covidence (or similar software) to manage references/screening process?

Please comment on how the quality of studies will be assessed.

Is the study design appropriate for the research question?

Partly

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Partly

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Primary care/family practice nursing

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

We are very grateful for your time and expertise in reviewing our scoping review protocol, your critique is constructive and valuable. The scoping review has been revised in response to your review. We have replied to your comments, numbered below.

1. Within your Introduction, please broaden the discussion beyond Irish general practice/GPNs, e.g. what about this role in other countries such as Australia, Canada, New Zealand?

Your suggestion to broaden the discussion to include an international context has strengthened the arguments in favour of carrying out this review. The international dimension has been addressed in the Introduction section with the addition of relevant articles which outline important findings regarding general practice nursing. This research draws attention to the positive impact and potential of the role, but also identifies barriers to progress. These studies highlight many common themes of an impactful but invisible, undervalued workforce, requiring leadership and robust research which will inform policymakers and healthcare strategists.

2. Within abstract, if there is space within journal guidelines/word restrictions, additional details regarding the methods should be provided, e.g. anticipated date of search

Unfortunately, the constraints of the word count preclude this.

3. Is there a difference between ‘quality care process metrics’ and ‘QCM’? These are both used interchangeably in the manuscript .

Thank you for noting this. Quality care metrics is a broad term that may include three types of healthcare quality assessment: structure, process, and outcomes. This is discussed in the ‘Nursing Quality Care Process Metrics’ section of the review. Quality care process metrics (QCP-Ms) measure specifically the quality of care delivered by nurses. This concept has now been clarified, addressed, and integrated into the title and throughout the document. A working definition of quality care process metrics (QCP-Ms) is included within the  ‘Stage 2: Identifying the relevant studies, Concept’ section of the document.

4. With respect to your search strategy, did you consider search PsycINFO, Embase, Joanna Briggs Institute (JBI) Library of Systematic Reviews, and/or ProQuest Dissertations and Theses?

As a self-funded researcher, limitations of resources & time would not allow searching all these databases; however, we have included Embase and Web of Science. Cochrane database is indexed on PubMed and Web of Science, therefore any relevant studies will be identified within these databases and included in the review.

5. Will you conduct key author/journal searches?

Yes, reference to this is included in section ‘Stage 2: Identifying the relevant studies’.

6. Under ‘Eligibility of population or types of participants’, Barret et al.'s (2021)  article may be useful when discussing lack of uniformity in nomenclature.

Thank you for highlighting this excellent, research paper. Findings from this paper have been integrated and included within the ‘Eligibility of population or types of participants’ section of the review.

7. What types of study designs are considered for inclusion?

We have now clarified and will include the following types of study designs. All peer review empirical research, qualitative, quantitative, mixed methods, and action research studies will be included in this review. See Table 1. Inclusion and exclusion criteria.

8. Are you able to provide examples of quality care metrics?

Thank you for this suggestion. We have in version 2 of the review. We included examples of quality care metrics from public health nursing which may be relevant to general practice nursing. We have also included examples of metrics developed for ambulatory care nurses in the USA. See the section titled ‘Nursing Quality Care Process Metrics’.

9. Please clarify if advanced practice nurses/nurse practitioners or other classes of registered nursing are included/excluded within your review.

Research involving all classes of registered nurses will be included in this scoping review, including advanced nurse practitioners. This is now clarified in the ‘Eligibility of population or types of participants’ section.

10. One of your objectives is to examine the use of QCM in providing advantages for patient outcomes and/or service delivery – however, your inclusion/exclusion criteria do not include anything related to reporting of outcomes within studies. Also, wouldn't this objective lend itself to a systematic review rather than a scoping review?

Thank you for highlighting the potential difficulties surrounding reporting outcomes in this scoping review. We have considered your comments and agree with your observations re scoping v systematic review. Therefore outcome reporting has been omitted from the objectives of this review.

11. Have you considered using Covidence?

​​​​​​​We will use Covidence, and this is referred to in the  ‘Stage 3: Study selection’ section of the document.

12. Please comment on how the quality of studies will be assessed.

It is our understanding that scoping reviews aim to map the extent of evidence and do not seek to report on the quality of evidence as referred to by Munn 1. However, the PAGER framework for improving the quality of scoping review reporting will be used to ensure a consistent clear approach to analysis and reporting of the review findings 2.

References.

1.  Munn, Z., et al., Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 2018. 18(1): p. 143.

2.   Bradbury-Jones, C., et al., Scoping reviews: the PAGER framework for improving the quality of reporting. International Journal of Social Research Methodology, 2021: p. 1-14.