Literature DB >> 36251653

General practitioner perspectives on factors that influence implementation of secondary care-initiated treatment in primary care: Exploring implementation beyond the context of a clinical trial.

Clair Le Boutillier1,2, Haroon Ahmed3, Vishal C Patel4,5,6, Mark McPhail4,5, Ben Carter7, Christopher Ward8, Vanessa Lawrence1.   

Abstract

BACKGROUND: The Beta-blockers Or Placebo for Primary Prophylaxis of oesophageal varices (BOPPP) trial is a 3-year phase IV, multi-centre clinical trial of investigational medicinal product (CTIMP) that aims to determine the effectiveness of carvedilol in the prevention of variceal bleeding for small oesophageal varices in patients with cirrhosis. Early engagement of General Practitioners (GPs) in conversations about delivery of a potentially effective secondary care-initiated treatment in primary care provides insights for future implementation. The aim of this study was to understand the implementation of trial findings by exploring i) GP perspectives on factors that influence implementation beyond the context of the trial and ii) how dose titration and ongoing treatment with carvedilol is best delivered in primary care.
METHODS: This qualitative study was embedded within the BOPPP trial and was conducted alongside site opening. GP participants were purposively sampled and recruited from ten Clinical Commissioning Groups in England and three Health Boards across Wales. Semi-structured telephone individual interviews were conducted with GPs (n = 23) working in England and Wales. Data were analysed using reflexive thematic analysis.
FINDINGS: Five overarching themes were identified: i) primary care is best placed for oversight, ii) a shared approach led by secondary care, iii) empower the patient to take responsibility, iv) the need to go above and beyond and v) develop practice guidance. The focus on prevention, attention to holistic care, and existing and often long-standing relationships with patients provides an impetus for GP oversight. GPs spoke about the value of partnership working with secondary care and of prioritising patient-centred care and involving patients in taking responsibility for their own health. An agreed pathway of care, clear communication, and specific, accessible guidance on how to implement the proposed treatment strategy safely and effectively are important determinants in the success of implementation.
CONCLUSIONS: Our findings for implementing secondary care-initiated treatment in primary care are important to the specifics of the BOPPP trial but can also go some way in informing wider learning for other trials where work is shared across the primary-secondary care interface, and where findings will impact the primary care workload. We propose a systems research perspective for addressing implementation of CTIMP findings at the outset of research. The value of early stakeholder involvement is highlighted, and the need to consider complexity in terms of the interaction between the intervention and the context in which it is implemented is acknowledged. TRIAL REGISTRATION: ISRCTN10324656.

Entities:  

Mesh:

Substances:

Year:  2022        PMID: 36251653      PMCID: PMC9576064          DOI: 10.1371/journal.pone.0275668

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.752


Introduction

Liver disease is the third commonest cause of premature death in the United Kingdom and is rising in incidence [1]. Portal hypertension is caused by cirrhosis, and variceal haemorrhage (VH) is a common complication associated with portal hypertension. While the management for varices and variceal haemorrhage has markedly advanced over the past decades, the mortality rate of acute VH is 10%-20% [2]. Prevention of VH is therefore vital in those who have varices. Non-selective beta-blockade (NSBB) has been found to reduce the rate of progression to bleeding or progression to larger varices when initial variceal size is moderate-large varices (>5mm in diameter) [3]. The Beta-blockers Or Placebo for Primary Prophylaxis of oesophageal varices (BOPPP) trial is a 3-year phase IV, multi-centre randomised controlled trial (RCT) that aims to determine if there is a benefit of using carvedilol in the prevention of variceal bleeding for those patients with small oesophageal varices (OVs). Carvedilol treatment for VH is by endoscopic criteria, assessed following detection of small OVs at gastroscopy. Where required the dose will be up- or down- titrated at clinician discretion, or if the patient reports side effects. Surveillance endoscopy will be undertaken annually. NSBBs are low cost, easy to administer, and do not require specific management expertise. The aim is for dose escalation to be managed in primary care after the trial is completed. This qualitative study explores General Practitioner (GP) perspectives on factors that influence implementation beyond the context of the trial and investigates how the treatment is best delivered in primary care. Early involvement of GPs on their views of dose-titration and management of carvedilol provides insights for future implementation, fosters future engagement, and creates an opportunity to enhance the secondary/primary care interface.

Methods

Ethical approval was obtained from the York and Humber (Leeds West) Research Ethics Committee and the Health Research Authority (REC reference 19/YH/0015).

Study design

The study used qualitative methodology to provide insights into the complexities of implementation beyond the context of the trial. Semi-structured individual interviews were conducted to gain an understanding of the barriers and facilitators to implementation in primary care. GP participants were recruited from ten Clinical Commissioning Groups (CCGs) in England and three Health Boards across Wales, chosen to provide a mix of different regions and practice size. GPs were selected purposively on the basis that they could offer a particular perspective, that is, as members of the Royal College of General Practitioners, on implementation in primary care. GPs were not recruited on their level of knowledge or experience of managing cirrhosis because the research focused on routine implementation beyond the context of a clinical trial. Potential GP participants were first approached by the local NIHR Clinical Research Network (CRN) Research Delivery Manager or local contacts, and subsequently recruited by the lead author via telephone or email. Informed verbal consent to enter the study was sought from each participant only after a full explanation and information leaflet was given and time allowed for consideration.

Data collection

Interviews used open-ended questions to offer the opportunity to share opinions, and to gather a rich understanding of GPs’ perspectives. The interview schedule was informed by existing implementation literature and earlier qualitative research that explored patient and secondary-care provider perspectives on barriers and enablers associated with the proposed intervention [4]. Interviews explored GP views on the acceptability of the carvedilol treatment as well as possible barriers and enablers associated with implementation in primary care (i.e., concerns around dose titration, optimal timing of primary care involvement, the role of other primary care professionals (e.g., community pharmacists and practice nurses), and the information, support and infrastructure required to enable success). The interview schedule was revised iteratively in response to the priorities and concerns of participants. The interview schedule is included in Online Data Supplement 1. Interviews were conducted by telephone and were audio recorded and transcribed verbatim. With participant consent, the audio-files were transcribed by an external transcription company, who are an existing King’s College London supplier, and who signed a confidentiality agreement. Interviews were conducted by the lead author between October 2020 and April 2021. GPs were re-imbursed for their time.

Data analysis

Inductive reflexive thematic analysis was used for data analysis [5,6]. This deliberate and systematic process aims for depth in the interpretation of the data, where codes evolve through a dual process of thorough engagement and distancing. Researcher subjectivity is an integral component of analysis, and a reflexive diary was kept throughout the study to consider interactions with participants, to detail initial thoughts or assumptions, and to record developing insights [5]. Data analysis began with case-by-case repeated reading of interview transcripts and re-listening of sound files to become immersed in the data. This was followed by line-by-line coding, where individual extracts were grouped under one or several codes. Each code was refined, and where data and interpretation allowed, further codes were developed. Visual maps were used to cluster codes according to connections in the data by considering the patterns between them [7]. An initial coding frame was developed, and analysis was then undertaken to group the codes into overarching themes and sub-themes, that is, shared ideas or concepts. Refinements to the specifics of themes, and thematic patterns continued until a useful and meaningful analysis was achieved. Thematic saturation occurred when the themes had been fully explored and new data was easily accommodated within them [5]. Data analysis occurred using NVivo QSR International qualitative analysis software (version 12). The lead author directed the analysis. Themes were reviewed by two additional raters (HA and VL) to provide an opportunity to reflect on the coding approach, and to enhance the interpretive depth of the data [5].

Results

Participants

A total of 23 individual interviews were conducted. GP characteristics are shown in Table 1.
Table 1

Participant characteristics.

n (%)GPsn = 23
Gender Male Female 15 (65.2) 8 (34.8)
Age 31–40 41–50 51–60 61–7010 (43.5)10 (43.5)2 (8.7)1 (4.3)
Time since qualification     0–2 years     2 years + -5 years     5 years + -10 years     10 years + -15 years     15 years + -20 years     20 years + -25 years     25 years +1 (4.3)4 (17.4)6 (26.1)7 (30.5)2 (8.7)2 (8.7)1 (4.3)
Time in current post     >6 months     6–24 months     2–5 years     5–10 years     10–15 years     15–20 years     20–25 years     30 years2 (8.7)3 (13.1)6 (26.1)5 (21.7)4 (17.4)0 (0.0)2 (8.7)1 (4.3)
Ethnicity     White British     White Other     Asian/Asian British-Indian     Asian/Asian British-Pakistani     Asian/Asian British-Other     Mixed. White & Asian     Mixed. White & Black African     Not otherwise specified11 (48.1)2 (8.7)5 (21.7)1 (4.3)1 (4.3)1 (4.3)1 (4.3)1 (4.3)
Current geographical area of work London & South East East Anglia East of England South West Midlands North West Wales7 (30.5)1 (4.3)1 (4.3)2 (8.7)3 (13.1)1 (4.3)8 (34.8)
Participants were recruited via nine CRN sites in England and through local contacts in Wales. Of the participants contacted by the researcher (CL), 74% agreed to take part. 26% of those invited to take part did not respond to the invitation. One participant was able to share their previous experience of being asked to prescribe carvedilol for small OVs. The mean duration of the interviews was 19.5 minutes with the time ranging between 12–32.5 minutes. Five overarching themes were identified. Most participants felt that primary care is best placed for oversight. The second theme, a shared approach led by secondary care, refers to the recommended pathway to implementation and a desire to feel supported and to deliver the intervention as a part of a wider team. This is complemented by the third theme, empower the patient to take responsibility. The fourth theme, the need to go above and beyond, represents the potential barriers and challenges to implementation and the final theme, develop practice guidance, refers to the specific information and training requirements requested by GPs to enable implementation. Involving GPs in conversations about delivery of a potentially effective treatment at the outset was also identified as a facilitator to implementation: I think it is really good that you are speaking to GPs early, because I think the risk, in terms of ensuring that this is implemented if indeed the trial is successful, I think it is really important … if [GPs] are going to be having these dose titrations and discussions, I think it is really important to have them engaged early on. Because otherwise I think it creates a further barrier if you come when the trial finishes and you are trying to then almost push this into primary care, then there may be more apprehension in doing it. So, I think that is a really positive thing. K64 Due to word limitations, the overarching themes are reported in this paper. The full coding framework (including sub-themes) is available in ODS 2, and a visual illustration of themes and their relationships is included in ODS 3.

Theme 1: Primary care is best placed for oversight

While the proposed treatment is secondary care-initiated, almost all GPs felt that primary care is best placed to provide oversight, and that the request to manage carvedilol in primary care fitted with the ethos of proactive general practice. This corresponds with GP descriptions of preventative medicine as core work for primary care. The need to reduce risks of untreated varices was acknowledged, with improved quality of life, reduced demand for healthcare further up the system, and cost savings identified as benefits of implementation: … if by picking it up means that there’s an impact to the patient’s life… if it means that there’s an impact to cost implications for that patient’s healthcare as well, so if there are multiple benefits to doing this and managing this in the community early… then obviously everyone would be up for that. K66 GPs went on to explain how they deliver holistic care by working with the whole person within the wider context of their environment. They explained that patient discussions that balance risks and benefits of treatment and take account of other health conditions are a part of day-to-day primary care practice. They reported that discussions around treatment for varices would fit within this scope: …having those pragmatic discussions, risks versus benefits, taking into account other health conditions. Obviously, GPs, we do that day in, day out, whereas specialists focus on their area. So, in terms of having that holistic all-round view, I think GPs are best placed. K64 GPs also identified themselves and general practice as a constant in patients’ lives. GPs reported that they have existing and often long-standing relationships with their patients, beyond those in secondary care, and these relationships can also be used to support patients in their treatment. GPs went on to explain the structure of the system whereby they can draw on the skills of health care practitioners within their Primary Care Network (PCN) to support oversight: GPs would probably be the person to oversee this all, but there might be other people… if you’ve got a community pharmacist, they’re invaluable as well (K71). Another explained, how the team can draw on existing systems, processes and expertise of other clinicians within the network to support implementation. For example, pharmacists or nursing staff might monitor blood pressure and check the heart rate of those people taking carvedilol and refer this information to the GP: The nurses are very good at monitoring people, because the thing that would have to be monitored would be the blood pressure, so I think they could just treat it in exactly the same way they treat monitoring the blood pressure for a beta-blocker that they’re on for another reason. They’re aware of what normal blood pressure limits are. So, they can come in and see the nurse and then [the nurses have] got avenues to ask us for opinions, if that blood pressure is out of range. K72 They went on to explain that, for many patients, the varices treatment would fit into existing review processes. GPs reported that the request to monitor medication in primary care is not new and is recognised as part and parcel of patient management. GPs explained that medication reviews are standard practice with established pathways, and that starting new medication is something that happens all the time: People get discharged from hospital all the time on new medications. An ACE inhibitor, for example, they get started on a low dose and we need up titrate them. This is something that we do all the time. So, there’s no reason why it can’t work. K57 Alongside, GPs explained that beta blockers are commonly used and usually well-tolerated safe drugs. This familiarity means that GPs can build on their experience and knowledge of how beta blockers work in different situations.

Theme 2: A shared approach led by secondary care

While most GPs felt that primary care is best placed for oversight, they explained that partnership working, and a shared approach would best support implementation and workload management. GPs outlined a recommended practice pathway to facilitate safe and effective ongoing care, to support GP confidence in managing the clinical request, and to minimise the burden on primary care. Overall, GPs felt that is would be most helpful for secondary care to initiate treatment after the OVs have been identified. This would also allow patients to ask the specialist questions before their care was transferred to primary care: … I think definitely if it had been started in secondary care, that would be helpful, if only because the patient had already been primed with some knowledge about what was the plan and why was the plan, and why it was recommended and so on. And also, to give me a steer on starting doses and up-titration from there. K70 Another GP stated that an approach like shared care would be helpful and that it would ideally be a joint decision to prescribe to ensure patient safety: There are shared care agreements for prescribing certain drugs whereby we’re sent something to sign, and consultant says he’s taking responsibility for this part of it, and we take responsibility for other parts. K77 GPs went on to explain that stabilising the dose in secondary care would also provide time for primary-secondary care communication and for organising the medication supply. One GP explained an approach whereby secondary care transferred care after a 14-day dose adjustment period. GPs explained that the handover from secondary care needs to be clear, and communication is required to ensure there is a plan that explicitly states the actions required from general practice, ‘So, just really explicitly putting the plan, we’ve told the patients to do this, and that it’s not too much work for the GP’ (K72). GPs also spoke about the need to have alerts set up for monitoring as well as a direct point of contact to access back-up secondary care support and advice because they have the specialist knowledge about starting the medication: …having the back-up from the specialist that’s involved to know that what you’re doing is accepted practice and, it’s hopefully relatively safe and effective because, when it really boils down to it as a GP, you just want to know that you’re doing your best for somebody in a manner that’s safe and doing what’s expected, shall we say. K56

Theme 3: Empower the patient to take responsibility

Empowering the patient to take responsibility was identified as a theme that complements the shared approach led by secondary care. GPs spoke about the value of prioritising patient-centred care and involving patients in taking responsibility for their own health. However, GPs acknowledged the time and resources it can take to engage patients in their care and the impact that engagement can have on medication reviews: …it can be a bit haphazard when you review patients on medication and this particular group of patients are potentially not great at coming in for medication reviews and stuff like that. So that’s a challenge. K58 Another GP went on to speak about the need to acknowledge the impact of the often-social needs (e.g., alcohol use, of no fixed abode) of this patient group: … in this group of patients are they going to turn up for their medication treatment? Are they going to take the medication regularly? Is there going to be risk to the patient if they take it intermittently rather than regularly?… So, it’s a lot of that context behind monitoring the drug that might be specific to this group of patients which wouldn’t be specific to maybe patients coming in for their hypertension monitoring or heart disease, for example, it might just have different issues. K60 To support patient engagement, some GPs identified the need to discuss the pros and cons of treatment options, with the possible use of decision aids, with patients in order to share decision making. These patient conversations provide an understanding as to why the treatment is being offered, and promote involvement in self-managing health. GPs reported this as particularly important when working with people who are asymptomatic and sometimes reluctant to add another drug with possible side-effects: … discussions about prophylactic treatment that I’ve had with patients, you’re just really trying to work out for the patients themselves what are the benefits. So… what’s the risk of my varices getting worse or bleeding, versus what are the risks of me taking this treatment. K60 GPs identified the need for patient education and explained that a patient information leaflet would be helpful to outline the value of the treatment in preventing oesophageal bleeding: I think with patients, and especially alcoholics and those suffering from oesophageal varices, it is a pretty horrific thing to happen when they have a bleed. And education to the patient around the importance of taking the betas… if I was a sufferer, I wouldn’t need much encouragement to take them because I know the consequences of dying in that way. So, some patient education material that quite graphically illustrates to them the benefits of taking it might work. K57 One GP explained that it would be helpful for the patient to receive a copy of the letter from secondary care to promote a sense of responsibility (and to reduce GP workload) and to advise them to contact their GP for monitoring follow-up: … quite often we’ll get a letter from secondary care saying, “Please [see] the patient” … and that’s very difficult because it involves us having to get in touch with the patient to tell them, “Please can you come…”. It’s a lot easier if a letter subsequently goes to the patient as well saying, “We’ve spoken to your GP. Please can you make an appointment to make this happen”. That places the burden onto them to get it done. K57 Some GPs explained that other services involved in the person’s care could also be involved in monitoring: …if you diagnose people with varices and they have a chaotic lifestyle and they don’t come and don’t engage with GPs then it’s a matter of you start the medication and how are you doing to monitor it… you do have other community services like we have the GDAS (drug and alcohol service) [and] mental health, they would be better placed to give a bit of advice in addition to all the other things. K63

Theme 4: The need to go above and beyond

The most common reported barrier to implementation was the potential that involvement would mean this is additional work above and beyond what is seen as normal GP work (K76). Approximately half of all GP participants felt that primary care would be reluctant to take on this request for monitoring because it would create extra work and I think that one of the barriers is already adding to a particularly busy workload (K64). GPs explained that while there are existing systems to manage new treatments, it is also important to remain mindful to the capacity of general practice because of an increasing workload that’s been devolved from secondary care (K77). In relation to this, concerns were also raised about how GPs might find a way to prioritise the treatment strategy: you feel like there’s just always 100 plates you’re spinning… and different drugs and different treatments are fighting to be heard in terms of becoming normal practice… I’ve worked in a gastroenterology department, and I can appreciate how, in the world of gastroenterology if this becomes the new exciting thing then that’s quite exciting. But obviously with my GP hat on, gastroenterology is one small part of what feels like hundreds of different things that we’re trying to stay on top of. K56 On the contrary, one GP explained, it’s not going to completely overload GPs because there probably aren’t many patients (K72). This infrequent need to monitor varices was also seen as a barrier to implementation. One GP spoke about the influence of irregularity on implementation and questioned the relevance of the treatment to their practice because varices are not a common problem. They went on to explain, in all the time I’ve worked, I’ve probably [seen] two patients with oesophageal varices (K67). For another GP, the irregularity and unfamiliarity prompted concern around the amount of time it would take to monitor the treatment: We don’t see these kinds of things that often, so when you do have a patient and you’re monitoring them, and following them through, initially it’s a bit more intensive, because you’re having to get up to speed with whatever the monitoring process is… Because it’s not like, a big part of day-to-day practice. K62 Three other GPs went on to state that the unfamiliarity, and their limited experience and knowledge in the area would influence their confidence of managing varices in primary care: And, if I’m honest, because we do it so infrequently, there’d be a part of me that would feel a bit anxious about doing things beyond my capabilities. K66 One GP felt that due to the specialist nature of the request, management should remain in secondary care: I think the absolute ideal is nurse led service at the hospital. That’s ideal. Then the risk is taken away from general practice… I think this is a specialist condition and I think … there’s a major gain to be made that if we can find a medication that destresses. So, I think this is something that you don’t want to really want to risk someone not having enough specialist advice on. It’s a condition that probably needs specialist management. K74 A financial incentive was seen as a facilitator for titration to take place in primary care; six GPs spoke about the need for financial reimbursement because they are going above and beyond to support varices treatment in primary care: …it’s an element of remuneration for that work because the set-up within general practice being private businesses, there’s those conflicting elements of clinical as well as, is this going to be seen as part of a GP’s normal general medical services contract, or is this above and beyond what we would normally expect GPs to be doing? K76 On the other hand, one GP stated, I don’t think it would be a huge resource implication, but you will of course have GPs that feel that any additional workload ought to be funded (K77). Another GP explained how the paperwork for funding needs to be proportionate to the number of patients being seen: We have the same thing with coeliac disease, they have these long protocols for relatively few patients, and the claims process and paperwork related to that, it was more laborious than the income. And so, it’s the numbers that were important. Although every little bit helps, it’s just about being sensible, I think. K65

Theme 5: Develop practice guidance

GPs spoke about specific information and training requirements that would support implementation. GPs requested a clear management plan with instructions from secondary care that outlines what to do and how to do it, individualises the dose titration/monitoring needs for each patient and is integrated into the patients notes. Additionally, GPs requested guidance and information on how frequently blood pressure and pulse monitoring is required along with the acceptable thresholds: As long as we’ve got clear guidance as to this blood pressure’s acceptable, you can go up to this dose. I think, we do titrate up in other beta blockers in general practice ourselves anyway. But as long as it’s clear guidance as to what the schedule is for titrating up it’s doable in general practice… I don’t think it would be that much of a challenge. K73 Alongside, some GPs requested information on risk reduction: So having clear information from the study on what the relative risk reduction and the absolute risk reduction in patients would be vital, not just saying, “Oh this benefits patients”. You want to know well by how much? And is that a relevant population to the population that I’m seeing. K78 One GP suggested that an online link to more information (i.e., the evidence base) or a link to a dedicated website could be included within the secondary care letter. Another explained the need to include the important information on the first page of the letter: …if you sent a letter with these kind of instructions in them, I think they should be very clear and ideally on the first page because as one of the things we have to do as GPs is look through a lot of letters. And a lot of letters have no information… they’re updating us and things like that… Just because of the workload pressures and just trying to get through the letters as quickly as possible. So, I think if the letter has things to do I think it should be clearly stated early on, in bold, GP action, and then this. And then you can have the detail of the letter after it. K75 Some GPs felt that the evidence base could be reported and included in NICE and/or British Society for Gastroenterology or Hepatology guidance, BNF, and added to an existing online guideline repository: there’s something locally that’s been developed in the last year, it’s called health pathways… in that lots of secondary care doctors are writing specific guidelines for primary care, so that it is just quite easy to access, it’s online, it’s a repository of guidelines that we follow, and it’s a great first point of resource for us. K62 Additionally, some GPs felt that a medication pathway could be developed for commissioning: There might be a discussion to be had… there’s a medicines group for each CCG. It might be worth having a discussion about how they perhaps could safely monitor these in the community. K71 GPs also highlighted the need to be aware of information patients had received to support ongoing care, and to involve patients and health care professionals in decision aid development: If you go down the route of decision aids or anything like that, then because the decision aid is obviously a shared decision, it’s two parties involved, then I think having patients involved would be crucial. But also, the healthcare professionals that are going to have that discussion, it would be really useful to get both perspectives. K64 Some GPs felt that with the right information, training might not be necessary. Others felt that optional training would be helpful, depending on their experience and confidence. Online training was identified as quick, easy, and accessible: I think the training for this sort of thing would work best as an e-module with a pre-assessment test [to] measure knowledge as it stands, and then taking you through an evidence-based guideline, illustrated with case scenario-type issues, and then a post-module assessment at the end, just to check my understanding, my learning. I can imagine that working for this kind of thing. K70

Discussion

The aim of this study was to explore GP perspectives on factors that influence implementation of secondary care-initiated treatment trial findings into routine primary care. Our inductive approach to analysis found five overarching themes: i) primary care is best placed for oversight, ii) a shared approach led by secondary care, iii) empower the patient to take responsibility, iv) the need to go above and beyond, and v) develop practice guidance. Implementation studies typically classify interventions as events in systems and identify factors that impact uptake across multiple levels of healthcare, including patient, provider, organisation, and policy levels [8,9]. We use the Consolidated Framework of Implementation Research (CFIR) to frame our findings, where four of the five CFIR domains are represented: characteristics of the individual (primary care is best placed for oversight), outer setting (a shared approach led by secondary care and empower the patient to take responsibility), inner setting (the need to go above and beyond), and intervention characteristics (developing practice guidance). Mapping our findings to existing theory informs our developing model for implementing secondary care-initiated treatment in primary care [10]. GPs spoke about their support for implementation and identified that primary care is best placed for oversight. This finding reflects characteristics of the individual and provides an overarching contextual understanding of individual GP professional beliefs and attitudes to the purpose of their work. This cultural mindset, where proactive general practice is the dominant paradigm, influences individuals’ knowledge and belief about the proposed intervention as well as their confidence in delivering the intervention. Almost all GPs identified medicines management as a core part of primary care work and reported a sense of responsibility towards preventing adverse events that will have negative consequences for patients and downstream health services. The core tenets of general practice were described as key to this, including whole-person medicine and continuity of care [11]. While GPs explained that medication reviews are standard practice, a shared approach led by secondary care was identified as the optimal pathway to implementation. This involves partnership working to ensure patients are supported and care is coordinated across the secondary-primary care interface [11]. The CFIR also acknowledges that social capital, that is, staff networks and relationships (within and across organisations) with a collective vision and boundary spanning roles are more likely to support implementation [10]. GPs spoke about the possible development of shared care, whereby they have access to ongoing secondary care specialist knowledge if required, similar to the model used with other chronic conditions [12]. GPs also acknowledged the value and importance of involving patients in this partnership interaction and identified the need for patient information and to prioritise patient-centred care so that patients are empowered and involved in their own care [13]. Consideration to patient needs and resources must be integral to any implementation that seeks to improve patient outcomes [10]. This is especially important given the specific implications of the patient population who are clinically vulnerable because they are living with a chance of VH or death, and for those whose condition relates to alcohol use and/or who have additional vulnerabilities and risks. Some GPs spoke about potential barriers and challenges to implementation and felt that they would be going above and beyond to support varices treatment in primary care. Barriers to implementation included adding to the primary care workload, the infrequency of the request and subsequent relevance to practice, and the need for financial incentives. These map to two of the inner setting CFIR constructs: implementation climate (compatibility, relative priority) and readiness for implementation. The compatibility of the proposed intervention in terms of how the intervention will impact workload and relative priority of the intervention as in the importance of implementing and relevance to practice, especially given the increase in general practice workload [14]. The need for financial incentives maps to readiness for implementation and access to available resources, including money and training [10]. Characteristics of the intervention were also identified as influencing the success of implementation. Practice guidance was suggested by GPs as a solution (e.g., specific information reporting the evidence base (i.e., evidence strength and quality) and impact on risk reduction) as well as training to guide implementation. This study promotes research from bench to bedside by engaging stakeholders in implementation at the outset [15]. While the BOPPP trial is a clinical trial of investigational medicinal product (CTIMP) that aims to deliver a ‘simple’ intervention, there is complexity in implementation, in that the proposed intervention will be managed in and across both secondary and primary care. Using a systems research perspective helps researchers to consider the interaction between an intervention and the context in which it is implemented at the outset of research. The MRC framework for developing and evaluating complex interventions is an established framework that shifts the focus from the binary question of whether an intervention works in the sense of achieving its intended outcome to include questions on acceptability, feasibility and implementation. Early engagement with stakeholders increases the chance of developing an intervention that can be implemented in practice [16]. Involvement of GPs in early conversations about delivering a potentially effective treatment was identified as a support and facilitator for implementation beyond the context of the trial. GPs spoke positively about the opportunity to offer their perspectives and indicated that participating at the outset of the trial would enhance future uptake and buy-in. GP contributions at this early stage of the research process also provided insights on transferability and implementation that could be considered alongside the trial and as the research progressed. These findings reaffirm the value of engaging intended users (those individuals who will be tasked with implementing the intervention) in the process of exploring factors that influence implementation to promote the success in adopting the intervention [17].

Strengths and limitations

While the paper extends previous research by exploring patient and recruiting staff perspectives and experiences, it is important to note that the findings are specific to the BOPPP trial. It is possible, however, to enhance transferability by describing the research context and assumptions, and by making connections between the analysis of participants accounts and claims in the extant literature. A strength of the study is the thorough and systematic application of qualitative methods and reflexive thematic analysis [5,6]. While the anonymity of telephone use can allow participants to disclose sensitive information, telephone interviews have received criticism for compromising interviewer/participant rapport and interaction, and for limiting contextual data due to the absence of face-to-face contact and visual cues. However, this method of data collection is convenient, in that it is flexible (in terms of time and location), accessible (i.e., remote research conducted during the COVID-19 pandemic), and allows for a wide reach (e.g., accessing GPs across the UK) [17]. Reflexive thematic analysis and implementation science studies are enhanced by the involvement of trans-disciplinary research teams. Our research team included multi-disciplinary clinicians working in secondary care as well as a general practitioner [6,10].

Conclusions

The ethos of proactive primary care practice, with preventative medicine as core work provides an impetus for GP oversight. An agreed pathway of care, clear communication, and specific readily accessible guidance on how to implement the proposed treatment strategy safely and effectively are important determinants in the success of implementation. These findings are important to the specifics of the BOPPP trial but can also go some way in informing the wider learning for other trials where findings will impact the primary care workload.

GP interview schedule.

(DOC) Click here for additional data file.

Full coding framework.

(DOCX) Click here for additional data file.

Thematic map.

(PUB) Click here for additional data file.

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present. 30 Aug 2022
PONE-D-21-39432
General Practitioner perspectives on factors that influence implementation of secondary care-initiated treatment in primary care: exploring implementation beyond the context of a clinical trial
PLOS ONE Dear Dr. Le Boutillier, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.
Please see the comments of two reviewers below. Both reviewers have requested additional clarity in the manuscript. Please ensure that you provide either the COREQ or SRQR checklist or similar when you resubmit, as per PLOS ONE requirements here: http://journals.plos.org/plosone/s/submission-guidelines#loc-qualitative-research, and please ensure that your manuscript presents: 1) defined objectives or research questions; 2) description of the sampling strategy, including rationale for the recruitment method, participant inclusion/exclusion criteria and the number of participants recruited; 3) detailed reporting of the data collection procedures; 4) data analysis procedures described in sufficient detail to enable replication; 5) a discussion of potential sources of bias; and 6) a discussion of limitations.
Please submit your revised manuscript by Oct 13 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Hanna Landenmark Staff Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. Thank you for stating the following in your Competing Interests section: “No competing interests” Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state "The authors have declared that no competing interests exist.", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now This information should be included in your cover letter; we will change the online submission form on your behalf. 3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. 4. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: N/A ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This is an analytic study which points to demonstrate the utility of primary and secondary care close involvement in the management of a difficultt to treat patients such as those with a portal hypertension complicated liver cirrhosis. Few questions to the authors: - How were patients engaged before being empowered? - Were the GPs competence on the management of cirrhotic patients certified? - Somewhere in the text is reported that the nurses should check and monitor blood pressure in patients taking beta-blockers for portal hypertension. To be effective in reducing the portal pressure, beta-blockers should first decrease heart rate by at least 25% from the basic value. Therefore nurses should also check and refer doctors about heart rate. This point needs to be included in the text. Reviewer #2: This is a well-written manuscript presenting the findings of a qualitative study into GP perspectives of implementing secondary care-initiated treatment in primary care. The results and discussion are clearly presented and place the findings in the context of the wider evidence base. There are a number of areas where clarification or amendment are required: 1. In the abstract, the method of recruitment and sampling approach are not detailed. 2. In some places, carvedilol is written with an uppercase 'C' in the middle of a sentence. Also 'royal college of general practitioners' should be 'Royal College of General Practitioners' 3. In the Methods section, under the heading 'Data collection' the authors should describe how the interview guide was developed and piloted. Did recruitment continue until data saturation was achieved? Also, please add details of who conducted and transcribed the interviews. 4. In the Results, please add the mean duration of the interviews, and the range 5. Did the authors use a reporting guideline for qualitative research i.e. COREQ or SRQR? If so, they should outline where they have reported each of the domains. If not, please consider using one of these reporting guidelines. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Ignazio Grattagliano Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. 5 Sep 2022 Dear Editor 05/09/2022 Re: General Practitioner perspectives on factors that influence implementation of secondary care-initiated treatment in primary care: exploring implementation beyond the context of a clinical trial Thank you very much for reviewing this manuscript. Please find responses to each point raised by the staff editor and reviewer(s) below. All changes to the manuscript are highlighted with track changes. 1. Please ensure that you provide either the COREQ or SRQR checklist or similar when you resubmit, as per PLOS ONE requirements. We have used the COREQ guidelines to report the study – and re-attach the checklist. 2. Please ensure that your manuscript presents: 1) defined objectives or research questions; 2) description of the sampling strategy, including rationale for the recruitment method, participant inclusion/exclusion criteria and the number of participants recruited; 3) detailed reporting of the data collection procedures; 4) data analysis procedures described in sufficient detail to enable replication; 5) a discussion of potential sources of bias; and 6) a discussion of limitations. The manuscript presents defined objectives or research questions (p.3), description of the sampling strategy, including rationale for the recruitment method (p.4), participant inclusion/exclusion criteria and the number of participants recruited (p.4 and p.5), detailed reporting of the data collection procedures (p.4), data analysis procedures described in sufficient detail to enable replication (p.5), a discussion of potential sources of bias (N/A to qualitative research); and a discussion of limitations (p.17-18). 3. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. We have checked PLOS ONE’s style requirements and have changed the supplementary information file names to meet the requirements. 4. If you have no competing interests, please state "The authors have declared that no competing interests exist.". This information should be included in your cover letter; we will change the online submission form on your behalf. Thank you for bringing this to our attention. We can confirm that the authors have declared that no competing interests exist. 5. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. We will update your Data Availability statement on your behalf to reflect the information you provide. Thank you for clarifying. Our revised Data Availability Statement is: This study uses data (containing potentially identifying and/or sensitive information) collected from a small group of staff participants and involves indirect identifiers (such as sex, ethnicity, location, etc.) that may risk the identification of study participants. Sharing data outside of the anonymised excerpts and quotations included in the paper will violate the agreement to which the participants consented. 6. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section. We have checked the manuscript and the ethics information has been moved to the Methods section (p. 4). 7. How were patients engaged before being empowered? Example methods of engagement have been highlighted (p.11): To support patient engagement, some GPs identified the need to discuss the pros and cons of treatment options, with the possible use of decision aids, with patients in order to share decision making. These patient conversations provide an understanding as to why the treatment is being offered and promote involvement in self-managing health. 8. Were the GPs competence on the management of cirrhotic patients certified? The GP participants competence on the management of cirrhotic patients was not certified. We have clarified this on p.4: GPs were not recruited on their level of knowledge or experience of managing cirrhosis because the research focused on routine implementation beyond the context of a clinical trial. 9. Somewhere in the text is reported that the nurses should check and monitor blood pressure in patients taking beta-blockers for portal hypertension. To be effective in reducing the portal pressure, beta-blockers should first decrease heart rate by at least 25% from the basic value. Therefore nurses should also check and refer doctors about heart rate. This point needs to be included in the text. This information is contained in a participant quote – as an illustration of how teams might draw on existing systems and processes to support implementation. We have included the above detail to further explain the context of the quote (p.8): Another explained, how the team can draw on existing systems, processes and expertise of other clinicians within the network to support implementation. For example, pharmacists or nursing staff might monitor blood pressure and check the heart rate of those people taking carvedilol and refer this information to the GP. 10. In the abstract, the method of recruitment and sampling approach are not detailed. The recruitment method and sampling approach have been added to the abstract (p.2): GP participants were purposively sampled and recruited from ten Clinical Commissioning Groups in England and three Health Boards across Wales. 11. In some places, carvedilol is written with an uppercase 'C' in the middle of a sentence. Also 'royal college of general practitioners' should be 'Royal College of General Practitioners' Thank you for bringing this to our attention. We have corrected using track changes (p.2-4). 12. In the Methods section, under the heading 'Data collection' the authors should describe how the interview guide was developed and piloted. Did recruitment continue until data saturation was achieved? Also, please add details of who conducted and transcribed the interviews. We have described how the interview schedule was developed and piloted (p.4-5): The interview schedule was informed by existing implementation literature and earlier qualitative research that explored patient and secondary-care provider perspectives on barriers and enablers associated with the proposed intervention (Le Boutillier et al., 2022) … The interview schedule was revised iteratively in response to the priorities and concerns of participants. Did recruitment continue until data saturation was achieved? We have further explained how thematic saturation was achieved (p.5): Thematic saturation occurred when the themes had been fully explored and new data was easily accommodated within them. Also, please add details of who conducted and transcribed the interviews. The interviews were conducted by the lead author between October 2020 and April 2021. This is reported on p.5. We have added the following detail (p.5): With participant consent, the audio-files were transcribed by an external transcription company, who are an existing King’s College London supplier, and who signed a confidentiality agreement. 11. In the Results, please add the mean duration of the interviews, and the range. We have added this information (p.7): The mean duration of the interviews was 19.5 minutes with the time ranging between 12-32.5 minutes. Please note we have also updated author affiliations. We hope that these responses and changes make the paper suitable for publication in PLOS ONE. Yours faithfully, Clair Le Boutillier Submitted filename: Response to Reviewers.docx Click here for additional data file. 21 Sep 2022 General Practitioner perspectives on factors that influence implementation of secondary care-initiated treatment in primary care: exploring implementation beyond the context of a clinical trial PONE-D-21-39432R1 Dear Dr. Le Boutillier, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Ignazio Grattagliano Guest Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: 6 Oct 2022 PONE-D-21-39432R1 General Practitioner perspectives on factors that influence implementation of secondary care-initiated treatment in primary care: exploring implementation beyond the context of a clinical trial Dear Dr. Le Boutillier: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Ignazio Grattagliano Guest Editor PLOS ONE
  14 in total

1.  Shared decision making--pinnacle of patient-centered care.

Authors:  Michael J Barry; Susan Edgman-Levitan
Journal:  N Engl J Med       Date:  2012-03-01       Impact factor: 91.245

2.  Primary care epidemiology: its scope and purpose.

Authors:  Philip C Hannaford; Blair H Smith; Alison M Elliott
Journal:  Fam Pract       Date:  2005-12-06       Impact factor: 2.267

3.  When are complex interventions 'complex'? When are simple interventions 'simple'?

Authors:  Mark Petticrew
Journal:  Eur J Public Health       Date:  2011-08       Impact factor: 3.367

Review 4.  Theorising interventions as events in systems.

Authors:  Penelope Hawe; Alan Shiell; Therese Riley
Journal:  Am J Community Psychol       Date:  2009-06

Review 5.  Shared care across the interface between primary and specialty care in management of long term conditions.

Authors:  Susan M Smith; Gráinne Cousins; Barbara Clyne; Shane Allwright; Tom O'Dowd
Journal:  Cochrane Database Syst Rev       Date:  2017-02-23

Review 6.  Addressing liver disease in the UK: a blueprint for attaining excellence in health care and reducing premature mortality from lifestyle issues of excess consumption of alcohol, obesity, and viral hepatitis.

Authors:  Roger Williams; Richard Aspinall; Mark Bellis; Ginette Camps-Walsh; Matthew Cramp; Anil Dhawan; James Ferguson; Dan Forton; Graham Foster; Ian Gilmore; Matthew Hickman; Mark Hudson; Deirdre Kelly; Andrew Langford; Martin Lombard; Louise Longworth; Natasha Martin; Kieran Moriarty; Philip Newsome; John O'Grady; Rachel Pryke; Harry Rutter; Stephen Ryder; Nick Sheron; Tom Smith
Journal:  Lancet       Date:  2014-11-29       Impact factor: 79.321

7.  Clinical workload in UK primary care: a retrospective analysis of 100 million consultations in England, 2007-14.

Authors:  F D Richard Hobbs; Clare Bankhead; Toqir Mukhtar; Sarah Stevens; Rafael Perera-Salazar; Tim Holt; Chris Salisbury
Journal:  Lancet       Date:  2016-04-05       Impact factor: 79.321

8.  A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance.

Authors:  Kathryn Skivington; Lynsay Matthews; Sharon Anne Simpson; Peter Craig; Janis Baird; Jane M Blazeby; Kathleen Anne Boyd; Neil Craig; David P French; Emma McIntosh; Mark Petticrew; Jo Rycroft-Malone; Martin White; Laurence Moore
Journal:  BMJ       Date:  2021-09-30

Review 9.  A systematic review of the use of the Consolidated Framework for Implementation Research.

Authors:  M Alexis Kirk; Caitlin Kelley; Nicholas Yankey; Sarah A Birken; Brenton Abadie; Laura Damschroder
Journal:  Implement Sci       Date:  2016-05-17       Impact factor: 7.327

10.  Using a theory-informed approach to explore patient and staff perspectives on factors that influence clinical trial recruitment for patients with cirrhosis and small oesophageal varices.

Authors:  Clair Le Boutillier; Claire Snowdon; Vishal Patel; Mark McPhail; Christopher Ward; Ben Carter; Ruhama Uddin; Ane Zamalloa; Vanessa Lawrence
Journal:  PLoS One       Date:  2022-02-03       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.