| Literature DB >> 35031027 |
Deanna Mill1, Amy Page2,3,4, Jacinta Johnson5,6, Kenneth Lee2, Sandra M Salter2, Liza Seubert2, Rhonda Clifford2, Danielle D'Lima7.
Abstract
BACKGROUND: Guidelines and practice standards exist to communicate the conduct and behaviour expected of health care professionals and ensure consistent quality practice. It is important that they describe behaviours explicitly so they can be interpreted, enacted and measured with ease. The AACTT framework specifies behaviour in terms of the: Action to be performed, Actor who performs the action, Context where the action occurs, Target who the action is performed with/for and Time when the action is performed (AACTT). It provides the most up to date framework for specifying behaviours and is particularly relevant to complex behavioural problems that involve sequences of behaviours performed by different people. Behavioural specificity within pharmacy practice standards has not been explored. AIM: To determine if behaviours described in the Professional Practice Standards for Australian Pharmacists specify Action, Actor, Context, Target and Time.Entities:
Keywords: Behavioural specification; Pharmacist; Practice standards; Professional behaviour
Mesh:
Year: 2022 PMID: 35031027 PMCID: PMC8760715 DOI: 10.1186/s12913-021-07358-4
Source DB: PubMed Journal: BMC Health Serv Res ISSN: 1472-6963 Impact factor: 2.655
Fig. 1The layout of each standard and its components for the Pharmaceutical Society of Australia Professional Practice Standards [6]. (Authors have permission to reproduce this image from the Pharmaceutical Society of Australia)
Codebook developed to apply AACTT framework to analysis of the practice standards
| Criteria* | AACTT Criteria original definition [ | AACTT Criteria adjusted definition | Allocated codes and definitions | Examples from Professional Practice Standards for Australian Pharmacists |
|---|---|---|---|---|
Is an action specified per the review definition? | A discrete observable behaviour that needs to change, in terms that can be observed or measured. | A discrete observable behaviour…in terms that can be observed or measured. | Yes - There is an action(s) that is/are discrete and observable in the statement. No - There is no discrete and observable action(s) present in the statement. | |
Is there reference to another guideline or document in the action statement? | Yes - One or more guidelines or documents are mentioned in the statement. No - No guidelines or documents are mentioned in the statement. | |||
If there is reference to another guideline or document. Is it clear what the document/guideline is and how it can be accessed? | Yes - Guideline or document has been explicitly named and where it can be accessed in the statement. No -The guideline has not been explicitly named and where to access it has not been specified in the document. MIN -The guideline or document has been explicitly named OR how to access it is stated but not both. | |||
Is actor(s) specified per the review definition? | The individual or group of individuals who perform (or should/could) the Action. | The individual or group of individuals who perform (or should/could) the Action. | Yes -Explicitly names the person OR persons responsible for performing the action. No - No one is explicitly named to perform the action OR assumptions of responsible person need to made to interpret. | |
Is context specified per the review definition? | The physical location, emotional or social setting in which the Actor performs (or should/ could) the Action. | The physical location, emotional or social setting in which the Actor performs (or should/ could) the Action. | Yes - A location/context for the action has been explicitly named. No -A location/context has not been named OR assumptions need to be made to interpret the context. MIN -A location/context has been named but there could be multiple OR a reference to location/context is made but more information would be needed to interpret OR when nonspecific terms are used to refer to the context that could have multiple meanings and have not been predefined | |
Is target(s) specified per the review definition? | The individual or group of individuals for/ with/ on behalf of whom the Actor performs the Action. | The individual or group of individuals for/ with/ on behalf of whom the Actor performs the Action. | Yes -An individual or group that the action is with/for AND on behalf of is named. No - No individual or group that the action is with/for AND on behalf of is specified OR assumptions need to be made to interpret who the target is. MIN -When a reference to target is made but more information would be needed to interpret which specific individuals are the target OR one of with/for/behalf of is missing and shouldn’t be. NN - The action doesn’t require a target OR the target is also the actor. | |
Is time specified per the review definition? | The time period and duration that the Actor performs the Action in the Context with/for the Target. | The time period and duration that the Actor performs the Action in the Context with/for the Target. | Yes - Time period and duration if relevant and explicitly specified OR if states the situation when the action should occur. No -No time period or duration is specified, OR assumptions were made about them. MIN - When a reference to time is made but more information would be needed to interpret or assumptions would need to be made to interpret OR duration and/or frequency are present but not both. |
MIN More Information Needed
NN Not needed
*Additional criteria added by research team
Interpretation of action verbs as discrete and observable for the codebook
| Action word | Relevant dictionary definitions from Macquarie Online Dictionary [ | Interpretation of discrete and observable for review |
|---|---|---|
1. To secure, or bring surely, as to a person: 2. To make sure or certain to come, occur, etc.: 3. To make secure or safe, as from harm. | For all definitions: Not discrete as likely to take multiple successive actions. Not observable as not enough detail to know what the physical outcomes would be or what actions are needed. | |
1. To keep in existence or continuance; preserve; retain: 2. To keep in due condition, operation, or force; keep unimpaired: 3. To keep in a specified state, position, etc. 4. To affirm; assert (with a clause, or with an object and infinitive): | For all definitions: Not discrete and would take multiple successive actions. Some outcomes are possibly observable but adequate description of the action and outcome would be needed. | |
1. To employ for some purpose; put into service; turn to account: 2. To avail oneself of; apply to one’s own purposes: 3. To utter (words) or speak (a language). 4. To operate or put into effect. | For all definitions: Possibly discrete but dependent on if there is enough explanation as to ‘how’ to use the object, article etc. If ‘how’ is not clearly detailed then the action would be considered non-discrete. Some outcomes are possibly observable but adequate description of the action and outcome would be needed. | |
1. To direct the attention or thoughts of: 2. To direct for information or for anything required: 3. (of a medical practitioner) to direct (a patient) to another doctor, usually a specialist, for further consultation or treatment. 4. To have recourse or resort; turn, as for aid or information: t | For definitions 1,2 and 4: Possibly discrete but dependent on if there is enough explanation as to ‘how’ and ‘what’ to refer the object, article etc. If ‘how’ and ‘what’ is not clearly detailed then the action would be considered non-discrete. Some outcomes are possibly observable but adequate description of the action and outcome would be needed. For definition 3: If referring to another health profession then this is likely discrete and observable. | |
1. To recognise or establish as being a particular person or thing; attest or prove to be as claimed or asserted: 2. To serve as a means of identification for: | For all definitions: Possibly discrete but dependent on if there is enough explanation as to ‘how’ and ‘what’ to refer the object, article etc. If ‘how’ and ‘what’ is not clearly detailed then the action would be considered non-discrete. Some outcomes are possibly observable but adequate description of the action and outcome would be needed. | |
| 1. To maintain contact and act in concert. | Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done. Possibly observable but this is dependent on specific outcome or action. | |
1. To check, observe, or record the operation of (a machine, etc.), without interfering with the operation. 2. To supervise; observe critically. | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done. Possibly observable but this is dependent on specific outcome or action. | |
1. To be devoted to; be attached to as a follower or upholder: 2. To hold closely or firmly to: | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done and ‘what’ is being adhered to. Possibly observable but this is dependent on specific outcome or action. | |
| 1. To put (a plan, proposal, etc.) into effect | Not discrete as likely to take multiple successive actions. Not observable as not enough detail to know what the physical outcomes would be or what actions are needed. | |
1. To contemplate mentally; meditate or reflect on. 2. To regard as or deem to be: 3. To think; suppose. 4. To make allowance for. 5. To pay attention to; regard: | For all definitions: Most likely not discrete and observable as is an internal thought process, may take multiple actions in succession to achieve and will not necessarily always have a physical outcome. | |
1. To inspect, especially formally or officially. 2. To look back upon; view retrospectively. | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done and ‘what’ is being reviewed. Possibly observable but this is dependent on specific outcome or action. | |
1. To estimate generally, as to quality, size, weight, etc. 2. To value in current money; estimate the value of. | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done and ‘what’ is being appraised. Possibly observable but this is dependent on specific outcome or action. | |
| 1. To ascertain the value or amount of; appraise carefully. | Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done and ‘what’ is being evaluated. Possibly observable but this is dependent on specific outcome or action. | |
1. To fix or determine the amount of (damages, a tax, a fine, etc.). 2. To measure or evaluate. | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done and ‘what’ is being assessed. Possibly observable but this is dependent on specific outcome or action. | |
| 1. To gain admittance to: | Discrete and observable as is a physical action. | |
1. To inspire with courage, spirit, or confidence. 2. To stimulate by assistance, approval, etc. | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done. Possibly observable but this is dependent on specific outcome or action. | |
1. To make easier or less difficult; help forward (an action, a process, etc.). 2. To assist the progress of (a person): | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done. Possibly observable but this is dependent on specific outcome or action. | |
1. To occupy the attention or efforts of (a person, etc.): 2. To secure for aid, employment, use, etc.; hire: 3. To attract and hold fast: 4. To reserve or secure. 5. To attract or please: 6. To bind as by pledge, promise, contract, or oath; make liable. 7. To occupy oneself; become involved: | For all definitions: Not discrete as likely to take multiple successive actions. To be discrete would need an explanation of ‘how’ this is being done. Possibly observable but this is dependent on specific outcome or action. | |
1. To make certain or sure; corroborate; verify: 2. To make valid or binding by some formal or legal act; sanction; ratify: 3. To reaffirm (a booking, ticket reservation, appointment, etc.) as by a notification to a person or organisation of one’s intention to carry out one’s original plans. 4. To strengthen (a person) in habit, resolution, opinion, etc. | For definitions 2 and 3: Discrete and observable if ‘what’ or ‘who’ and ‘how’ something is being confirmed is named, as likely to have a physical or verbal outcome. For definitions 1 and 4: Not discrete as likely to take multiple successive actions. These may be internal thought processes. To be discrete would need an explanation of ‘how’ this is being done. Possibly observable but this is dependent on specific outcome or action. | |
| 1. To choose in preference to another or others; pick out. | Possibly discrete but may involve internal decision-making processes. Likely observable if physically choosing between objects. | |
1. To commend by favourable representations; present as worthy of confidence, acceptance, use, etc.: 2. To represent or urge as advisable or expedient: 3. To advise (a person, etc., to do something): | Discrete and observable as likely to have a physical or verbal outcome. |
Summary of all action statements ACTION criteria analysis by standard
| Number with behaviourally relevant content | Action statements with discrete observable actions | Action statements with more than one discrete observable actions | Action statements that’s ACTION referenced other documents | Action statements that’s reference to other documents explicitly named and said how to access the document | ||
|---|---|---|---|---|---|---|
| Standard | No. | Meets criteria | No. (%) | No. (%) | Specified | Partially specified |
| Standard 1: Fundamental Pharmacy Practice | 48 | 22 (46%) | 2 (4%) | 8 (17%) | 4 (50%) | 0 |
| Standard 2: Leading and Managing Pharmacy Practice | 51 | 16 (31%) | 1(2%) | 11(22%) | 0 | 1 (9%) |
| Standard 3: Dispensing and Other Supply Arrangements | 70 | 36 (51%) | 3 (4%) | 14 (20%) | 1 (7%) | 4 (29%) |
| Standard 4: Provision of Non-prescription Medicines and Therapeutic Devices | 30 | 16 (53%) | 2 (7%) | 7 (23%) | 0 | 2 (29%) |
| Standard 5: Compounding | 75 | 36 (48%) | 10 (13%) | 22 (29%) | 6 (27%) | 5 (23%) |
| Standard 6: Medicines Information | 23 | 3 (13%) | 1 (33%) | 0 | 0 | 0 |
| Standard 7: Health Promotion and Education | 21 | 6 (29%) | 0 | 1 (5%) | 0 | 0 |
| Standard 8: Counselling | 36 | 14 (39%) | 1 (3%) | 4 (11%) | 0 | 0 |
| Standard 9: Collaborative Care | 52 | 12 (23%) | 1 (2%) | 7 (13%) | 0 | 0 |
| Standard 10: Screening and Risk Assessment | 36 | 10 (28%) | 0 | 10 (28%) | 2 (20%) | 2 (20%) |
| Standard 11: Vaccination Service | 65 | 26 (40%) | 1 (2%) | 14 (22%) | 0 | 4 (29%) |
| Standard 12: Minor Ailments Service | 39 | 13 (33%) | 0 | 9 (23%) | 1 (11%) | 1 (11%) |
| Standard 13: Disease State Management | 47 | 16 (34%) | 1 (2%) | 10 (21%) | 2 (20%) | 3 (30%) |
| Standard 14: Medication Review | 52 | 31 (60%) | 3 (6%) | 10 (19%) | 1 (10%) | 0 |
| Standard 15: Dose Administration Aid Service | 73 | 21 (29%) | 0 | 10 (14%) | 2 (20% | 1 (10%) |
| Standard 16: Harm Minimisation | 50 | 22 (44%) | 0 | 11 (22%) | 1 (9%) | 2 (18%) |
| 768 | 300 (39%) | 26 (3%) | 148 (19%) | 20 (14%)a | 25 (17%)a | |
% calculated per total no. of behaviourally relevant actions in each standard unless otherwise specified
a% calculated per total action statements that referenced other documents
Summary of action statements ACTOR, CONTEXT, TARGET and TIME criteria analysis by standard
| Actions with behaviourally relevant content | ACTOR(s) | CONTEXT was specified | TARGET(s) was specified | TIME was specified | |||||
|---|---|---|---|---|---|---|---|---|---|
| Standard | No. | Meets criteria | Meets criteria | Partially meets criteria | Meets criteria | Partially meets criteria | Not necessary No. (%) | Meets criteria | Partially meets criteria |
| Standard 1: Fundamental Pharmacy Practice | 48 | 0 | 0 | 5 (10%) | 14 (29%) | 23 (48%) | 1 (2%) | 8 (17%) | 6 (13%) |
| Standard 2: Leading and Managing Pharmacy Practice | 51 | 0 | 0 | 6 (12%) | 2 (4%) | 28 (55%) | 7 (14%) | 2 (4%) | 7 (14%) |
| Standard 3: Dispensing and Other Supply Arrangements | 70 | 0 | 5 (7%) | 2 (3%) | 17 (24%) | 28 (40%) | 2 (3%) | 12 (17%) | 9 (13%) |
| Standard 4: Provision of Non-prescription Medicines and Therapeutic Devices | 30 | 0 | 1 (3%) | 0 | 8 (27%) | 11 (37%) | 2 (7%) | 7 (23%) | 4 (13%) |
| Standard 5: Compounding | 75 | 0 | 3 (4%) | 8 (11%) | 4 (5%) | 14 (19%) | 5 (7%) | 14 (19%) | 20 (27%) |
| Standard 6: Medicines Information | 23 | 0 | 0 | 1 (4%) | 6 (26%) | 13 (57%) | 1 (4%) | 2 (9%) | 3 (13%) |
| Standard 7: Health Promotion and Education | 21 | 0 | 1 (5%) | 0 | 1 (5%) | 14 (67%) | 1 (5%) | 2 (10%) | 1 (5%) |
| Standard 8: Counselling | 36 | 0 | 2 (6%) | 0 | 11 (31%) | 10 (28%) | 0 | 3 (8%) | 3 (8%) |
| Standard 9: Collaborative Care | 52 | 0 | 0 | 2 (4%) | 2 (4%) | 31(60%) | 2 (4%) | 1 (2%) | 4 (8%) |
| Standard 10: Screening and Risk Assessment | 36 | 0 | 1 (3%) | 0 | 7 (19%) | 8 (22%) | 4 (11%) | 3 (8%) | 7 (19%) |
| Standard 11: Vaccination Service | 65 | 0 | 0 | 4 (6%) | 12 (18%) | 29 (45%) | 2 (3%) | 8 (12%) | 12 (18%) |
| Standard 12: Minor Ailments Service | 39 | 0 | 0 | 2 (5%) | 6 (15%) | 13 (33%) | 0 | 3 (8%) | 6 (15%) |
| Standard 13: Disease State Management | 47 | 0 | 0 | 1 (2%) | 10 (21%) | 19 (40%) | 4 (9%) | 2 (4%) | 5 (11%) |
| Standard 14: Medication Review | 52 | 0 | 1 (2%) | 3 (6%) | 11 (21%) | 25 (48%) | 0 | 4 (8%) | 7 (13%) |
| Standard 15: Dose Administration Aid Service | 73 | 0 | 8 (11%) | 0 | 10 (14%) | 22 (30%) | 3 (4%) | 12 (16%) | 16 (22%) |
| Standard 16: Harm Minimisation | 50 | 0 | 3 (6%) | 1 (2%) | 10 (20%) | 15 (30%) | 2 (4%) | 6 (12%) | 9 (18%) |
| 768 | 0 | 25 (3%) | 35 (5%) | 131(17%) | 303 (39%) | 36 (5%) | 88 (11%) | 120 (16%) | |
% calculated per total no. of behaviourally relevant actions in each standard
Summary of Standard statement, Background and scope, and Criteria ACTOR, CONTEXT, TARGET and TIME criteria analysis by standard
Example action statements specification problems and possible adjustments
| Example number and problem type | Example action statement verbatim from the standards (4)(relevant section bolded) | Problem explained | Example of possible specification adjustment for the problem | Other issues with this criteria | Example of possible specification for entire action statement per AACTT (adjusted sections bolded) | |
|---|---|---|---|---|---|---|
| 1. | Not a discrete or observable action | 3.8.8 | Creating awareness is difficult to observe and would likely require numerous discrete actions. This term needs to be replaced with something that is discrete and observable e.g. Educates. | Actor, context, target and time are all not specified. Assume actor is pharmacist, patient is target, context is in the pharmacy and time could be when they are dispensing medicines for them. | ||
| 2. | Not an observable action | 3.8.7 | We can’t observe someone ensuring something. We can observe them discussing substitution with the patient. Suggest remove ‘ensures’ and focus on discussing as the action. | Actor and context are not specified, assume pharmacist and in the pharmacy (doesn’t necessarily have to be though). Time is during the counselling process but how often should this occur, assume always when substitution has been made. Should name what is being substituted e.g. medication. | ||
| 3. | How the action should be performed needs clarification | 15.7.5 | What is required to maintain these clear records? Assume need to document each of those things into a record every time they are packed into a DAA for a patient. | Actor is not specified, assume pharmacist. Target and time are not specified, assume patient and every time it is packed. | ||
| 4. | Nonspecific language used, how to perform action not specified | 14.8.2 | How should they confirm this, could specify verbally? The service could also be further specified, in this standard it is talking about medicine review services. | Actor, context and time are missing. Assume accredited pharmacist is the actor, context would be specific to the type of medicines review and this should all be confirmed prior to initiating the service. | ||
| 5. | Reference to document with necessary information missing | 14.3.1 Ensures that all medication review services are consistent with | Reference to clinical and program guidelines, but not specified exactly what they are or where they can be found. Suggest naming the relevant documents and supplying a link to where they can be found. | Ensures that all medication review services are consistent with relevant clinical guidelines and comply with program guidelines | Ensures isn’t discrete or observable, suggest changing to provides all medication review services that are… Actor isn’t specified, should be an accredited pharmacist. Target isn’t specified but assume is a patient. Context isn’t specified but would be dependent on the type of service being provided. | |
| 6. | Actor not specified | 2.3.2 Works with a mentor for peer review of practice or to assist in meeting professional development goals. | Who works with a mentor? The actor is not specified. | Action is ‘works’ and ‘peer review of practice’ could both be further specified. Context and Time are also not specified at all. | ||
| 7. | Assuming actor is a pharmacist but which pharmacist | 11.3.5 Confirms that the authorised immuniser has professional indemnity insurance and that the delivery site has insurance policies appropriate for the delivery of a vaccination service. | Whose job is it to do this? Is it the pharmacy owner, the pharmacist manager, the pharmacist on duty or someone else? | Time is not specified at all. Context is delivery site but could be further specified. Confirms could also be further specified- how should they confirm? For example, verbally, via citation of appropriate documentation. | ||
| 8. | No context specified but action may be in a fixed location | 16.6.9 Adapts workflow to facilitate the delivery of harm minimisation services. | Workflow and the delivery of the harm minimisation service where? | Adapts workflow of | Adapting is not a discrete behaviour as it would require multiple actions to achieve or would depend on need. Target is not specified and, in this case, could be for the patient and with the pharmacy owner and staff. Time is not specified, but likely should be prior to providing the service. Actor is also not specified and could be the pharmacy owner, manager, and/or dispensing pharmacist. | |
| 9. | Non-specific reference to a physical location/context | 12.11.4 Regularly assesses the suitability of the surfaces, furnishings and equipment in the | Service environment is non-specific? Standard 12 refers to Disease State Management services that would like to occur in a community pharmacy and preferably in a private consultation room within that pharmacy. | Regularly assesses the suitability of the surfaces, furnishings and equipment in the OR Regularly assesses the suitability of the surfaces, furnishings and equipment in the | Assess and responds appropriately are not necessarily observable or discrete as actions. Actor is missing, assume it should be pharmacist. Target is not specified, assume this is done for the patient. Time is specified as, regularly but this is not specific and could be further specified eg. Weekly or prior to providing the service. | |
| 10. | Non-specific term used for the target | 5.11.3 Educates other | The target is health professionals, but this is a non-specific term and could be further specified as to who is most likely to need education on preparation and administration. This would most likely be nurses as they usually administer medications. | Educates | Actor is missing, assume pharmacists. Action is educating, could be further specified how they should educate. Context and time are also not specified, but context may not matter for education and time could be as requested or prior to them administering. | The pharmacist educates |
| 11. | Missing information for target | 8.7.1 Checks the dispensing history and/or electronic healthcare record to determine the appropriateness of information being sought and provided. | Does not specify who is seeking the information and who it is being provided to. Assume target is a patient. | Checks the dispensing history and/or electronic healthcare record to determine the appropriateness of information being sought | Actor is not specified, assume pharmacist. Action words are checks and determines, not necessarily observable and discrete. Context is not specified, assume in a pharmacy. Time is not specified assume, when it is requested. | |
| 12. | Assumption of when to do action is needed | 4.8.2 Provides advice to optimise use of non-prescription medicines and therapeutic devices. | It is not specified when this should be done. Assume this should be done every time either of these products is supplied or it is requested by the patient. | OR Provides advice to optimise use of non-prescription medicines and therapeutic devices | Actor is not specified, assume pharmacist. Context is not specified, assume within the pharmacy or wherever selling/recommending these products. Target is not specified, assume a patient. | |
| 13. | Non-specific language used for time | 5.5.6 | Nonspecific terms ‘regularly’ and ‘as required’ have been used to indicate when the action should be completed. These could be further specified by stating a length of time instead of regularly and a specified circumstance instead of as required. | Conducts and documents environmental monitoring of the cleanroom and ancillary areas | Actor is not specified and, in this case, could be a pharmacist or assistant assigned by the pharmacist. Action words conducts, documents and initiates corrective action could possibly be further specified (e.g. how should it be conducted, what is corrective action). Context is specified as clean room and ancillary areas, but no context for where it should be documented has been provided. Target is not specified but this would depend if the pharmacist or an assistant was completing the action. | The |
aAssumptions made to interpret/make example adjustment
Consolidated criteria for reporting qualitative studies (COREQ): 32-item checklist
| No. Item | Guide questions/description . | Page number reported on |
|---|---|---|
| Domain 1: Research team and reflexivity | ||
| Personal Characteristics | ||
| 1. Interviewer/facilitator | Which author/s conducted the interview or focus group? | N/A Document review – the researchers background are described in the methods section on page 6 |
| 2. Credentials | What were the researcher’s credentials? E.g. PhD, MD | N/A Document review |
| 3. Occupation | What was their occupation at the time of the study? | N/A Document review |
| 4. Gender | Was the researcher male or female? | N/A Document review |
| 5. Experience and training | What experience or training did the researcher have? | N/A Document review |
| Relationship with participants | ||
| 6. Relationship established | Was a relationship established prior to study commencement? | N/A Document review |
| 7. Participant knowledge of the interviewer | What did the participants know about the researcher? e.g. personal goals, reasons for doing the research | N/A Document review |
| 8. Interviewer characteristics | What characteristics were reported about the interviewer/facilitator? e.g. Bias, assumptions, reasons and interests in the research topic | N/A Document review |
| Domain 2: study design | ||
| Theoretical framework | ||
| 9. Methodological orientation and Theory | What methodological orientation was stated to underpin the study? e.g. grounded theory, discourse analysis, ethnography, phenomenology, content analysis | Directed content analysis – methods sections, page 6 |
| Participant selection | ||
| 10. Sampling | How were participants selected? e.g. purposive, convenience, consecutive, snowball | N/A Document Review. Rationale for the choice of document analysis can be found in the methods section, page 6 |
| 11. Method of approach | How were participants approached? e.g. face-to-face, telephone, mail, email | N/A Document Review. |
| 12. Sample size | How many participants were in the study? | N/A Document Review. |
| 13. Non-participation | How many people refused to participate or dropped out? Reasons? | N/A Document Review. |
| Setting | ||
| 14. Setting of data collection | Where was the data collected? e.g. home, clinic, workplace | N/A Document Review. |
| 15. Presence of non-participants | Was anyone else present besides the participants and researchers? | N/A Document Review. |
| 16. Description of sample | What are the important characteristics of the sample? e.g. demographic data, date | N/A Document Review. |
| Data collection | ||
| 17. Interview guide | Were questions, prompts, guides provided by the authors? Was it pilot tested? | N/A Document Review. |
| 18. Repeat interviews | Were repeat interviews carried out? If yes, how many? | N/A Document Review. |
| 19. Audio/visual recording | ||
| 20. Field notes | Were field notes made during and/or after the interview or focus group? | N/A Document Review. The researchers documented decisions during development of the code book. |
| 21. Duration | What was the duration of the interviews or focus group? | N/A Document Review. |
| 22. Data saturation | Was data saturation discussed? | N/A Document Review. |
| 23. Transcripts returned | Were transcripts returned to participants for comment and/or correction? | N/A Document Review. |
| Domain 3: analysis and findings | ||
| Data analysis | ||
| 24. Number of data coders | How many data coders coded the data? | Second researcher reviewed 20% of coding for agreement, see methods page 6–7 |
| 25. Description of the coding tree | Did authors provide a description of the coding tree? | Development of code book provided in methods, page 6–7 Code book can be viewed in Table |
| 26. Derivation of themes | Were themes identified in advance or derived from the data? | Directed content analysis – methods sections, page 6 |
| 27. Software | What software, if applicable, was used to manage the data? | Microsoft Excel was used to store data and analysis. |
| 28. Participant checking | Did participants provide feedback on the findings? | N/A Document Review |
| Reporting | ||
| 29. Quotations presented | Were participant quotations presented to illustrate the themes / findings? Was each quotation identified? e.g. participant number | N/A Document Review. Examples of analysis and potential improvements to statements can be viewed in Table |
| 30. Data and findings consistent | Was there consistency between the data presented and the findings? | Yes. |
| 31. Clarity of major themes | Were major themes clearly presented in the findings? | Yes. See results section on page 7–9 |
| 32. Clarity of minor themes | Is there a description of diverse cases or discussion of minor themes? | N/A Document Review |