| Literature DB >> 36237440 |
Hamidreza Tadayon1,2, Seyed Ali Masoud3, Ehsan Nabovati1,2, Hossein Akbari4, Mehrdad Farzandipour1,2, Masoud Babaei5.
Abstract
This study aimed to determine the functional requirements of a self-management mobile application for stroke survivors. For extracting the initial functional requirements, a literature review as well as interviews with 17 patients and caregivers were done. The results were analyzed using the content analysis method. The initial extracted requirements were then provided to the specialists by the Delphi technique to determine the final functional requirements. Content validity ratio (CVR) and content validity index (CVI) were calculated according to the Lawshe model. Criteria for item approval included CVR > 0.49 and CVI > 0.79. Finally, the approved items were turned into a five-point Likert scale questionnaire and were then provided to 53 experts and items with a mean score higher than 3.75 were approved. Functional requirements including creating a user account, educational material, support services, providing reminders and alerts for drugs administration and physician appointments, and rehabilitation exercises (to improve balance, upper and lower extremities rehabilitation, and activities of daily living (ADLs)) were approved. Most of the approved functional requirements were related to rehabilitation exercises for improving upper limb motor function. The experts did not approve the requirements for using splints and slings or the recommendation to take some medications.Entities:
Year: 2022 PMID: 36237440 PMCID: PMC9535756 DOI: 10.1049/htl2.12034
Source DB: PubMed Journal: Healthc Technol Lett ISSN: 2053-3713
FIGURE 1Overview of the study methods
Content analysis of patients' interviews
| No. | Theme | Subtheme | Code (response frequency) | Identified functional requirements for mobile‐based application |
|---|---|---|---|---|
| 1 | Problems related to hemiplegia or hemiparesis |
‐ Difficulty in doing ADLs ‐ Difficulty in walking and maintaining balance |
Disorder in: Going to the toilet (11), bathing (8), eating (7), dressing and undressing (8), walking (10), balance (8), and history of falls (6). | Ability to train patients in upper and lower limbs rehabilitation *** |
| 2 | Stroke complications |
‐ Disease complications ‐ Treatment complications ‐ DDI | Urinary Incontinence or leakage (10), faecal incontinence (2), hemiplegic shoulder pain (7), speech disorder* (3), dysphagia* (2), visual disorders* (4), bed sores (2), UTI3 (2), cognitive impairment* (3), increase in blood creatinine level (drug complication) ** (1), tremor (drug complication) ** (3), purpura (drug complication) ** (2), Digestive problems (drug complication) ** (2), Severe hypoglycaemia (drug interaction) ** (2). |
‐ Ability to train patients to do exercises strengthening the pelvic floor muscles *** ‐ Ability to train patients in doing exercises for hemiplegic shoulder pain relief*** ‐ Ability to train patients in doing activities to prevent bed sores ** ‐ Ability to train patients regarding drug side effects ‐ Ability to train patients regarding important DDI |
| 3 | Psychological disorders | ‐ mood disorders ‐ Emotional problems | Depressed mood (5), mania mood (frequent and loud laughter) (2), feeling helpless (2), anxiety and worry (3), aggression and anger (1), fear of death (1), a severe decrease in life expectancy (3), lack of hope for recovery (4), lack of cooperation in taking medication and following up the treatment (1). |
‐ Ability to train patients in prevention of depression and seeing a doctor early *** ‐ Ability to train patients regarding the importance of doing exercises *** ‐ Ability to train patients regarding the possible consequences of stopping the treatment + ‐ Ability to train patients in disease curability and encourage them to continue the treatment + |
| 4 | Information asymmetry between the physician and the patient |
‐ Insufficient knowledge about the disease ‐ Insufficient knowledge about treatment methods | Lack of informing the patient about the duration of medication by the physician (3), Lack of informing the patient about the correct use of medications by the physician (2), lack of informing the patient about the possible consequences of the disease by the physician (5), Lack of informing the patient about subsequent visit time (2). | ‐ Ability to provide communication between the physician and the patient to resolve possible ambiguities *** |
ADLs: Activities of daily living.
DDI: Drug‐drug interaction.
Although interviewed people have expressed these items because they were not in line with the objectives of this study, they have not been considered in determining functional requirements.
According to the patients, items of complications and DDI were approved by the doctor. The physician has stated these symptoms are due to complications or DDI.
The identified items in the previous step (identifying requirements based on previous studies and guidelines) which are not considered as new.
New requirements identified in interviewing patients and caregivers.
Functional requirements identified for the self‐management application for patients with stroke
| Group | Functional requirement | CVR | CVI | Strongly agree | Agree | No idea | Disagree | Strongly disagree | Mean score |
|---|---|---|---|---|---|---|---|---|---|
| Creating an account | Possibility to enter patient username (unchangeable) | 0.625 | 0.958 | 26 | 0 | 2 | 0 | 0 | 4.85 |
| Possibility to enter patient age | 0.75 | 1 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| Possibility to enter patient gender | 0.875 | 1 | 27 | 0 | 1 | 0 | 0 | 4.92 | |
| Possibility to enter patient weight | 0.875 | 0.979 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| Possibility to enter patient height | 0.875 | 0.916 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| Automatic calculation of body mass index | 0.875 | 0.937 | 27 | 0 | 1 | 0 | 0 | 4.92 | |
| Patient facts | Definition and explanation of the disease | 0.875 | 0.937 | 27 | 0 | 1 | 0 | 0 | 4.92 |
| How the stroke has happened | 0.625 | 0.937 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| The risk factors for this disease and the necessary diet | 0.875 | 0.937 | 27 | 0 | 1 | 0 | 0 | 4.92 | |
| Common signs and symptoms of the disease | 0.875 | 0.916 | 27 | 0 | 1 | 0 | 0 | 4.92 | |
| Warning signs and symptoms | 1 | 0.812 | 28 | 0 | 0 | 0 | 0 | 5 | |
| Common complications of the disease on balance, bowel, and bladder thinking, pain, physical problems, sleep, fatigue, feeling, speech, and swallowing | 0.75 | 0.916 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| Methods of prevention and treatment of the disease | 0.75 | 0.916 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| Side effects of the most common drugs prescribed | 0.625 | 0.937 | 25 | 0 | 3 | 0 | 0 | 4.78 | |
| Important DDIs | 0.75 | 0.875 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| Patient improvement methods * | 0.25 | 0.937 | − | − | − | − | − | − | |
| Description of program goals for patients | 0.625 | 0.916 | 25 | 0 | 2 | 1 | 0 | 4.75 | |
| The importance of the repeated practice of exercises | 0.625 | 0.916 | 25 | 0 | 2 | 1 | 0 | 4.75 | |
| Explanations about the curability of the disease and encouragement to follow up the treatment | 0.625 | 0.854 | 25 | 0 | 2 | 1 | 0 | 4.75 | |
| Possible consequences of discontinuing the treatment | 0.875 | 0.895 | 27 | 0 | 1 | 0 | 0 | 4.92 | |
| Training prevention of spasticity and skin injury | Putting a soft pillow under the seat and behind one's back in their wheelchair | 0.75 | 0.874 | 26 | 0 | 2 | 0 | 0 | 4.85 |
| Avoiding washing too much | 0.625 | 0.895 | 25 | 0 | 2 | 1 | 0 | 4.75 | |
| Using appropriate moisturizer creams and lotions * | 0.375 | 0.895 | − | − | − | − | − | − | |
| Observing skin hygiene | 0.625 | 0.937 | 25 | 0 | 3 | 0 | 0 | 4.78 | |
| Using a special mattress | 0.5 | 0.895 | 24 | 0 | 3 | 1 | 0 | 4.67 | |
| Changing the position on the bed regularly | 0.875 | 0.937 | 27 | 0 | 1 | 0 | 0 | 4.92 | |
| Changing the position of the hemiplegic shoulder in the form of maximum external rotation, every day for 30 min* | 0.375 | 0.645 | − | − | − | − | − | − | |
| Using suitable wrist, elbow, and hand splints to manage spasms at rest (with figure) * | 0 | 0.708 | − | − | − | − | − | − | |
| Using suitable splints for the ankle when resting or during assistive standing * | −0.125 | 0.812 | − | − | − | − | − | − | |
| Training prevention of bowel and bladder problems | Recommendation to see or contact the doctor in case of symptoms of urinary retention or urinary incontinence | 0.75 | 0.958 | 26 | 0 | 2 | 0 | 0 | 4.85 |
| Recommendation to use a bedpan every 2 h during waking hours and every 4 h during sleeping hours * | 0.25 | 0.875 | − | − | − | − | − | − | |
| Recommendation to taking laxatives such as magnesium hydroxide or lactulose in case of constipation * | 0 | 0.791 | − | − | − | − | − | − | |
| Training pelvic floor muscles strengthening * | 0.125 | 0.479 | − | − | − | − | − | − | |
| Seeing the doctor if the consistency, number, and timing of bowel movements' have changed significantly before the stroke | 0.625 | 0.895 | 25 | 0 | 2 | 1 | 0 | 4.75 | |
| Training prevention of hemiplegic shoulder pain | Training shoulder movement range and shoulder positioning (with animation or video) ‐ Exercising in the rehabilitation exercises section | 0.625 | 0.854 | 25 | 0 | 3 | 0 | 0 | 4.78 |
| Training to use supportive tools and slings during hemiplegic shoulder pain (with animation or video) * | 0 | 0.791 | − | − | − | − | − | − | |
| Advising the patient to contact the physician if pain develops | 0.625 | 0.916 | 25 | 0 | 2 | 1 | 0 | 4.75 | |
| Training prevention of fall | Observing balance exercises ** | 0.625 | 1 | 25 | 0 | 2 | 1 | 0 | 4.75 |
| Advising the patient and their families to change the home arrangement to reduce the risk of falls | 0.625 | 0.875 | 25 | 0 | 3 | 0 | 0 | 4.78 | |
| Doing tai chi training for patients * | −0.375 | 0.708 | − | − | − | − | − | − | |
| Training prevention of Depression |
Advising the patient or caregivers to see the doctor if the patient experiences any of the following symptoms over two weeks: Decreased interest and desire to do daily activities, frustration and depressed mood, sleep disturbance, extreme tiredness and lack of energy, decreased or increased appetite, feeling of failure, severe disorders of concentration, talking too slowly or too fast, restlessness or agitation, negative and self‐harming thoughts | 0.625 | 0.875 | 25 | 0 | 3 | 0 | 0 | 4.78 |
| Yoga and tai chi training and playing games actively to reduce stress and increase the quality of life * | −0.5 | 0.479 | − | − | − | − | − | − | |
| Possibility of making an offline or online visit with a psychiatrist monthly to assess the psychological status of the patient | 0.625 | 0.916 | 25 | 0 | 3 | 0 | 0 | 4.78 | |
| Encouraging the patient to participate in entertainment programs and maintain a healthy lifestyle (watching TV, listening to the radio, communicating with friends, doing crosswords, reading, playing with children and grandchildren, going out etc.) | 0.5 | 0.875 | 25 | 0 | 2 | 1 | 0 | 4.75 | |
| Ability to set weekly goals and make improvements through notes * | 0 | 0.770 | − | − | − | − | − | − | |
| Support services | Frequently asked questions (FAQ) * | 0.125 | 0.687 | − | − | − | − | − | − |
| Ability to communicate between patient and the therapist through the following: voice message, video message, and text message ** | 0.625 | 1 | 25 | 0 | 3 | 0 | 0 | 4.78 | |
| Ability to contact the application support team to fix problems *** | 0.8 | 0.866 | 25 | 0 | 1 | 2 | 0 | 4.71 | |
| Possibility of a weekly phone call from a counsellor or therapist with the patient to remind him/her to do the exercises | 0.5 | 0.854 | 24 | 0 | 3 | 1 | 0 | 4.67 | |
| Providing alerts and reminders | Reminding the patient to arrange doctor appointments | 0.75 | 1 | 26 | 0 | 2 | 0 | 0 | 4.85 |
| Reminders for daily blood pressure (BP) measurement | 0.75 | 0.937 | 26 | 0 | 2 | 0 | 0 | 4.85 | |
| Warning the patient to contact the doctor if the systolic BP is over 185 mm Hg2 and diastolic BP is over 110 mm Hg. | 0.875 | 1 | 27 | 0 | 0 | 1 | 0 | 4.89 | |
| Reminders to record pulse rate (PR) daily * | 0.375 | 0.854 | − | − | − | − | − | − | |
| Reminders to take prescribed medications | 0.875 | 1 | 27 | 0 | 1 | 0 | 0 | 4.92 | |
| Reminders to take vitamin D and calcium supplements | 0.5 | 0.853 | 22 | 0 | 5 | 1 | 0 | 4.53 | |
| Functional requirements of the therapist application | Creating an account for the doctor, including first and last name and type of specialty | 0.625 | 0.937 | 21 | 3 | 3 | 1 | 0 | 4.57 |
| Ability to view some items of the patient record summary (including patient name, record number, age, gender, date of discharge, disease complications at discharge time, affected side, major comorbidities, prescribed medications) *** | 1 | 1 | 24 | 1 | 2 | 1 | 0 | 4.71 | |
| Possibility of voice or text chat with the patient if necessary | 0.875 | 0.979 | 26 | 0 | 1 | 1 | 0 | 4.82 | |
| Ability to receive patients' offline contact and send answers to them | 0.75 | 0.916 | 26 | 0 | 1 | 1 | 0 | 4.82 | |
| Ability to receive weekly line charts for patients' BP and the ability to provide appropriate feedback for each patient | 0.75 | 0.875 | 26 | 0 | 1 | 1 | 0 | 4.82 | |
| Ability to receive weekly line chart for patients' PR and the ability to provide appropriate feedback for each patient * | 0.25 | 0.770 | − | − | − | − | − | − | |
| Overall mean | 0.566 | 0.879 | 4.809 | ||||||
| Rehabilitation exercises (Simple and understandable videos must be displayed for all exercises) | |||||||||
| Grading the exercises | Grading all exercises (simple, medium, difficult) and arranging exercises from simple to difficult | 0.866 | 1 | 21 | 4 | 0 | 0 | 0 | 4.84 |
| Stretching exercise for beginning | Repeating stretching exercises of upper and lower limbs and trunk to start the exercises 10 to 15 times | 0.6 | 0.844 | 16 | 2 | 7 | 0 | 0 | 4.36 |
| Circuit class therapy | Sitting‐to‐stand exercise (standing from a sitting position on the chair with assistance, standing from a sitting position on the chair without assistance, sitting from the floor to a chair) | 0.6 | 0.866 | 14 | 6 | 2 | 3 | 0 | 4.24 |
| Lateral and forward step (the patient places the affected foot on a front or side stair and, with the help of guards on both sides, puts himself/herself on the stair. The patient then stands on the stairs and lowers the unaffected foot to touch the ground) | 0.733 | 0.822 | 20 | 0 | 0 | 3 | 0 | 4.24 | |
| The heels are lifted off the ground in an upright position* | 0.2 | 0.488 | − | − | − | − | − | − | |
| Mini‐Scott practice | 0.733 | 0.8 | 20 | 1 | 1 | 0 | 3 | 4.4 | |
| Strengthening hamstring actively (the patient sits in a chair and lifts the affected lower limb as far as possible and bends forward from the hip) | 1 | 0.844 | 22 | 0 | 3 | 0 | 0 | 4.76 | |
| Reaching to different directions in the sitting position (to strengthen leg muscles) * | −0.066 | 0.444 | − | − | − | − | − | − | |
| Stretching the gastrocnemius and soleus muscles in a standing position | 0.6 | 0.866 | 14 | 6 | 5 | 0 | 0 | 4.36 | |
| Cycling on a stationary bike (if available) * | 0.2 | 0.733 | − | − | − | − | − | − | |
| Sitting to standing, walking exercises | Standing from a sitting position on a chair | 1 | 0.955 | 22 | 3 | 0 | 0 | 0 | 4.88 |
| Going up and down the stairs | 0.6 | 0.933 | 17 | 6 | 1 | 1 | 0 | 4.56 | |
| Walking forth and back and sideways | 1 | 0.933 | 22 | 3 | 0 | 0 | 0 | 4.88 | |
| Walking around an object or from an obstacle, on a soft surface such as a carpet | 0.6 | 0.822 | 17 | 4 | 4 | 0 | 0 | 4.52 | |
| Carrying an object while walking, carrying an object while walking on an obstacle * | 0.066 | 0.862 | − | − | − | − | − | − | |
| Lateral bending of the knee and hip while lying on the unaffected side | 0.733 | 0.888 | 20 | 4 | 1 | 0 | 0 | 4.76 | |
| Bridge exercise | 0.733 | 1 | 18 | 7 | 0 | 0 | 0 | 4.72 | |
| Lower limb crossover (lifting and bending one leg and dropping it on the other leg and reopening and repeating with the other leg) * | −0.2 | 0.799 | − | − | − | − | − | − | |
| Slipping the heel (bending the knees and then sliding the heel until the lower limb is flat and slipping again until it bends and then the other one) | 1 | 0.955 | 22 | 0 | 0 | 3 | 0 | 4.64 | |
| Lying down on the side to sit down (lying down on the unaffected side, pressing the elbow and hand on the floor or bed, and sitting and hanging the feet from the edge of the bed) | 1 | 0.866 | 19 | 3 | 0 | 3 | 0 | 4.52 | |
| Static sitting balance (sitting for 30 s in a balanced position on both hips (on the chair), changing the weight to the pelvis by lifting one leg while sitting on a chair for 5 s and then the opposite leg) | 1 | 0.866 | 19 | 6 | 0 | 0 | 0 | 4.76 | |
|
Dynamic sitting balance (bending diagonally towards the stronger leg with hooked hands and then raising and stretching the hands to the affected side and repeating the movement for the opposite side) | 1 | 0.866 | 22 | 3 | 0 | 0 | 0 | 4.88 | |
| Improve control while standing | Standing behind a table and moving the lower limb to the sides using the hip joint abduction | 0.733 | 0.888 | 20 | 4 | 1 | 0 | 0 | 4.76 |
| Standing in a tandem position and touching an object on the ground * | 0.2 | 0.644 | − | − | − | − | − | − | |
| Standing in a marked area, touching the floor in the front, side, and behind the standing area with one foot and then repeating the same with the other foot. | 0.733 | 0.866 | 17 | 0 | 3 | 2 | 3 | 4.04 | |
| Lifting an object from the floor and then giving it to another person. * | 0.333 | 0.733 | − | − | − | − | − | − | |
| Touching the front step regularly with the toes. Then touching and lifting a paper glass without any deformation. * | −0.2 | 0.511 | − | − | − | − | − | − | |
| Throwing the ball to another person and catching the ball thrown by him/her ** | 0.6 | 0.9 | 17 | 3 | 0 | 5 | 0 | 4.28 | |
| Standing on one leg | 0.6 | 0.933 | 17 | 6 | 2 | 0 | 0 | 4.6 | |
| Heel‐to‐toe style walking (in the next step, the front foot's heel sticks to the big toe of the back foot, and this cycle continues). ** | 0.733 | 0.866 | 20 | 1 | 1 | 0 | 3 | 4.4 | |
| Upper limp Rehabilitation | Sitting behind the table and stretching arms and shoulders to lift a distant object | 0.733 | 0.911 | 20 | 4 | 1 | 0 | 0 | 4.76 |
| Positioning of the affected shoulder forward while lying down and returning to the original position | 1 | 0.911 | 22 | 0 | 3 | 0 | 0 | 4.76 | |
| Moving the shoulder up and down and rotating the shoulder joint | 0.6 | 0.866 | 19 | 5 | 1 | 0 | 0 | 4.72 | |
| Weight‐bearing while sitting on the floor by the opening of the bent affected elbow to strengthen the elbow and shoulder muscles | 0.733 | 0.866 | 17 | 8 | 0 | 0 | 0 | 4.68 | |
| Lying down in a supine position and flexing and extending the affected elbow | 0.6 | 0.866 | 19 | 6 | 0 | 0 | 0 | 4.76 | |
| Lifting and moving objects (such as books) in different sizes on the shelves * | 0.333 | 0.755 | − | − | − | − | − | − | |
| Opening and closing bottle caps * | 0.066 | 0.8 | − | − | − | − | − | − | |
| Picking up clothespins and placing them on a horizontal or vertical bar ** | 0.733 | 0.9 | 17 | 8 | 0 | 0 | 0 | 4.68 | |
| Collecting coins off the surface of a table * | 0.333 | 0.666 | − | − | − | − | − | − | |
| Spooning into a cup full of water and pouring water from one cup to another * | 0.2 | 0.866 | − | − | − | − | − | − | |
| Turning cards over * | 0.333 | 0.688 | − | − | − | − | − | − | |
| Positioning of the hands in a supine (palms facing up) and prone position (palms facing the ground) and repeating that ** | 0.733 | 0.866 | 17 | 7 | 1 | 0 | 0 | 4.64 | |
| Placing the palm on the table and moving the wrist side to side (in more advanced methods, the patient can place a towel under the forearm and hold objects with his/her hands and perform the movement) | 0.733 | 0.866 | 17 | 8 | 0 | 0 | 0 | 4.68 | |
| Bending and opening the wrist joint in the supine and prone position | 0.733 | 0.866 | 20 | 5 | 0 | 0 | 0 | 4.8 | |
| Active wrist stretching using small weights * | 0.2 | 0.644 | − | − | − | − | − | − | |
| Internal and external rotation of the shoulder joint with the use of a rubber band to create resistance ** | 0.733 | 0.866 | 20 | 1 | 4 | 0 | 0 | 4.64 | |
| Moving the joints of the fingers with small elastic bans | 1 | 0.933 | 19 | 3 | 3 | 0 | 0 | 4.64 | |
| Using Constraint‐Induced Movement Therapy (CIMT) to strengthen the affected upper limb (for 1 h daily) | 1 | 0.933 | 19 | 0 | 6 | 0 | 0 | 4.52 | |
| Lower limb rehabilitation | Rehabilitating the ankle by moving the foot to kick a ball | 0.733 | 0.888 | 20 | 1 | 4 | 0 | 0 | 4.64 |
| Lying down on the unaffected side and bending the affected knee, and then opening it | 0.733 | 0.888 | 20 | 5 | 0 | 0 | 0 | 4.8 | |
| Lying down in a supine position with the bent knees (45°) and then moving the bent knee side to side by moving the hip joint * | −0.066 | 0.844 | − | − | − | − | − | − | |
| Sitting in a chair and bending diagonally to the affected side to reduce lower limb spasticity | 0.733 | 0.911 | 20 | 4 | 1 | 0 | 0 | 4.76 | |
| Bending and opening the affected lower limb while standing on the affected leg to strengthen the muscles | 1 | 0.933 | 22 | 0 | 3 | 0 | 0 | 4.76 | |
| Safe transfer, walking for a short distance with assistive devices | 1 | 0.933 | 22 | 3 | 0 | 0 | 0 | 4.88 | |
| Ergometry of the leg, arm, or a combination of arm and leg for 20–60 min per day (three periods of 10–15 min) five days a week * | −0.466 | 0.4 | − | − | − | − | − | − | |
| Strengthening the extensor muscles of the lower limb in the weight‐bearing position | 1 | 0.888 | 22 | 0 | 3 | 0 | 0 | 4.76 | |
| ADLs3 training | Brushing training * | 0.2 | 0.688 | − | − | − | − | − | − |
| Eating training | 0.733 | 0.866 | 20 | 5 | 0 | 0 | 0 | 4.8 | |
| Bathing training | 0.733 | 0.888 | 20 | 4 | 1 | 0 | 0 | 4.76 | |
| Going to toilet training | 1 | 0.888 | 22 | 3 | 0 | 0 | 0 | 4.88 | |
| Grooming training * | 0.333 | 0.755 | − | − | − | − | − | − | |
| Hand and face washing training | 1 | 0.933 | 22 | 3 | 0 | 0 | 0 | 4.88 | |
| Dressing and undressing training | 1 | 0.933 | 22 | 3 | 0 | 0 | 0 | 4.88 | |
| Overall mean | 0.610 | 0.834 | 4.65 | ||||||
DDI: Drug‐drug interaction.
mm Hg: Millimetre of Mercury.
The repetition of some exercises in different sections is because some exercises pursue different goals and may be necessary to achieve one and unnecessary for another.
Removed items from the final list of requirements due to the low content validity ratio (CVR < 0.49); not entering the Delphi stage.
Reviewed items returned to the experts due to the low content validity index (CVI < 0.79) in the first stage. (The mentioned CVI is the final CVI after review).
Suggested items by some experts in the first stage which were sent to 10 experts in the review stage.