Literature DB >> 28636163

The PU-PROM: A patient-reported outcome measure for peptic ulcer disease.

Na Liu1, Jing Lv1, Jinchun Liu2, Yanbo Zhang1.   

Abstract

OBJECTIVE: Patient-reported outcome measure (PROM) conceived to enable description of treatment-related effects, from the patient perspective, bring the potential to improve in clinical research, and to provide patients with accurate information. Therefore, the aim of this study was to develop a patient-centred peptic ulcer patient-reported outcome measure (PU-PROM) and evaluate its reliability, validity, differential item functioning (DIF) and feasibility.
METHOD: To develop a conceptual framework and item pool for the PU-PROM, we performed a literature review and consulted other measures created in China and other countries. Beyond that, we interviewed 10 patients with peptic ulcers, and consulted six key experts to ensure that all germane parameters were included. In the first item selection phase, classical test theory and item response theory were used to select and adjust items to shape the preliminary measure completed by 130 patients and 50 controls. In the next phase, the measure was evaluated used the same methods with 492 patients and 124 controls. Finally, we used the same population in the second item reselection to assess the reliability, validity, DIF and feasibility of the final measure.
RESULTS: The final peptic ulcer PRO measure comprised four domains (physiology, psychology, society and treatment), with 11 subdomains, and 54 items. The Cronbach's α coefficient of each subdomain for the measure was >0.800. Confirmatory factory analysis indicated that the construct validity fulfilled expectations. Model fit indices, such as RMR, RMSEA, NFI, NNFI, CFI and IFI, showed acceptable fit. The measure showed a good response rate.
CONCLUSIONS: The peptic ulcer PRO measure had good reliability, validity, DIF and feasibility, and can be used as a clinical research evaluation instrument with patients with peptic ulcers to assess their condition focus on treatment. This measure may also be applied in other health areas, especially in clinical trials of new drugs, and may be helpful in clinical decision making.
© 2017 The Authors Health Expectations Published by John Wiley & Sons Ltd.

Entities:  

Keywords:  classical test theory; differential item functioning; item response theory; patient-reported outcome; peptic ulcer; reliability; validity

Mesh:

Year:  2017        PMID: 28636163      PMCID: PMC5689228          DOI: 10.1111/hex.12575

Source DB:  PubMed          Journal:  Health Expect        ISSN: 1369-6513            Impact factor:   3.377


INTRODUCTION

Peptic ulcer is defined as an ulcer occurring in a region that touches gastric acid and pepsin, and usually refers to a gastric or duodenal ulcer. Although peptic ulcers have a very low mortality rate, they can have complications such as haemorrhage and perforation if not treated in time. They can cause significant physical pain to patients and increase financial and service burdens. One report found that the lifetime prevalence of peptic ulcer disease in the general population has been estimated to be about 5%‐10%, and incidence 0.1%‐0.3% per year.1, 2, 3 Although peptic ulcers are a benign, non‐fatal disease, they do result in lost productivity and associated economic loss. Distress caused by peptic ulcers includes psychological, social and behavioural problems, which may interfere with a patient's ability to fully participate in their health care, and manage their illness and its consequences. The widely accepted bio‐psycho‐social medical model includes quality of life (QoL), which is the general well‐being of individuals and societies, outlining negative and positive features of life. It is understood to be a multidomain concept with physical, psychological and social components, however which is insufficient to assess the patients treatment‐related effects. Besides, some of the symptoms associated with treatment, such as nausea and vomiting, are frequently underreported by clinicians, even when data are prospectively collected within clinical trials. Only relying on the results of clinical examination and the judgement of experts without patients’ perception could indirectly lead to misdiagnosis and medical accidents because of the different opinions between doctors and patients. Developing a patient‐centred measure tool can enhance the self‐efficacy of patients to recognize and report symptoms of deteriorating conditions, improve patient ‘s self‐efficacy, identify and report the deterioration of symptoms and able to actively contribute to the management of chronic diseases.4, 5 Patient‐reported outcomes (PROs) have been demonstrated to be a valid, reliable, feasible and precise approach to evaluate clinical research and enables symptoms that are missed by clinicians to be detected. The International Society for Pharmacoeconomics and Outcomes Research (ISPOR), the European Regulatory Issues on Quality of Life Assessment Group (ERIQA), the United States Food and Drug Administration (FDA)6 and the International Society for Quality of Life Studies (ISQOL) recommend that clinical efficacy evaluation should include outcomes provided by patients and proxy respondents. Patient‐reported outcomes (PROs) are a central aspect.7 A PRO is a measurement of any aspect of a patient's health status that originates directly from the patient (i.e, without the interpretation of the patient's responses by a physician or other person).8 A PRO can directly reflect the influence of disease in a patient, help in the treatment of that patient and help to establish good communication between the patient and medical staff in determining treatment efficiency. In addition, a PRO can help to explain clinical outcomes and treatment decisions made. In recent years, many effective and reliable measures for the digestive system have been developed internationally and applied in practice. Commonly used measures include the Sickness Impact Profile (SIP),9 the Nottingham Health Profile (NHP)10 and the Quality of Well‐being (QWB).11 The Medical Outcomes Study Short Form‐36 (SF‐36) is the most well‐known and widely accepted measure.12 Specific health‐related QoL (HRQoL) measures commonly used include the Quality of life in peptic diseases (QPD) questionnaire,13 Peptic ulcer diseases questionnaire (PUDQ), Ulcer esophagitis subject symptom (UESS), Quality of life in duodenal ulcer patients (QLDUP).14 Many studies have been performed on the demographic and clinical characters and health‐related quality of life in the disease‐specific patients based on all those measures. However, these scales all have a specific focus, and cannot fully reflect the actual situation of patients with peptic ulcers. Therefore, in this study, we aimed to develop a PRO measure for peptic ulcer patients (PU‐PROM) that (I) was developed from the perspective of patients and could be widely applied in evaluations of clinical curative effect; (II) is established across four domains (physical, psychological, social and treatment) to comprehensively reflect health status and quality of life in patients with peptic ulcers; (III) can be specifically used to report the clinical outcomes of patients with peptic ulcers; (IV) comprised items that were easy to understand and answer (responses on 5‐point Likert scale).

METHODS

Ethics statement

The study protocol and the PU‐PROM were reviewed and approved by the Medical Ethics Committee of Shanxi Medical University.

Study population and design

Based on the principles of the United States FDA, we performed a comprehensive review of the literature and related measures, conducted semi‐structured interviews with patients with peptic ulcers and consulted relevant experts. We extracted and integrated information from these sources to form a theoretical framework and an initial item pool. The interview participants were 10 patients with peptic ulcers with a consistent disease distribution by sex and age, including six men and four women aged 40.01±9.81 years. The six experts consulted included three chief peptic ulcer physicians, one psychologist, one sociologist and one ethics expert. Based on the patient interviews and expert consultation, we debugged and modified the expressions of items in the initial item pool. For the first item screening stage, 200 participants were sampled from eight hospitals at different levels in Shanxi Province, China. This included 150 patients with peptic ulcers and 50 controls. Completed questionnaires were examined using classical test theory (CTT) and item response theory (IRT), to select and adjust the item pool, and a preliminary measure was developed. This was followed by a formal investigation, with 550 patients with peptic ulcers and 150 controls, using the same method to reduce the items and form the final measure. Finally, the reliability, validity, differential item functioning (DIF) and feasibility of the measure were verified.

Development of the PU‐PROM

The PU‐PROM was developed in three phases: (i) conceptual framework construction and initial item generation; (ii) formation of the final measure by two item selection process based on the CTT and IRT; and (iii) validation of the PU‐PROM. Phase 1 involved a qualitative analysis, whereas the other two phases used quantitative analyses. A flow chart of this developmental process is shown in Figure 1.
Figure 1

Developmental process flow chart

Developmental process flow chart

Step 1: Item generation

Identifying the conceptual framework and initial item content

We searched for related literature of PRO measures to build the conceptual framework of PU‐PROM. The theoretical framework was established including four domains and 12 subdomains: physiology (subdomains: physical symptoms, independence and physical status); psychology (subdomains: work stress, anxiety, depression and fear); society (subdomains: social support and social adaptation); and treatment (subdomains: compliance, degree of satisfaction and availability). Then, the patients were interviewed to understand the main symptoms, the influence of the psychological and social, and the evaluation of treatment satisfaction; all of the information were collected and collated to form the item pool. Next, the item pool was revised based on discussions with the six experts and 10 patients. They put forward items that ambiguous in words and difficult to understand should be deleted, and some items should be added. Subsequently, an initial version of the measure was developed, using four domains, 11 subdomains (independence was excluded from the physiology domain) and 64 items.

Step 2: Item selection

Sampling survey

We selected a sample comprising 150 peptic ulcer patients and 50 controls from the eight participating hospitals in Shanxi Province. Patients who were diagnosed with a definite peptic ulcer, who were fully competent and who volunteered to participate were included in this study. Patients were excluded if they had deficiencies in language or cognitive abilities that meant they could not understand or complete the questionnaire; mental illness; or disturbance of consciousness. The controls did not have peptic ulcers, malignant tumours or mental illness, and had a similar age distribution to the patient group. In the process of evaluating the patients’ completed questionnaires, 20 were invalid and 130 were valid, giving a valid response rate of 87%. The valid response rate for the controls was 100%. Reponses to all items were on a 5‐point Likert scale, where recorded as 0‐4 points. The 5‐point scale form was most commonly chosen as the easiest to complete, and item omission was least frequent with this form. Nagata suggests that the 5‐point scale is most useful for measuring health status.15 The measure contained positive items and negative items. Positive items were scored as the original score plus one and negative items were scored as five minus the original score. Missing data were tested by Little's Missing Completely at Random test, and the P‐value was <.001.16 Items considered as missing at random were imputed based on the expectation‐maximization algorithm.16

Statistical methods for item selection

The item reduction for the preliminary measure was based on CTT and IRT. CTT includes discrete trend, factor analysis, correlation coefficients, Cronbach's α if an item is deleted, retest reliability and differentiation degree analysis. These methods were combined with specialized knowledge to assess the items. Items selected at by least five methods were kept, although this meant that other methods might have suggested that the item be removed. The final version of the preliminary measure comprised four domains, 11 subdomains and 54 items (10 items were deleted).

CTT

Discrete trend
The scores of all items (derived from the 5‐point Likert scale) could be regarded as similar to normal processing. A low discrete trend indicates people inclined to select the same answer, and the item has poor evaluation ability. We used the standard deviation (SD) to measure the discrete degree of items. Items with a low SD (<1.0) were deleted.
Factor analysis
We used principal component factor analysis, with the largest orthogonal rotation according to the eigenvalue and the variance contribution rate of an item. The value for the Kaiser‐Meyer‐Olkin measure of sampling adequacy was >0.5. Items with low factor loading (<0.4) and cross‐measurement with more than one other item were deleted.
Correlation coefficient
Items were filtered by representativeness and independence, which showed the item satisfied the purpose of the PROM. An item that showed a low correlation coefficient (<0.6) in relation to its subdomain was deleted.
Cronbach's alpha if item was deleted (CAID)
The method used internal consistency to choose items and ensure homogeneity.17 The internal consistency of items was evaluated by calculating the CITC and CAID values (Cronbach's α), when the CITC value was more than 0.45, which showed the item has highly contribution to the measured construct. The CAID values determined which item has highly contribution to the reliability of the PROM. Whether the Cronbach's α coefficient showing a big increment after an item was removed indicated that item was influential for internal consistency and it should be deleted.
Retest reliability
Retest reliability reflects stability and consistency across time. We selected 4 days as the retest interval and calculated the correlation coefficient of the item score across two surveys. Items with low correlation coefficients (<0.6) were deleted.
Differentiation degree analysis
Whether the item could not make a distinction between different objects that should be deleted. We compared each item score for the patient and control groups by performing independent two‐sample t‐tests (α=0.05). Items with no statistical difference were deleted.

IRT

Item response theory is a nonlinear model used to select items and test construction. It establishes a functional relationship between a participants’ reaction to the item and their ability. This relationship is reflected by an item characteristic curve (ICC). Items were assessed using Multilog 7.03 with a grade response model. Each item's parameters of discrimination (α) and difficulty (b) were estimated. In general, items with a discrimination value of <0.4 should be deleted. Difficulty was divided into four grades (b1, b2, b3 and b4) ranging from −3 to 3. Items outside this range should be considered for deletion.

Second sampling survey

To verify the measure, we recruited 550 patients and 150 controls from the same eight hospitals, but only 492 and 124, respectively, were available to participate in the study. The response rate met the requirements, and the number of participants satisfied Nunnally's proposal.18 We used the same methods as used for the preliminary measure to revise the items. Classical test theory and item response theory were used for item reselection. Combined with professional knowledge, we used at least five methods to evaluate the items. Three item evaluation methods were discarded. The results indicated that all 54 items should be kept to form the final measure.

Step 3: Validation of the measure

Finally, we using the data obtained from these 492 patients as well as 124 control participants to examine the reliability, validity, DIF and feasibility of the final measure.

Reliability

Reliability refers to the consistency of the test results; the higher the measured value of homogeneity, the better the reliability.19 Cronbach's α coefficient and retest reliability are frequently used in reliability analyses. Cronbach's α coefficient is the most commonly used method. In this study, we calculated every subdomain's Cronbach's α coefficient. And generally, the α value should be more than 0.7. Retest reliability reflects the stability and homogeneity across time. And it is generally believed that the correlation coefficient should be more than 0.6.

Validity

Validity analysis evaluates the validity of a questionnaire. This involves content validity, construction validity and discriminant validity. Content validity reflects the degree to which the selected items represent the expected content.19 Construction validity (or structure validity) examines whether the multi‐index measurement is a professionally ideal structure, testing the structure from clinical and common sense perspectives. A measure with good construction validity can obtain true latent trait of subjects during measurement. We used confirmatory factor analysis (CFA) to build a measurement model between the item and the subdomain that included the item. We used LISREL 8.70 software (Scientific Software International. Inc. 7383 North Lincoln Avenue, Suite 100 Lincolnwood, IL 60712‐1704) for the CFA.20 In addition, the evaluation of the fit effect of the model for every domain was also used multiple indexes, commonly fit index including: GFI, RMR, NFI, NNFI, IFI, CFI.21 Discriminant validity reflects small changes across different populations and different times. It can reflect the different trait of selected subjects. Discriminant validity was assessed by comparing the mean score of the patients and the controls to ensure whether each subdomain correctly distinguish the two types of people. Generally, we used a simple independent two‐sample t‐test to compare patients and controls. When the P‐value was <.05, we considered the difference to be statistically significant, and the measure to have a good degree of differentiation.

DIF

As a test result has personal, social and political ramifications, it should be reliable, valid and fair.22 To investigate whether a test item is fair among members of different subgroups such as males and females and majority groups and minority groups, a plethora of research on DIF has been conducted.23, 24 This verified the quality of the questionnaire and ensured the validity and fairness of the measure. DIF is generally divided into two types of uniform DIF and non‐uniform DIF. Uniform DIF is present when an item differs across groups in item difficulty parameters, while non‐uniform DIF is present when an item differs across members of different subgroups in item discrimination parameters.25 The MACS model identifies non‐uniform DIF and uniform DIF using unidimensional multistage scoring. If there is no DIF in the items of all subdomains, we further confirmed it by the comparison of nested models. Comparing the chi‐square difference between the “measurement equivalence model” and the “baseline model,” if the difference was not significant, the items of the subdomains did not exist DIF; if there is DIF in the items of all subdomains, we need to compare the chi‐square difference between the “measurement equivalence model” and the “partial measurement equivalence model”; if the difference has statistical significance, indicating that the items exist DIF.

Feasibility

Feasibility is used to reflect the degree of acceptability of a measure. This is characterized by acceptance rate, response rate and completion times. In general, the recovery rate of the questionnaires should more than 85%, and the response rate also should more than 85%. In addition, time for each person answered should be controlled within 15 minutes.

Statistical software

Data analyses were performed with spss, version 16.0 (SPSS for Windows, Version 16.0. Chicago, SPSS Inc.), Multilog 7.03 and LISREL 8.70.

RESULTS

Participant characteristics

In the first survey with the preliminary measure, 130 patients with peptic ulcers aged 41.25±5.97 years and 50 controls aged 40.00±5.49 years completed the measure. In the formal survey, 492 patients aged 41.84±8.81 years and 124 controls aged 41.35±8.35 years completed the measure. Tables 1 and 2 present the participants’ characteristics, and in the first item pool reduction phase, and the revaluation and validation phase, respectively.
Table 1

Baseline data for participants in sample survey

VariablesPeptic ulcerControl t2 P
Age (years)41.25±5.9740.00±5.491.290.199
Gender
Male65312.089.148
Female6519
Height (cm)165.90±4.97165.52±4.700.466.642
Weight (kg)64.08±7.8463.64±8.030.478.634
Drinking
Never37160.616.959
Quit6223
Occasional2910
Always21
Smoking
Never1482.121.548
Quit4719
10 branches/d4412
10 branches/d~2511
Table 2

Baseline data for participants in formal survey

VariablesPeptic UlcerControl t2 P
Age (years)41.84±8.8141.35±8.350.555.579
Gender
Male283823.040.081
Female20942
Height (cm)164.87±2.26165.53±5.82−1.230.219
Weight (kg)64.96±7.2966.37±6.96−1.948.052
Drinking
Never142311.041.791
Quit22858
Occasional11032
Always123
Smoking
Never112331.577.665
Quit22850
<10 branches/d11631
10 branches/d~3610
Baseline data for participants in sample survey Baseline data for participants in formal survey

Item generation

Through a large number of literature, expert consultation and patient interviews, we conducted a conceptual framework consisted of four domains, 12 subdomains and a pool of 77 items. Next, we selected items based on interviewing 10 patients with peptic ulcer and consulting six relevant experts to ensure that all the remaining items are easy to understand and related to the topic. So, one domain and 18 items describing atypical symptoms and overlap with each other were deleted, and five items were added. Therefore, there are four domains, 11 subdomains and 64 items were generated for the initial peptic ulcer PRO measure. The items are described in Additional file 1: Appendix 1.

Item selection

The two‐step item selection process was based on CTT and IRT. This iterative process resulted in a final version comprised four domains, 11 subdomains and 54 items. For the first phase, statistical results for the items are given in Table 3. As we can see, 10 items (PHD15, PHD16, PSD14, PSD15, PSD16, PSD20, SOD4, SOD8, SOD9, THA8) were deleted based on the criteria described in the Methods. To ensure the reliability and validity of each item, we used the same methods to re‐select items and considered their practical significance based on the experts’ opinions for each item. All items remained after this process. Figure 2 shows the matrix plot of the ICCs for each item. Ideally, the first ICC curve should decrease monotonously, the last curve should increase monotonously and the other curves follow a normal distribution. The closer the ICC distribution is to the ideal state, the more information it contains, and vice versa. As seen in Figure 2, most items were satisfactory. Therefore, the preliminary measure comprised four domains, 11 subdomains and 54 items (Appendix 2).
Table 3

Item selection outcome based on CTT and IRT

SubdomainItemIRTSD t Factor LoadingCAIDCCRetest ReliabilityOutcome
ab1b2b3b4
SOMPHD12.17−0.780.270.641.841.1720.0010.7560.9020.6340.769
PHD22.97−0.380.200.571.301.2850.0010.8580.8950.7770.843
PHD32.08−0.78−0.330.141.021.2060.0010.7930.8970.7480.810
PHD42.07−1.21−0.630.080.801.1100.0010.7750.8980.7170.664
PHD52.37−0.87−0.420.010.751.1510.0010.7800.8970.7370.737
PHD61.39−1.88−1.16−0.261.211.0220.0010.6540.9000.6610.780
PHD71.45−1.66−0.750.101.851.0160.0070.6630.9000.6780.691
PHD82.18−1.39−0.460.161.231.0220.0010.4250.9010.6420.725
PHD93.12−0.61−0.500.261.101.0380.0010.5460.8970.7390.702
PHD102.61−0.95−0.420.271.191.0180.3300.5440.9030.5980.784
PHD112.18−0.93−0.67−0.151.081.0190.0040.6100.9040.5860.772
PHD121.75−4.25−0.96−0.720.230.8820.0010.7340.9040.5650.715
PHD131.75−0.570.360.861.961.2600.0390.6030.9030.6400.656
PHD141.70−4.46−0.660.070.771.0740.0010.6510.9000.6790.766
PHD150.83−7.42−1.73−0.991.620.9600.0080.4050.7970.6250.741×
PHD161.30−5.54−1.33−0.181.460.9090.0140.4170.7940.6200.784×
PHYPHD172.37−1.11−0.340.101.171.0730.1030.8150.6930.8550.760
PHD183.29−0.89−0.350.030.991.0090.0030.7940.7180.8090.828
PHD190.87−3.21−2.35−1.221.041.0040.0230.8110.7410.7650.775
WORPSD11.92−0.520.030.571.401.3540.0010.6780.8330.8810.822
PSD22.17−1.30−0.040.421.171.1710.0300.7900.8020.8760.828
PSD31.59−1.41−0.350.161.191.2110.0010.7920.7700.8960.751
ANXPSD44.43−0.65−0.090.260.951.1020.0010.6820.9120.7820.717
PSD53.89−0.68−0.210.301.181.0260.0010.7710.9040.8330.729
PSD64.28−0.64−0.220.410.931.0620.0040.8490.9010.8570.662
PSD74.04−2.56−0.200.591.021.0030.0010.8480.9060.8200.719
PSD84.04−0.67−0.080.371.041.0900.0010.8610.9010.8590.713
PSD92.87−1.20−0.420.291.130.9800.0050.7270.9110.7750.751
PSD103.99−0.50−0.370.040.961.0290.0020.7820.9070.8120.698
DEPPSD110.16−8.32−1.115.8716.961.1940.0010.7170.6450.7810.709
PSD120.55−9.25−1.570.973.621.0150.0010.7650.6610.7340.750
PSD130.20−9.58−2.453.2110.471.2070.0010.7860.5870.8310.756
PSD140.28−9.30−0.054.5213.330.9380.0010.4280.7430.6020.700×
PSD151.14−5.97−0.910.481.930.9870.0460.5940.7750.6550.736×
PSD162.24−1.88−0.450.091.220.9840.0010.4400.7730.6620.740×
FEAPSD172.70−0.90−0.60−0.210.651.0180.0040.6840.7430.7570.635
PSD181.773.90−4.44−0.751.051.0270.0870.7260.7650.6950.711
PSD192.45−1.14−0.38−0.320.821.0580.0010.7260.7260.8060.816
PSD201.74−2.02−1.09−0.640.860.8900.4220.5500.7800.6180.851×
SOCSOD12.53−0.98−0.080.281.401.0840.0010.8330.7350.7910.827
SOD23.04−0.71−0.310.091.201.0320.0010.7920.7380.7800.822
SOD32.25−1.33−0.390.151.081.0600.0010.7730.7630.7340.874
SOD41.80−2.33−0.86−0.640.560.9400.2640.4050.7880.6480.874×
SOD51.57−1.41−1.15−0.800.821.0150.0500.5540.7530.7480.893
SUPSOD60.68−5.46−1.96−0.162.431.0270.0010.5080.7990.5120.824
SOD70.28−7.28−1.091.257.271.2280.0010.6960.7360.7910.776
SOD80.54−9.140.121.515.900.9920.0220.7010.7830.5870.728×
SOD90.54−8.46−1.310.575.310.9390.3300.7790.8010.4790.766×
SOD100.44−8.62−3.33−1.422.731.0330.2020.8070.7470.7440.650
SOD110.67−5.10−2.01−1.751.851.0330.1220.8960.7320.8030.850
SOD120.56−3.91−2.84−1.141.831.1750.0190.7800.7550.7270.830
COMTHA10.98−6.64−2.25−0.252.160.8110.0270.7960.8110.8050.717
THA20.66−3.60−1.88−0.363.991.0210.0570.8790.7830.8600.789
THA30.39−6.45−3.81−0.624.601.0540.0100.7430.8150.8240.838
THA40.716.34−8.80−1.541.561.0260.1160.7220.8080.8290.700
AVATHA50.48−4.97−3.290.184.461.0210.0670.7970.6870.8130.751
THA60.77−2.88−2.25−1.102.411.0350.0010.7530.7050.7940.924
THA70.47−5.48−3.02−1.523.811.0520.1340.7900.6800.8230.776
THA80.38−7.09−5.74−3.763.280.9440.3780.5690.7950.6520.819×
SATTHA91.015.35−6.70−1.301.951.0050.0300.7320.8010.7450.860
THA100.826.24−7.88−2.202.451.0020.0090.8560.7590.8470.700
THA110.89−2.74−1.210.243.231.0040.1630.810.7730.8150.729
THA121.02−1.72−1.64−0.562.721.0400.0010.7750.7930.7680.802
THA130.38−4.82−1.56−0.395.631.2490.0010.6570.8410.7060.826

“CC” is the abbreviation of Correlation Coefficient. × represents the item considered to be deleted, and √ considered to be kept.

Figure 2

ICC matrix 1: Black, 2: Blue, 3: Magenta, 4: Green, 5: Cyan

Item selection outcome based on CTT and IRT “CC” is the abbreviation of Correlation Coefficient. × represents the item considered to be deleted, and √ considered to be kept. ICC matrix 1: Black, 2: Blue, 3: Magenta, 4: Green, 5: Cyan

Validation of the measure

The reliability, validity, DIF and feasibility of the 54 items were assessed, and the results are presented in the followed.

Reliability

Cronbach's α coefficient is an important indicator for the reliability. In general, its value should more than 0.70. For our PU‐PROM, the Cronbach's α of each subdomain was more than 0.800 for the measure and ranged from 0.817 to 0.907 for the four domains, indicating the measure was reliable (Table 4). In addition, we conducted a repeated survey of 50 patients, and the correlation coefficients of each item were >0.60, which showed the measure has high retest reliability.
Table 4

Cronbach's α coefficient of four domains and total measure

DomainSubdomainCronbach's α coefficient
PhysicalSOM0.897
PHY0.854
PsychologicalWOR0.907
ANX0.884
DEP0.884
FEA0.905
SocialSOC0.901
SUP0.817
TreatmentCOM0.844
AVA0.881
SAT0.871
Cronbach's α coefficient of four domains and total measure

Validity

The measure was also found to have good content validity as it allows direct communication with patients26, 27 and they thought the PU‐PROM was easy to understand and response. In the process of the item building and modifying phase, experts also agreed the measure was reasonable and comprehensive in content. We conducted CFA for the 54 items to investigate the factor structure of the measure. We also found that the indices of fit (GFI, RMR, NFI, NNFI, CFI, IFI) met the expected structure. On the whole, GFI, NFI, NNFI, CFI and IFI are all more than 0.90, and RMR is <0.09. The results are shown in Tables 5 and 6. The measure was able to distinguish between patients with peptic ulcers and controls. Our analysis of the different average scores using the independent two‐sample t‐test showed that all P‐values were <.05, indicating the measure had a good degree of differentiation (Table 7). As controls did not receive treatment and could not answer items in the treatment domain, no comparison was made for the SAT (satisfaction) subdomain.
Table 5

Goodness‐of‐fit statistics of CFA for PU‐PROM

GFIRMRNFINNFICFIIFI
PHD0.810.1000.880.880.900.90
PSD0.930.0560.950.960.970.97
SOD0.980.0380.980.980.990.99
THA0.940.0450.950.950.960.96
Total0.800.0720.860.910.920.92
Table 6

Maximum likelihood estimation of CFA for PU‐PROM

DomainSubdomainItemFactor loadingSE t R 2 Error variance
PHDSOMPHD10.690.0514.830.390.73
PHD20.900.0517.240.500.83
PHD30.760.0613.610.341.11
PHD40.760.0514.300.370.98
PHD50.910.0517.030.490.88
PHD60.850.0516.050.440.90
PHD70.670.0514.210.370.77
PHD80.640.0513.830.350.75
PHD90.760.0515.370.420.80
PHD100.640.0513.470.340.82
PHD110.630.0513.420.330.79
PHD120.680.0513.700.350.87
PHD130.710.0513.840.350.93
PHD140.810.0613.960.361.18
PHYPHD151.040.0423.110.810.25
PHD160.800.0417.880.540.54
PHD170.890.0420.000.650.43
PSDWORPSD11.030.0522.380.710.44
PSD21.160.0525.160.830.28
PSD31.230.0524.040.780.43
ANXPSD41.020.0519.960.610.67
PSD51.080.0521.700.680.55
PSD60.960.0422.980.730.34
PSD70.950.0520.760.640.50
PSD80.840.0517.190.490.73
PSD90.680.0513.200.320.96
PSD100.600.0512.120.280.94
DEPPSD110.950.0520.940.660.46
PSD120.890.0421.720.700.34
PSD131.090.0523.760.790.31
FEAPSD141.000.0424.810.810.23
PSD150.960.0425.100.820.20
PSD161.070.0522.240.700.49
SODSOCSOD10.940.0420.920.650.47
SOD20.990.0423.750.770.30
SOD30.960.0423.130.740.32
SOD40.990.0520.840.650.54
SUPSOD50.650.0513.440.350.79
SOD60.950.0518.700.590.64
SOD70.830.0419.940.640.39
SOD80.550.0510.570.230.98
SOD90.930.0520.050.650.47
THACOMTHA10.670.0416.140.460.53
THA20.650.0513.730.360.75
THA30.980.0422.330.750.32
THA40.970.0421.800.720.36
AVATHA50.820.0420.330.640.38
THA60.930.0423.730.800.22
THA70.890.0421.710.700.33
SATTHA80.630.0513.960.360.71
THA90.890.0423.340.760.25
THA100.870.0422.710.730.28
THA110.740.0418.370.550.46
THA120.750.0418.320.540.48
Table 7

Scores comparison between peptic ulcer patients and controls

SubdomainPeptic UlcerControls t/t′ P
SOM47.07±11.0261.50±2.08−27.197<.001
PHY11.93±2.9613.31±0.92−8.781<.001
WOR9.77±3.5912.12±1.22−12.046<.001
ANX23.88±6.4930.26±1.47−19.869<.001
DEP9.96±3.1212.66±1.07−15.866<.001
FEA11.57±3.1713.36±0.96−10.763<.001
SOC14.26±4.0816.93±1.31−12.219<.001
SUP19.03±4.3321.39±1.42−10.074<.001
Goodness‐of‐fit statistics of CFA for PU‐PROM Maximum likelihood estimation of CFA for PU‐PROM Scores comparison between peptic ulcer patients and controls

DIF

This study used a mean and covariance structure (MACS) model based on sex for the DIF analysis, through which we examined whether there were differences between men and women. We performed DIF analysis for the 11 subdomains by sex (Table 8). As the subdomains including: physical status (PHY), work stress (WOR), depression (DEP), fear (FEA) and availability (AVA) all contained only three items, their degree of freedom was 0, which cannot be well fitted the “baseline model,” so in the study, items contained in these subdomains did not exist DIF. For the subdomain of “social adaptation (SUP),” the result suggested that there are differences in model fitting, items exist DIF, but modification index (MI) prompted the item difficulty parameters and discrimination parameters are cross gender equal. The results showed there is not significant DIF. Other subdomains of DIF analysis results are shown that the items of the PU‐PROM do not exist DIF.
Table 8

Transgender DIF nested model results

χ2 df GFIRMRRMSEANFINNFICFIIFIΔχ2 Δdf
SOMMeasurement equivalence model1032.5611950.8060.1230.1320.8690.9010.8940.894
Baseline model1001.5531540.8050.1080.1500.8730.8720.8920.89231.00841
MI1=2.662, P>.05/14MI2=2.211, P>.05/13 P>.05
PHYMeasurement equivalence model14.42380.9720.1430.05720.9760.9910.9890.988
WORMeasurement equivalence model10.23880.9850.05950.03380.9880.9980.9970.997
ANXMeasurement equivalence model170.847480.9100.1050.1020.9410.9620.9570.956
Baseline model154.355100.9240.07030.1360.9460.9330.9550.95616.49238
MI1=4.288, P>.05/7MI2=1.082, P>.05/6 P>.05
DEPMeasurement equivalence model12.24780.9850.1060.04650.9840.9950.9940.994
FEAMeasurement equivalence model9.31380.9800.06780.02590.9890.9990.9980.998
SOCMeasurement equivalence model21.438150.9700.05250.04190.9850.9970.9960.996
Baseline model17.67640.9730.03030.1180.9880.9730.9910.9913.76211
MI1=0.743, P>.05/4MI2=1.321, P>.05/3 P>.05
SUPMeasurement equivalence model53.386240.9580.08690.07070.9540.9780.9740.974
Baseline model28.690100.9750.05010.08730.9750.9660.9830.98324.69614
MI1=2.099, P>.05/5MI2=2.216 (SOD6), P>.05/4 P <.05
Partial measurement equivalence model53.412230.9580.08700.07350.9540.9770.9730.973−0.0261
MI3=2.134, P>.05/4MI4=2.215, P>.05/4 P>.05
COMMeasurement equivalence model100.327150.8920.09570.1520.8970.9280.9100.910
Baseline model91.54540.8990.07410.2990.9090.7360.9120.9138.78211
MI1=0.780, P>.05/4MI2=0.997, P>.05/3 P>.05
AVAMeasurement equivalence model8.93480.9830.06280.02180.9870.9990.9980.998
SATMeasurement equivalence model50.964240.9540.1540.06770.9680.9850.9820.982
Baseline model36.804100.9710.03710.1050.9770.9650.9830.98314.1614
MI1=0.417, P>.05/5MI2=1.411, P>.05/4 P>.05

Modification index 1 (MI1) represents the largest fixed index associated with the intercept, and MI2 is associated with the load of the factors. MI3, MI4 represent the above interpretation after the item “SOD6” being removed, respectively.

Transgender DIF nested model results Modification index 1 (MI1) represents the largest fixed index associated with the intercept, and MI2 is associated with the load of the factors. MI3, MI4 represent the above interpretation after the item “SOD6” being removed, respectively.

Feasibility

The acceptance rate and completion rate of the measure were beyond 85%, and the average completion time was within 15 minutes, indicating that the measure was feasible. Therefore, the final PU‐PROM is comprised of four domains, 11 subdomains and 54 items (Appendix 3) ,and the theoretical framework is shown in the Table 9.
Table 9

Construction frame of final PU‐PROM

DomainSubdomainItem
Physical domain (PHD)Physical symptoms (SOM)1−, 2−, 3−, 4−, 5−, 6−, 7−, 8−, 9−, 10−, 11−, 12−, 13, 14−
Physical status (PHY)15−, 16−, 17−
Psychological domain (PSD)Work stress (WOR)1−, 2−, 3−
Anxiety (ANX)4−, 5−, 6−, 7−, 8−, 9−, 10−
Depression (DEP)11−, 12, 13
Fear (FEA)14−, 15−, 16−
Social domain (SOD)Social support (SOC)1−, 2−, 3−, 4−
Social adaptation (SUP)5, 6, 7, 8, 9
Treatment domain (THA)Compliance (COM)1, 2, 3, 4
Availability (AVA)5, 6, 7
Satisfaction (SAT)8−, 9, 10, 11, 12

“−”means negative item, others means positive item.

Construction frame of final PU‐PROM “−”means negative item, others means positive item.

DISCUSSION

Peptic ulcers have various causes and mainly occur in the stomach and duodenum mucosa. A peptic ulcer is a chronic disease characterized by high incidence, low mortality, spontaneous remission and periodical paroxysms. The main peptic ulcer complications are haemorrhage and perforation. The disease leads to a decrease in productivity and brings significant loss to society, and the treatment cost contributes to social and economic burdens. Therefore, a PRO measure for peptic ulcers may improve patients’ QoL and can be used to evaluate clinical curative effect. Patients are increasingly involved in evaluations of health‐care quality.28, 29, 30 Internationally, many HRQoL measures have been developed and applied in chronic diseases of the digestive system. However, existing measures have some deficiencies. For example, the NHP focuses on a more serious disability level and is not sensitive to relatively mild condition changes; the SIP has wide coverage, but is very long; and the SF‐36 is widely used, but does not identify specific areas of the disease. The QPD is restricted to functional dyspepsia patients. The UESS involves fewer items and uses a 100 mm visual record to show the degree of symptom severity; higher scores indicate more serious symptoms. The PUDQ only involves three aspects of ulcers (pain, mood and social function) and does not accurately reflect the status of the disease. The QLDUP only reflects QOL in duodenal ulcer patients. In addition, at present, these questionnaires are mainly focused on physiology, psychology and society, and are limited. Our peptic ulcer PRO measure (PU‐PROM) has improved on the disadvantages of the above tools. This is a specific measure for peptic ulcers. It has a high correlation with the disease, and the results can reflect the actual life‐experience of patients. Our PU‐PROM also includes a new and significant concept of a treatment domain, which is comprehensive, and does not only consider the HRQoL index in the traditional sense. By measuring the patient's satisfaction, compliance and side‐effects of drugs, our measure also provides a basis for clinical treatment, new drug research and development, and clinical review. In developing the measure, we used cognitive investigation to form the conceptual framework, CTT and IRT to select items, and CFA to validate items. The United States FDA has emphasized the importance of clinical outcomes and provided guidance for the establishment of PRO measures.31 This study was based on FDA guidance, and our methods of investigation strictly followed the established PRO measure production process. We used expert and patient opinions and suggestions to build an initial measure. A sample investigation that combined CTT and IRT was used to select items. After a large‐scale formal investigation, we evaluated the reliability, validity, DIF and feasibility of the measure, finalizing a PRO measure for patients with peptic ulcers that included four domains, 11 subdomains and 54 items. A standard operating procedure was used to: generate appropriate items and domains; ensure the instrument was comprehensive relative to its intended measurement concept, population and context of use; and ensure patient understanding of the instrument (i.e, instructions, items and response options).32 In contrast to previous assessments of measures, we directed attention to the items rather than the structure validity of the measure. Items for the PU‐PROM were based on a review of the literature and other related questionnaires, face‐to‐face interviews with patients and discussions with expert professionals. The content validity index further strengthened the content validity of our preliminary measure, as in the development process, we selected items by this index. The role of content validity index in the process of preparation and evaluation cannot be ignored, and can meet the quality requirements of the measure before implementation. In the development stage, we used CTT and IRT to select the items, striving for items that had strong representativeness, independence and high sensitivity. CTT is easier to understand and is more commonly used than IRT. However, it neglects the estimation of the respondent's ability, and the reliability of the results is inadequate. Compared with the CTT, IRT has some advantages including: the estimate of the respondent's ability is independent of the item; the difficulty parameter of the items and respondent's ability is unified; parameter estimation of items is independent; and the accuracy of the estimator of the respondent's ability can be estimated. Use of the IRT enriched the representativeness, independence, internal consistency, sensitivity, fairness and importance of the items. However, the results of the measure should also be considered in combination with clinical knowledge and the patient's illness and psychological state, to ensure the quality of the measure. Differential item functioning is a research hotspot in the field of psychology and education measurement. DIF is more commonly used in the detection of fairness and effectiveness of examination questions. This study introduced DIF into the process of developing a clinical measure and broadened the application scope of DIF. The influence of DIF on the content of the measure provided a new method for item selection and content evaluation, and improved the quality of the developed measure. The PU‐PROM we developed fills a gap in clinical outcome measurement for patients with peptic ulcers, and addresses the deficiencies in existing tools. It will also provide valuable data for new drug development for peptic ulcers, because PROs are increasingly included as key primary or secondary end points in clinical studies to support drug development.33 However, there were some limitations in this study that should be resolved and improved in the future research. First, there were two clinical investigations during the development of the measure, and the results might have been affected by the investigation environment to produce bias. Respondents and investigators might have also affected the results of the study. Second, we did not use criterion validity to measure the PRO measure. As the content of the measure is various, and considering the patients’ physical and psychological states, we did not choose a well‐established measure as a criterion to test consistency. Third, the PRO measure scores were calculated using a 5‐point Likert scale, but there is no clear and suitable method to evaluate the overall QoL. Forth, the sample populations may not fully represent the entire population of patients with peptic ulcer. Our participants were from only the Shanxi province in northern China. Therefore, future research should explore the reliability and validity of the PU‐PROM with a nationwide sample. The PU‐PROM was administrated to native‐Chinese speaking individuals. Therefore, further work is needed to conduct cross‐cultural adaptation in different countries. Fifth, we performed DIF analysis for the 11 subdomains by sex, which showed sex had no influence on peptic ulcer, but we did not analyse age. We should consider the effect of age in the next application and development of the PU‐PROM. In addition, there are no standard quantitative indicators to support clinical decision making for the corresponding disease. Finally, we did not consider the demands of DIF analysis in the design phase, which made the numbers of items in some subdomains too small, meaning that in the process of DIF analysis, a “baseline model” could not be implemented. Additional studies should further expand the scope as well as the number of participants. We should also compare our PU‐PROM with a criterion measure and assess the measure in terms of the range, reliability, validity and applicability.

CONCLUSIONS

Our study makes important contributions to the treatment and outcomes of patients with peptic ulcers and develops a specific measurement instrument for this group. We found strong evidence for the reliability and validity of our PU‐PROM. However, we do not consider that our PU‐PROM is able to replace other related questionnaires. Therefore, we need to further improve the measure to ensure it suitable for a wider range of people. We could also extend the measure for other uses such as patients’ health conditions, clinical effects evaluation, new drug development, health service deployment and clinical research.

CONFLICT OF INTEREST

The authors declare that they have no conflict of interest.

HUMANS AND ANIMAL RIGHTS

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

INFORMED CONSENT

Informed consent was obtained from all individual participants included in the study.
ItemItem
PHD1. Do you have epigastric pain?PSD14. Are you optimistic about the future?
PHD2. Does the pain change with food?PSD15. Are you worried about bringing harm to yourself or a loved one?
PHD3. Is the pain getting worse when you are hungry?PSD16. Are you feeling fine about everything? Nothing bad will happen, right?
PHD4. Is the pain getting worse after meals?PSD17. Do you feel frustrated and hopeless about your illness?
PHD5. Do you have epigastric pain during the night?PSD18. Do you feel the illness is a burden of your family?
PHD6. Is the epigastric pain regular?PSD19. I don't want to talk about my illness to other people.
PHD7. Do you have abdominal distension?PSD20. I am not interested in social activities any more.
PHD8. Do you have heartburn in your stomach?SOD1. Is your job affected by your illness?
PHD9. Do you have acid regurgitation?SOD2. Are your hobbies affected by your illness (such as playing chess, dancing)?
PHD10. Do you have eructation?SOD3. Does your illness prevent you from taking family responsibilities?
PHD11. Do you feel nauseated?SOD4. Does your illness estrange you from your relatives, neighbours and friends?
PHD12. Do you have hematemesis?SOD5. Does your illness prevent you from participating the social and family activities?
PHD13. Is your bowel movement OK?SOD6. My family is concerned about my illness.
PHD14. Have you noticed any changes in the colour of your faeces, for example, are they getting darker?SOD7. My relatives, neighbours and friends all care about my illness.
PHD15. Do you feel dizzy?SOD8. My relatives, neighbours and friends all give me material help and support.
PHD16. Do you feel general weakness?SOD9. My relatives, neighbours and friends all give me spiritual help and support.
PHD17. Do you feel fatigue?SOD10. My family gives me material help and support.
PHD18. Do you have loss of appetite?SOD11. My family gives me spiritual help and support.
PHD19. Have you lost any weight?SOD12. The family often reminds me of medication.
PSD1. Do you do repetitive work?THA1. Take my medicine as instructed.
PSD2. Is your work trivial, complicated and big workload?THA2. I follow my doctor's instruction and get rid of my bad habits.
PSD3. Does your job have requirement on hours and speed?THA3. I follow my doctor's instruction and do regular follow‐ups.
PSD4. Are you stressed or nervous than usual?THA4. All of the checks and tests about my illness are necessary.
PSD5. Are you more irritable?THA5. Treatment is effective for my illness..
PSD6. Do you get angry more easily than usual?THA6. My mood improved after treatment.
PSD7. Do you feel unhappy and depressed?THA7. I have physical improvement after treatment.
PSD8. Are you worried about the epigastric pain?THA8. My life confidence increased after treatment.
PSD9. Is your sleep affected by the pain?THA9. Are you worried about the side‐effects of your medicine?
PSD10. Are you bothered by your indigestion?THA10. The doctors are friendly to me.
PSD11. Do you feel it difficult to concentrate to do one thing?THA11. Are you satisfied with the medical services?
PSD12. Do you have no difficulty in doing your daily activities?THA12. Are you satisfied with the costs of medical care?
PSD13. Are you still interested in the activities you love to do?THA13. Are you satisfied with current treatment?
ItemItem
PHD1. Do you have epigastric pain?PSD11. Do you feel it difficult to concentrate to do one thing?
PHD2. Does the pain change with food?PSD12. Do you have difficulty in doing your daily activities?
PHD3. Is the pain getting worse when you are hungry?PSD13. Are you still interested in the activities you love to do?
PHD4. Is the pain getting worse after meals?PSD14. Do you feel frustrated and hopeless about your illness?
PHD5. Do you have epigastric pain during the night?PSD15. Do you feel the illness is a burden of your family?
PHD6. Is the epigastric pain regular?PSD16. I don't want to talk about my illness to other people.
PHD7. Do you have abdominal distension?SOD1. Is your job affected by your illness?
PHD8. Do you have heartburn in your stomach?SOD2. Are your hobbies affected by your illness (such as playing chess, dancing)?
PHD9. Do you have acid regurgitation?SOD3. Does your illness prevent you from taking family responsibilities?
PHD10. Do you have eructation?SOD4. Does your illness estrange you from participating the social and family activities?
PHD11. Do you feel nauseated?SOD5. My family is concerned about my illness.
PHD12. Do you have hematemesis?SOD6. My relatives, neighbours and friends all care about my illness.
PHD13. Is your bowel movement OK?SOD7. My family gives me material help and support.
PHD14. Have you noticed any changes in the colour of your faeces, for example, are they getting darker?SOD8. My family gives me spiritual help and support.
PHD15. Do you feel fatigue?SOD9. The family often reminds me of medication.
PHD16. Do you have loss of appetite?THA1. Take my medicine as instructed.
PHD17. Have you lost any weight?THA2. I follow my doctor's instruction and get rid of my bad habits.
PSD1. Do you do repetitive work?THA3. I follow my doctor's instruction and do regular follow‐ups.
PSD2. Is your work trivial, complicated and big workload?THA4. All of the checks and tests about my illness are necessary.
PSD3. Does your job have requirement on hours and speed?THA5. Treatment is effective for my illness.
PSD4. Are you stressed or nervous than usual?THA6. My mood improved after treatment.
PSD5. Are you more irritable?THA7. I have physical improvement after treatment.
PSD6. Do you get angry more easily than usual?THA8. Are you worried about the side‐effects of your medicine?
PSD7. Do you feel unhappy and depressed?THA9. The doctors are friendly to me.
PSD8. Are you worried about the epigastric pain?THA10. Are you satisfied with the medical services?
PSD9. Is your sleep affected by the pain?THA11. Are you satisfied with the costs of medical care?
PSD10. Are you bothered by your indigestion?THA12. Are you satisfied with current treatment?
NeverOccasionallyAbout half of the timeOftenAlmost everyday
A. Physical domain
1. I had epigastric pain01234
2. I felt the pain change with food01234
3. I thought the pain getting worse when I am hungry01234
4. I thought the pain getting worse after meals01234
5. I had epigastric pain during the night01234
6. I had epigastric pain regular01234
7. I had abdominal distension01234
8. I had heartburn in my stomach01234
9. I had acid regurgitation01234
10. I had eructation01234
11. I felt nausea01234
12. I had hematemesis01234
13. I thought my bowel movement is OK01234
14. My face looked dark and dull01234
15. I felt fatigue01234
16. I felt loss of appetite01234
17. I was losing weight01234
  21 in total

1.  A review of patient-reported outcome labels in the United States: 2006 to 2010.

Authors:  Ari Gnanasakthy; Margaret Mordin; Marci Clark; Carla DeMuro; Sheri Fehnel; Catherine Copley-Merriman
Journal:  Value Health       Date:  2012-02-02       Impact factor: 5.725

2.  Patient-reported experiences with hospitals: comparison of proxy and patient scores using propensity-score matching.

Authors:  Oyvind Bjertnaes
Journal:  Int J Qual Health Care       Date:  2013-12-10       Impact factor: 2.038

3.  The Sickness Impact Profile: development and final revision of a health status measure.

Authors:  M Bergner; R A Bobbitt; W B Carter; B S Gilson
Journal:  Med Care       Date:  1981-08       Impact factor: 2.983

4.  Measuring quality of life in dyspeptic patients: development and validation of a new specific health status questionnaire: final report from the Italian QPD project involving 4000 patients.

Authors:  F Bamfi; A Olivieri; F Arpinelli; G De Carli; G Recchia; L Gandolfi; L Norberto; F Pacini; C Surrenti; S H Irvine; G Apolone
Journal:  Am J Gastroenterol       Date:  1999-03       Impact factor: 10.864

5.  The association of hospital quality ratings with adverse events.

Authors:  Joel S Weissman; Lenny López; Eric C Schneider; Arnold M Epstein; Stu Lipsitz; Saul N Weingart
Journal:  Int J Qual Health Care       Date:  2014-01-30       Impact factor: 2.038

6.  Choice of response scale for health measurement: comparison of 4, 5, and 7-point scales and visual analog scale.

Authors:  C Nagata; M Ido; H Shimizu; A Misao; H Matsuura
Journal:  J Epidemiol       Date:  1996-12       Impact factor: 3.211

7.  PRO development: rigorous qualitative research as the crucial foundation.

Authors:  Kathryn Eilene Lasch; Patrick Marquis; Marc Vigneux; Linda Abetz; Benoit Arnould; Martha Bayliss; Bruce Crawford; Kathleen Rosa
Journal:  Qual Life Res       Date:  2010-05-30       Impact factor: 4.147

8.  A prospective study of risk for peptic ulcer disease in Seventh-Day Adventists.

Authors:  J H Kurata; A N Nogawa; D E Abbey; F Petersen
Journal:  Gastroenterology       Date:  1992-03       Impact factor: 22.682

9.  Effectiveness of a patient education intervention in enhancing the self-efficacy of hospitalized patients to recognize and report acute deteriorating conditions.

Authors:  Min Ting Alicia See; Wai-Chi Sally Chan; Paul John Huggan; Yee Kian Tay; Sok Ying Liaw
Journal:  Patient Educ Couns       Date:  2014-07-24

Review 10.  Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

Authors:  Margaret Rothman; Laurie Burke; Pennifer Erickson; Nancy Kline Leidy; Donald L Patrick; Charles D Petrie
Journal:  Value Health       Date:  2009-09-25       Impact factor: 5.725

View more
  3 in total

1.  Application of Patient-Reported Outcome Measurements in Clinical Trials in China.

Authors:  Hui Zhou; Mi Yao; Xiaodan Gu; Mingrui Liu; Ruifeng Zeng; Qin Li; Tingjia Chen; Wen He; Xiao Chen; Gang Yuan
Journal:  JAMA Netw Open       Date:  2022-05-02

2.  The PU-PROM: A patient-reported outcome measure for peptic ulcer disease.

Authors:  Na Liu; Jing Lv; Jinchun Liu; Yanbo Zhang
Journal:  Health Expect       Date:  2017-06-21       Impact factor: 3.377

Review 3.  Towards a core outcome set for hemorrhoidal disease-a systematic review of outcomes reported in literature.

Authors:  R R van Tol; E van Zwietering; J Kleijnen; J Melenhorst; L P S Stassen; C D Dirksen; S O Breukink
Journal:  Int J Colorectal Dis       Date:  2018-04-22       Impact factor: 2.571

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.