Building a Citizen Pscientist: Advancing Patient-Centered Psoriasis Research by Empowering Patients as Contributors and Analysts.

INTRODUCTION: To design and implement a novel cloud-based digital platform that allows psoriatic patients and researchers to engage in the research process.
METHODS: Citizen Pscientist (CP) was created by the National Psoriasis Foundation (NPF) to support and educate the global psoriatic disease community, where patients and researchers have the ability to analyze data. Psoriatic patients were invited to enroll in CP and contribute health data to a cloud database by responding to a 59-question online survey. They were then invited to perform their own analyses of the data using built-in visualization tools allowing for the creation of "discovery charts." These charts were posted on the CP website allowing for further discussion.
RESULTS: As of May 2017, 3534 patients have enrolled in CP and have collectively contributed over 200,000 data points on their health status. Patients posted 70 discovery charts, generating 209 discussion comments.
CONCLUSION: With the growing influence of the internet and technology in society, medical research can be enhanced by crowdsourcing and online patient portals. Patient discovery charts focused on the topics of psoriatic disease demographics, clinical features, environmental triggers, and quality of life. Patients noted that the CP platform adds to their well-being and allows them to express what research questions matter most to them in a direct and quantifiable way. The implementation of CP is a successful and novel method of allowing patients to engage in research. Thus, CP is an important tool to promote patient-centered psoriatic disease research.

Introduction

Psoriasis is a common chronic autoimmune and inflammatory disease that affects the skin and causes a significant impact on quality of life, affecting approximately 2–4% of the US population [1, 2]. It is characterized by sharply demarcated, scaly, and erythematous skin lesions most commonly affecting the scalp, elbows, knees, feet, and trunk. Psoriatic arthritis (PsA), depression, anxiety, physical inactivity, and social isolation may also develop, which contribute further to the social stigma and burden caused by psoriasis [3-5]. Psoriasis is also strongly associated with diabetes and major cardiovascular events, with excess mortality seen in patients with psoriasis affecting 10% or more of the body surface area [6-9]. An important aspect of managing psoriatic disease is to address the psychosocial and physical symptoms through support, in which patients often benefit from sharing their experiences with a community of psoriatic patients [3, 5].

Traditionally, patients have not been included in contributing to research design and analysis because of under-recognition of the value of their contributions as research partners [10, 11]. There is a broader challenge of engaging patients in research that includes the lack of patient expertise or involvement. If only the perspective of researchers is represented, topics of less importance to patients may be explored, thus providing results that are of limited use. Given increasing social media utilization and the proportion of adults that seek health information from the internet, online crowdsourcing platforms have become innovative tools that actively engage patients in the research process [12-14]. Crowdsourcing solicits creative ideas from paid consumers who complete a requested task. Although crowdsourcing in its most general sense involves non-selective participation, a major advantage of disease-specific portals is their potential for optimization of patient groups that have different needs than the general population [15-18].

There are several online portals that invite patients to participate in the research process by contributing health data or ideas and observing the participants’ results (Table 1). PatientsLikeMe allows patients to share information about their disease with other participants and companies to develop improved healthcare tools or services, in which 5789 psoriasis patients are registered [19, 20]. However, data is outsourced to partner pharmaceutical and clinical trials research companies, which some patients may not feel comfortable with [21]. The Global Parents for Eczema Research analyzed “patient and caregiver chatter” from social networks for atopic dermatitis (AD), identifying topics on topical treatments, the side effects of steroids, and diet [22]. CureTogether, a website with patient-generated symptom and treatment data on skin diseases, was created in order to diversify participants and increase participation and has 335 enrolled psoriasis patients [23, 24].

Table 1

Online disease portals with network health science

Project name, condition(s), (website)	Innovative features	Role in medical research
Specific condition(s)
Citizen Pscientist [27], psoriasis and psoriatic arthritis, (www.citizenpscientist.org)	First organization in USA to crowdsource psoriasis and psoriatic arthritis patient information Consists of over 3500 members Users can analyze data and create graphs	Overseen by a governing council composed of in-house research staff, patients, dermatology, and rheumatology researchers Cloud-based data set for analysis and to understand research priorities that are most important to patients Exploration of innovative hypotheses of psoriatic demographics and clinical outcomes
Citizen Science [78], cancer, (http://www.cancerresearchuk.org)	World’s first organization to crowdsource cancer research by incorporating data analysis into apps and games Consists of 500,000 global volunteers Project was set up on the basis of the idea that collective efforts could free up specialists’ time	Study showed that crowdsourcing the general public could provide accurate estrogen receptor data using cell images
Creaky Joints Arthritis Power [79], arthritis, (https://arthritispower.creakyjoints.org/#one)	Arthritis Power allows patients to track symptoms, treatment, and other health information Can be used for patients to track their symptoms over time	De-identified data will be analyzed by researchers to advance personalized medicine
Digital Alzheimer Center (DAC) [80], Alzheimer’s disease, (https://www.alzheimercentrum.nl)	The first patient portal on dementia care in the Netherlands Offers information on dementia to enhance social activities, provides support and peer-to-peer contact	Tested the usability and usefulness of an internet portal for patients and their caregivers Mixed methods were used: observations of patients and caregivers while they perform prescribed tasks on the DAC; an online survey among patients and caregivers; and semistructured interviews with patients, caregivers, and healthcare professionals
Global Parents for Eczema Research [22], pediatric atopic dermatitis, (http://www.parentsforeczemaresearch.org)	Developed a computer technique from Natural Language Processing called topic modeling to summarize and analyze patient and caregiver posts from seven online social networks with active atopic dermatitis communities, which then underwent human review by a parent/caregiver of AD on the team	Analyzed 10,000 online posts and following the analysis by the parent/caregiver; 37 topics emerged from the batch—the most common topics dealt with issues related to topical treatment such as moisturizers and ointments, side effects of steroids, and connection between AD and diet (in that order)
Precision Medicine Advances using Nationally Crowdsourced Comparative Effectiveness Research (PRANCCER) [81], cardiovascular disease, (http://www.heart.org)	A joint effort between Patient-Centered Outcomes Research Institute (PCORI) and the American Heart Association that used crowdsourcing with input from patients, clinicians, family caregivers, and researchers	Identify priorities for ideation in cardiovascular disease research
Crohn & Colitis Foundation of America (CCFA) Partners, (https://ccfa.med.unc.edu/research)	CCFA Partners is an internet-based study of patients with Crohn’s disease or ulcerative colitis Patients fill out a survey twice a year As of July 2017, 156 proposed questions, 1800 votes cast, 270 comments	Patients can cast up to five “votes” to prioritize research projects and propose new topics
Multiple conditions
CureTogether [23, 24], (http://curetogether.com)	Largest available, real-world database studying 576 conditions with over 3 million data points 12,000 members in 112 countries Uses crowdsourcing to quantify “collective patient experience” Patients can report and track health outcomes (e.g., weight, pain) and connect with other users	Emphasis on rare or underfunded diseases Data on co-morbidities using only patient-contributed data
PatientsLikeMe [19, 20, 82], (https://www.patientslikeme.com)	Members can share symptoms, treatments, health data, and opinions	In-house research team that uses the large-scale data for different research outcomes
Public-Led Online Trials-Infrastructure and Tools, (http://www.ithinkwell.org)	Crowdsources research ideas and health data	Develop online randomized controlled trial (RCT) to assess shared decision-making for better health and well-being through building and testing infrastructure for valid online trials

Similarly, Citizen Pscientist (CP) was developed as a method of support and education for the psoriatic disease community. However, CP is distinct from any other crowdsourced projects in that patients are directly involved in their own research as both data contributors and research analysts. The CP research project was created in 2015 by the National Psoriasis Foundation (NPF) and funded through a Pipeline-to-Proposal Award from a US non-profit organization, the PCORI [25]. The objective of CP is to engage psoriasis patients in the research process, as the role of both subjects and “pscientists.” The initiation and implementation of CP were overseen by a CP governing council of patients, psoriatic disease researchers, and NPF staff. Here, we describe a novel approach of patient-driven research and share the experience of implementing a psoriatic disease-specific interactive patient database through CP.

Methods

CP Structure and Survey

A CP governing council, composed of patients, researchers, and NPF staff generated 59 initial survey questions asking about health data on demographics, family history, symptoms, disease onset, psoriasis subtypes, disease severity, triggers, quality of life, associated co-morbidities, and response to interventions. The CP survey followed the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) reporting criteria [26].

Patient Recruitment and Enrollment

Patients were invited to enroll in CP through a website (www.citizenpscientist.org) promoted by NPF. Individuals registered on the CP portal with a valid e-mail address, which allowed for the establishment of a single user profile. Electronic informed consent was obtained from all participants at enrollment.

Recruitment was conducted through NPF’s patient membership listserve, main website, social media outlets, the Patient Navigation Center, Psoriasis Advance magazine, and promotional materials used at NPF in-person events. The NPF currently has a strong social media presence for adequate marketing potential, as demonstrated by 71,190 “likes” and 68,054 followers on Facebook, 19,700 followers on Twitter, and 2180 followers on Linked-In.

Patient-Generated Data

CP’s most unique aspect allows patients to explore de-identified patient-generated data and examine the relationship between any two variables from the intake survey. Such findings are posted as charts on the website, which are named “discovery charts.” After the results are posted online, any of the users can comment on the output. The features of openly publishing results to the CP community promote further explorations or allow patients to discuss or relate the findings to their own experiences or knowledge about their condition. Researchers, such as those at academic universities, are also able to analyze the data (Fig. 1).

Fig. 1

Workflow process of Citizen Pscientist. The CP Governing Council helps develop survey questions, which the CP patients answer. This data is then stored in a de-identified cloud database. Then, CP patients and the psoriatic research community can analyze the data, post discoveries, and generate discussion about the findings. These activities inform future survey questions and CP initiatives

The content of new survey questions can be informed by patient input. The CP governing council previously published on patient priorities for comparative effectiveness research (CER) within the CP community and our survey reflects these topics of importance identified by patients [27].

Data Analysis

Patient demographics and clinical characteristics were tabulated by frequency using Microsoft Excel and STATA Special Edition, version 14.2 (College Station, TX). Geographical data was analyzed using ArcGIS Online mapping software (Environmental Systems Research Institute, Redlands, CA, USA). All patient-generated discovery charts up to September 2017 were analyzed for the content of topics. Missing data were included in the analysis and were specified as “no response” in the results table.

Compliance with Ethics Guidelines

Institutional review board (IRB) approval for CP was obtained from Genetic Alliance, which includes patients outside of the USA.

Results

Patient Participation

As of May 2017, there were 3534 users on the CP platform contributing over 200,000 data points. CP members were well distributed geographically in the USA; there were members from every state and territory (Fig. 2). Globally, CP members were primarily from the USA, UK, France, India, and Australia (Fig. 3). CP members were also observed from Fiji, Samoa, New Zealand, Iceland, Saudi Arabia, Singapore, Taipei, Finland, Syria, Greece, Austria, Russia, the Caribbean, and South Africa, among others.

Fig. 2

Geographical distribution of CP users in the USA, October 2017

Fig. 3

Worldwide geographical distribution of CP users, October 2017, n = 3404

The activity of CP users over time is monitored. Unique visits to the site averaged 800 per month from May to December 2017 for a total of 6409 visits by CP users, and the highest activity was in July and August.

Patient Demographics

At baseline, 3246 (91.9%) reported having physician-diagnosed psoriasis and 1545 (43.7%) reported having physician-diagnosed psoriatic arthritis (Table 2). A small percentage of CP users (8.1%) did not specify psoriasis status. The majority of CP users are greater than 40 years of age; few users of the CP platform are below the age of 18 (1.6%). There is a female predominance (60.9%) among the CP community with male members only representing approximately 27.3%, though 11.8% did not answer data on sex. The racial background of the CP community was determined from questions on parental ancestry rather than self-report of ethnicity. The CP membership is predominantly White/Caucasian (69.6%), followed by Asian (4.9%), Hispanic/Latino (4.5%), American Indian/Alaskan Native (3.4%), Black/African American (1.7%), and Native Hawaiian/Pacific Islander (0.3%).

Table 2

Demographics of CP members, May 2017

Member characteristic	Frequency, n (%)
Disease
Psoriasisa	3246 (91.9)
Psoriasis with psoriatic arthritis	1545 (43.7)
No responsea	288 (8.1)
Agea
Under 18	56 (1.6)
18–30	383 (10.8)
31–40	541 (15.3)
41–50	699 (19.8)
51–65	1105 (31.3)
Over 65	354 (10.0)
No response	396 (11.2)
Genderb
Female	2151 (60.9)
Male	964 (27.3)
No response	419 (11.8)
Racial/ethnic background*,b
White/Caucasian	4918 (69.6)
Asian	346 (4.9)
Hispanic/Latino	317 (4.5)
American Indian/Alaskan Native	242 (3.4)
Black/African American	122 (1.7)
Native Hawaiian/Pacific Islander	19 (0.3)
Other	1253 (17.7)
No response	979 (13.9)
Alcohol consumption (drinks per week)
1–3	972 (27.5)
4–6	295 (8.3)
7–9	191 (5.4)
10 or more	191 (5.4)
I don’t drink	1338 (37.9)
No response	547 (15.4)
Smoking (cigarettes per day)
1–10	208 (5.9)
11–20	167 (4.7)
> 20	57 (1.6)
Not daily smoker	179 (5.1)
Non-smoker	2365 (67.0)
No response	558 (15.8)
Immediate family with psoriasisa	1296 (36.7)
Immediate family with psoriatic arthritisa	921 (26.1)

*Total sum > 100% because of multiple responses by subjects

aCalculated using total number of subjects (n = 3534)

bCalculated using ethnic data from both mother and father (n = 7068)

Approximately 38% of CP users do not consume alcohol, while a similar proportion report having six drinks or less in 1 week and a minority consumes more than seven drinks per week (11%). The majority of CP users (67%) do not smoke, with 12.2% smoking one or more cigarettes per day. Regarding family history, 36.7% of the CP users report an immediate family member with psoriasis and 26.1% report an immediate family member with psoriatic arthritis.

Clinical Characteristics

It is well known from the literature that psoriatic disease patients have an increased risk of cardiovascular and autoimmune diseases [7, 28–32]. The most frequently reported comorbidities among the CP users include high blood pressure (22.4%), high cholesterol (20.1%), high triglycerides (9.6%), sleep apnea (10.1%), thyroid disease (11.2%), and eczema/atopic dermatitis (12.2%) (Table 3). Approximately 20% of CP users report having an autoimmune-related comorbidity. One-fifth of CP users did not report any of the listed comorbid conditions.

Table 3

Clinical characteristics of CP members, May 2017

Member characteristic	Frequency, n (%)
Comorbidities*,a
High blood pressure	790 (22.4)
High cholesterol	709 (20.1)
Thyroid disease	396 (11.2)
Sleep apnea	357 (10.1)
High triglycerides	341 (9.6)
Eczema/atopic dermatitis	431 (12.2)
Type 2 diabetes mellitus	193 (5.5)
Fatty liver disease	159 (4.5)
Cancer	144 (4.1)
Rheumatoid arthritis	136 (3.8)
Coronary artery disease	87 (2.5)
Uveitis	74 (2.1)
Sjögren’s syndrome	60 (1.7)
Liver disease	48 (1.4)
Celiac disease	49 (1.4)
Crohn disease	44 (1.2)
Stroke	43 (1.2)
Alopecia areata	31 (0.9)
Lupus	27 (0.8)
Type 1 diabetes mellitus	21 (0.6)
Multiple sclerosis	15 (0.4)
Cutaneous T cell lymphoma	4 (0.1)
Parkinson’s disease	5 (0.1)
Other	220 (6.2)
None	675 (19.1)
No response	349 (9.9)
Psoriasis subtype*,a
Plaque	2459 (69.6)
Guttate	573 (16.2)
Inverse	485 (13.7)
Pustular	350 (9.9)
Erythrodermic	116 (3.3)
Not sure	1 (< 0.1)
No response	294 (8.3)
Psoriasis location*,a
Scalp	2100 (59.4)
Arm/legs	1948 (55.1)
Elbow/knees	1799 (50.9)
Ears	1521 (43.0)
Abdomen	1429 (40.4)
Nails	1173 (33.2)
Skin folds	1013 (28.7)
Face	932 (26.4)
Genitals	854 (24.2)
Palms of hands	584 (16.5)
Soles of feet	561 (15.9)
No response	227 (6.4)
Psoriasis severitya
Mild: < 5% BSA	1303 (36.9)
Moderate: 5–10% BSA	1035 (29.3)
Severe: > 10% BSA	540 (15.3)
No response	249 (18.6)
Affected joints in psoriatic arthritisb
Knuckles	823 (53.3)
Knees	815 (52.7)
Toes	709 (45.9)
Wrists	664 (43.0)
Spine	629 (40.7)
Ankles	618 (40.0)
Shoulders	581 (37.6)
Hips	559 (36.2)
Neck	546 (35.3)
Elbows	485 (31.4)
Jaw	241 (15.6)
No response	5 (0.4)

BSA body surface area

*Total sum > 100% due to multiple responses by subjects

aCalculated using total number of subjects (n = 3534)

bCalculated using total number of subjects having psoriatic arthritis (n = 1545)

Psoriasis may be divided into several clinical subtypes. The majority of CP users reported having plaque psoriasis (69.6%), followed by guttate (16.2%), inverse (13.7%), pustular (9.9%), and erythrodermic (3.3%) variants. The scalp, elbows/knees, and arms/legs were the most frequently reported areas with psoriatic involvement (59.4%), followed by the ears and abdomen (43% and 40%, respectively). Psoriasis located on the face, genitals, and skin folds was in each case reported in about 25% of patients while the palms and soles of the hands and feet were reported among 17% of users. Approximately 33% of CP users report having nail psoriasis. In terms of psoriasis severity, 36.9% of the CP community reported less than 5% body surface area (BSA) involvement, 29.3% reported 5–10% BSA, and 15.3% reported greater than 10% BSA. Psoriatic arthritis most frequently affected the knees and knuckles (53%) followed by the toes, wrists, ankles, and spine (45%).

Participant-Generated Analysis

A unique aspect of CP is that users can analyze their own data instantly online and share their findings with other users to generate discussions. As of June 2017, patients had posted 70 discovery charts generating 209 comments by the CP community. To examine the content of these patient-generated charts, a consecutive subset of 31 charts were further analyzed. Discovery charts were focused on demographics or clinical features of psoriatic disease (35%), environmental triggers (32%), and quality of life (32%). The relationship of demographic characteristics was often displayed according to psoriasis severity, such as how smoking varies among those with different psoriasis severity. The discovery charts posted on clinical features examined, for example, which areas of the body were affected by psoriasis and which areas were the most bothersome stratified by psoriatic arthritis status (Fig. 4), and which areas correlated with sleep disturbance. In addition, the frequency of comorbidities was explored among different patient subsets. The subtype of psoriasis was compared to several variables, such as current treatments.

Fig. 4

Patient-generated analysis of most bothersome psoriasis sites. Screenshot from the CP online patient portal. Note the diverse discussion and feedback from personal experiences

The discovery charts that examined environmental triggers focused on the seasonal association of flares or flare triggers such as stress, skin injury, or smoking. Alternatively, exploration of exercise and meditation were identified to reduce flares. The association between stress reduction and psoriasis severity was examined.

Quality of life was explored through several discovery charts examining activities that are prevented by psoriatic arthritis. The association between self-consciousness and gender was examined, as well as discussions of overall life satisfaction.

Discussion

CP is a powerful tool that empowers the psoriatic disease community by allowing patients to take ownership in learning more about their disease and to contribute back through self-directed research. Though there have been several other disease portals that rely on crowdsourcing and online forums, CP is the only one that promotes direct analysis of data by the users and openly displays this information for rapid patient-directed education and support.

Since CP attracts motivated patients who enroll and provide data through an online interface, it is expected that certain groups may be over-represented. Indeed, we observed a relatively high proportion of patients with psoriatic arthritis (43.7%), which is toward the upper limit of an estimated range of 7–48% seen in epidemiologic studies and is higher than population-based estimates of approximately 10% [33-37]. This indicates that individuals suffering from psoriatic arthritis may be more motivated to enroll in CP or that patients with more severe disease (in which the prevalence of PsA is increased) are more motivated to enroll. Similarly, we observed a higher proportion of female patients, whereas large-scale epidemiological studies have found no clear gender predilection for psoriasis [2, 38]. Our results are consistent with the observation that women more often than men engage in health information-seeking behaviors [39].

The ages of CP participants follow a skewed distribution favoring ages above 41. Interestingly, the majority of participants are between 51 and 65 years (31.3%). The current CP community has a relatively low number of minorities, possibly reflecting our advertising that was limited to NPF members. Though questions about socioeconomic status were not asked in the CP survey, the NPF membership from which the CP individuals were drawn from are typically of a higher educational and income status than the general population. Approximately 17% of CP users reported current smoking behaviors, which is slightly greater than smokers found from US population studies. According to the Centers for Disease Control and Prevention, 13.6% of women in the USA smoked compared to 16.7% of men in 2015 [40]. A study analyzing data from the Nurses’ Health Study, the Nurses’ Health Study II, and the Health Professionals’ Follow-up Study found that current or former smokers were more likely to develop psoriasis than nonsmokers and with increased smoking duration the risk for psoriasis increased [41]. Approximately 47% of the CP members report alcohol consumption, with the majority consuming 1–3 drinks per week (27.5%) and only a minority reporting greater than 10 drinks per week (5.4%). Alcohol abuse has been associated with a greater risk for developing or worsening psoriasis [42]. Overall, the low prevalence of alcohol use among the CP community may be due to the female predominance, as women are less likely to be alcohol misusers [43], and that patients who participate in the CP initiative may be also less likely to engage in alcohol consumption. Within the CP community, 37% of members reported at least one immediate family member with psoriasis. This is consistent with studies showing that approximately 40% of patients with psoriasis or psoriatic arthritis have a family history of these disorders in first-degree relatives [44].

The high rate of disorders of impaired metabolism among the CP community is consistent with previous studies demonstrating a greater likelihood of obesity, hypertension, hypertriglyceridemia, hypercholesterolemia, diabetes, and sleep apnea [45-51]. In addition, 20% of CP users reported an autoimmune-related comorbidity consistent with prior studies detecting an increased autoimmune disease prevalence among patients with psoriasis and PsA such as uveitis, alopecia areata, celiac disease, systemic sclerosis, and Crohn disease [32, 52, 53].

The type, severity, and location of psoriasis reported among the CP users are parallel to findings in the literature, with the exception of pustular psoriasis occurring twice higher than expected. Chronic plaque psoriasis is the most common variant of psoriasis with the literature reporting 55–79% of patients with psoriasis identified as the plaque type [54, 55]. The majority of CP patients with psoriasis have moderate to severe disease, while population-based estimates have suggested that about 20% have moderate to severe psoriatic disease [56]. The most common areas include the scalp, elbows or knees, and gluteal cleft. Psoriatic arthritis has several different patterns of joint involvement [57], and we also found a wide distribution of joint involvement among CP users with psoriatic arthritis, the most common areas being the knuckles, knees, toes, wrists, spine, and ankles.

The patient-centered discoveries of CP add value to psoriasis knowledge by showing what patients consider important about their disease. The current literature is sparse for these high-priority topics identified by psoriasis patients. There are six studies that discuss environmental triggers of psoriasis [58-63], while 10 articles explore the seasonality of psoriasis [64-73]. These articles do not provide clear answers, may be resource-intensive to develop, and might have limited quality in the setting of confounding variables. Thus, there is an opportunity for the CP platform to fill these gaps of highly prioritized topics for psoriasis patients.

CP may redirect researchers to focus on studying disease factors that are the most important to patients. Furthermore, CP’s influence on research has the potential for enabling researchers and physicians to connect with ongoing questions generated by patients. For example, a survey that ranked the patient’s top priority CER topics showed that the following were the highest importance to CP patients: comparing the effectiveness, safety, risk, and costs of treatment; diet or remedies; and communication or management strategies. Specifically, the most popular CER questions were comparing biologics to methotrexate, treat-to-target management for psoriasis, comparisons of home versus office-based phototherapy, and differences between scalp psoriasis treatment formulations [27]. Although patient–physician communication is important in determining patient needs, direct feedback from CP is valuable information for guiding future research efforts and patient care [74].

Another unique aspect of CP is that messages can be posted by participants in response to the displayed discovery charts, which may result in further discussion and analysis. For example, a data-driven discussion debated whether the observed results had statistical significance. As a result of the high interest in the debated topic, researchers may consider following up on the discussion points raised by the users.

The initial efforts of CP were focused in the USA, as recruitment was implemented through the NPF. However, we were surprised by the reach of the CP platform to countries outside of the USA. As the number of international participants continues to increase, we will translate the survey to other languages. The fact that the intake survey and CP website are in English and from a US-based website may also contribute to the limited diversity of the subjects in our summarized results.

Additionally, the activity of CP by users has remained high over time, with the most active months during the Summer. The average of 800 visits per month and total unique visits of 6409 in 2017 suggest that users may be visiting the site multiple times, as the visits exceed the total count of registered CP users.

Psoriasis patients have expressed that CP adds significant value to their view of research, their general psoriasis knowledge, and their well-being. One member stated that CP is valuable because it gives patients the ability to be part of the effort to find a cure. Even though discussion groups and online forums are valuable in letting patients share their experiences with others, CP is unique in that patients can influence the direction of future research. It lets researchers know what questions matter the most to patients in a direct and quantifiable way. In addition, patients stated that CP is valuable because it lets them know what other patients’ concerns are by means of quantifiable information in the form of easy-to-read and easy-to-understand charts and graphs. They get an instant picture of other patients’ concerns and trends in the entire community’s response to survey questions. Another CP member shared the fact that awareness of overlapping disease features between patients refines patients’ understanding of psoriasis further. Importantly, CP emphasizes to those living with psoriasis that they are not alone. Individuals can anonymously share their toughest moments experiencing psoriasis, which can be translated into impactful science.

Limitations

With this interactive data tool, however, there is a risk of misinterpretation of the results by the CP users. For example, a comment was posted to a discovery chart stating that fizzy drinks and sugar could help psoriasis, which was the opposite interpretation of what the results displayed. Future enhancements to the platform could consider a dermatologist or research moderator to help users understand the results correctly. It is also possible that an analysis led by patients could induce potential conflicts of interests and biases that could favor inaccurate but desired health outcomes. Therefore, the CP discovery graphs must be interpreted with caution.

Self-reported data may not provide accurate information, especially when examining clinical factors in comparison to deriving health information from electronic health records. However, more insight into patient priorities and a wider variety of patients are reached when mining CP crowdsourced data. A correlation between self-administered scoring of disease severity to physician-generated clinical measures of psoriasis severity using the Psoriasis Area Severity Index (PASI) has been reported, although a review of patient-reported outcomes determined that most do not assess validity [75-77]. In our study, 91.9% of CP enrollees reported a physician-made diagnosis of psoriasis, but it is unclear if the remainder received a diagnosis of psoriasis from a different kind of provider or self-diagnosed their condition.

To improve the reliability of CP patient-generated data, a validation of the self-reported diagnoses through a review of patient medical records will be performed by CP researchers. After 10% of our total CP patients are sampled and consented, their physicians will be asked to provide documentation of medical records that support or refute a patient’s psoriasis diagnosis. As more robust data is generated by CP, the NPF researchers will conduct a more formal analysis of summary data.

Conclusions

CP is a unique research platform that encourages meaningful data exchange for psoriatic disease research. Other patient portals have used crowdsourced research for science innovation; however, none, to our knowledge, have integrated patients into the research development or analysis process. Patient-generated analyses in CP have demonstrated interest in demographics and clinical features of psoriasis, followed by environmental triggers and seasonality, indicating that the patient perspective can help guide future research areas.

Future efforts to enhance CP will focus on several areas. One priority is recruitment of a more racially diverse population through comprehensive outreach methods. Another priority is maintaining the engagement of users, through new survey questions and by expanding the interface to a mobile application. A subset of the CP data is currently being validated with medical records to assess the accuracy and quality of the self-reported information. Finally, the addition of real-time activity, fitness tracking, and DNA or other biospecimens may also be explored. In these ways, CP can continue to contribute to patient-centered research that improves the quality of life of psoriatic patients globally.