Harnessing the power of crowds: crowdsourcing as a novel research method for evaluation of acne treatments.

BACKGROUND: Crowdsourcing is a novel process of data collection that can provide insight into the effectiveness of acne treatments in real-world settings. Little is known regarding the feasibility of crowdsourcing as a means of collecting dermatology research data, the quality of collected data, and how the data compare to the published literature.
OBJECTIVE: The objective of this analysis is to compare acne data collected from a medical crowdsourcing site with high-quality controlled studies from peer-reviewed medical literature.
METHODS: Crowdsourced data was collected from 662 online acne patients. Online patients reported data in a Likert-type format to characterize their symptom severity (740 total responses) and their treatment outcomes (958 total responses). The crowdsourced data were compared with meta-analyses and reviews on acne treatment from August 20, 2010 to August 20, 2011.
RESULTS: We compared topical, oral systemic, alternative, phototherapy, and physical acne treatments of crowdsourced data to published literature. We focused on topical tretinoin due to the large number of online patient responses. While approximately 80% of tretinoin users observed clinical improvement after a 12-week treatment period in clinical trials, 46% of online users reported improvement in an unspecified time period. For most topical treatments, medication with high efficacy in clinical trials did not produce high effectiveness ratings based on the crowdsourced online data.
CONCLUSION: While limitations exist with the current methods of crowdsourced data collection, with standardization of data collection and use of validated instruments, crowdsourcing will provide an important and valuable platform for collecting high-volume patient data in real-world settings.