Annice E Kim1, Alicea J Lieberman2, Daniel Dench1. 1. Public Health Policy Research Program, RTI International, Research Triangle Park, North Carolina, USA. 2. Community Health Promotion Research Program, RTI International, Research Triangle Park, North Carolina, USA.
Abstract
OBJECTIVE: To assess whether crowdsourcing is a viable option for conducting surveillance of point of sale (POS) tobacco marketing practices. METHODS: We posted jobs to an online crowdsourcing platform to audit 194 Florida licensed tobacco retailers over a 3-week period. During the same period, trained data collectors conducted audits at the same retail locations. Data were collected on cigarette advertising, cigarette promotions and product availability (electronic cigarettes, snus and dissolvables). We compared data collected by crowdsourced workers and trained staff and computed frequencies, percent agreement and inter-rater reliability. Photographs of e-cigarettes and exterior cigarette advertisements submitted by crowdsourced workers were used to validate responses. RESULTS: Inter-rater reliability between crowdsourced and trained data collectors was moderate to high for coding exterior cigarette advertisements, product availability and some tobacco promotions, but poor to fair when coding presence of sales and interior cigarette advertisements. Photos submitted by crowdsourced workers confirmed e-cigarette availability that was missed by trained data collectors in three stores. CONCLUSIONS: Crowdsourcing may be a promising form of data collection for some POS tobacco measures. Future studies should examine the cost-effectiveness of crowdsourcing compared with traditional trained data collectors and assess which POS measures are most amenable to crowdsourcing. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
OBJECTIVE: To assess whether crowdsourcing is a viable option for conducting surveillance of point of sale (POS) tobacco marketing practices. METHODS: We posted jobs to an online crowdsourcing platform to audit 194 Florida licensed tobacco retailers over a 3-week period. During the same period, trained data collectors conducted audits at the same retail locations. Data were collected on cigarette advertising, cigarette promotions and product availability (electronic cigarettes, snus and dissolvables). We compared data collected by crowdsourced workers and trained staff and computed frequencies, percent agreement and inter-rater reliability. Photographs of e-cigarettes and exterior cigarette advertisements submitted by crowdsourced workers were used to validate responses. RESULTS: Inter-rater reliability between crowdsourced and trained data collectors was moderate to high for coding exterior cigarette advertisements, product availability and some tobacco promotions, but poor to fair when coding presence of sales and interior cigarette advertisements. Photos submitted by crowdsourced workers confirmed e-cigarette availability that was missed by trained data collectors in three stores. CONCLUSIONS: Crowdsourcing may be a promising form of data collection for some POS tobacco measures. Future studies should examine the cost-effectiveness of crowdsourcing compared with traditional trained data collectors and assess which POS measures are most amenable to crowdsourcing. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Entities:
Keywords:
Advertising and Promotion; Environment; Surveillance and Monitoring
Authors: Stephen Miller; James Pike; Jared Chapman; Bin Xie; Brian N Hilton; Susan L Ames; Alan W Stacy Journal: J Child Adolesc Subst Abuse Date: 2016-10-19