Web-based study on Chinese dermatologists' attitudes towards artificial intelligence.

BACKGROUND: Artificial intelligence (AI) has become a powerful tool and is attracting more attention in the field of medicine. There are a number of AI studies focusing on skin diseases, and there are many AI products that have been applied in dermatology. However, the attitudes of dermatologists, specifically those from China, towards AI, is not clear as few, if any studies have focused on this issue.
METHODS: A web-based questionnaire was designed by experts from the Chinese Skin Image Database (CSID) and published on the UMER Doctor platform (an online learning platform for dermatologists developed by the Shanghai Wheat Color Intelligent Technology Company, China). A total of 1,228 Chinese dermatologists were recruited and provided answers to the questionnaire online. The differences of dermatologists' attitudes towards AI among the different groups (stratified by age, gender, hospital level, education degree, professional title, and hospital ownership) were compared by using the Mann-Whitney U test and the Kruskal-Wallis H test. The correlations between stratified factors and dermatologists' attitudes towards AI were calculated by using the Spearman's rank correlation test. SPSS (version 22.0) was utilized for all analyses. A two-sided P value <0.05 was considered statistically significant in all analyses.
RESULTS: A total of 1,228 Chinese dermatologists from 30 provinces, autonomous regions, municipalities, and other regions (including Hong Kong, Macau, and Taiwan) participated in this survey. The dermatologists who participated acquired AI-related information mainly through the Internet, meetings or forums, and 70.51% of participated dermatologists acquired AI-related information by two or more approaches. In total, 99.51% of participated dermatologists pay attention (general, passive-active, and active attention) to information pertaining to AI. Stratified analyses revealed statistically significant differences in their attention levels (unconcerned, general, passive-active, and active attention) to AI-related information by gender, hospital level, education degree, and professional title (P values ≤1.79E-02). In total, 95.36% of the participated dermatologists thought the role of AI to be in "assisting the daily diagnosis and treatment activities for dermatologists". Stratified analyses about the thought of AI roles (unconcerned, useless, assist, and replace) showed that there was no statistically significant difference except for the hospital level (P value =4.09E-03). The correlations between stratified factors with attention levels and the opinions of AI roles showed extremely weak correlations. Furthermore, 64.17% of participated dermatologists thought secondary hospitals in China are in most need of the application AI, and 91.78% of participated dermatologists thought the priority implementation of AI should be in skin tumors.
CONCLUSIONS: The majority of Chinese dermatologists are interested in AI information and acquired information about AI through a variety of approaches. Nearly all dermatologists are attentive to information on AI and think the role of AI is in "assisting the daily diagnosis and treatment activities for dermatologists". Future AI implementation should be primarily focused on skin tumors and utilized in in secondary hospitals. 2020 Annals of Translational Medicine. All rights reserved.

Introduction

It was at the Dartmouth conference of 1956 that “artificial intelligence” (AI) was first formally proposed as a general term, and defined as the ability of technology to model intelligent behavior with minimal human intervention. Currently, AI is widely used in many fields, including in medical areas and healthcare systems (1-3). As dermatology is a medical specialty in which numerous clinical images are used, and the visual characteristics of observable image features are a key focus, it seems to be a field highly suited for the integration of AI training. Indeed, preliminary studies have concluded that the application of AI in dermatology has the potential advantages of being able to potentially automate repetitive tasks, optimize time-consuming tasks, extend access to limited medical resources, improve interobserver reliability issues, and expand the diagnostic toolbox of dermatologists (4). Thus far, many well-known and meaningful AI studies have been conducted which have focused on the recognition and classification of skin diseases, including skin cancers (5-13), atopic dermatitis (14), psoriasis (15,16), and onychomycosis (17).

In China, the development of AI has recently garnered more interest, and, as it makes inroads into dermatology, the interest in it from dermatologists has risen in kind. A library of skin images known as the Chinese Skin Image Database (CSID) was established in 2017 (18) and has developed into a system platform for skin imaging research, education, and application in China. CSID provides a large amount of skin imaging data for AI training and has facilitated the development of a series of clinical AI projects. AI research has also become more popular in dermatology in China; for example, AI methods were used to classify melanoma using 2,200 dermoscopy images in the Chinese population (19). However, there is currently no research or summary review of the attitudes that Chinese dermatologists’ hold towards AI. Therefore, the aim of this study was to evaluate the awareness that Chinese dermatologists have AI through a web-based questionnaire.

Methods

Study design

This study was initiated and sponsored by the National Institute of Hospital Administration, the National Health Commission of the People’s Republic of China, and the China Digital Medicine Magazine. We designed a web-based questionnaire (Supplementary file at http://fp.amegroups.cn/cms/e869712a2753bdd10cd7cf5f686dc12e/atm.2019.12.102-1.pdf) by reviewing the literatures (20-24) and consulting the CSID expert committee. Technicians from UMER Doctor (an online learning platform for dermatologists developed by Shanghai Wheat Color Intelligent Technology Company, China) provided technological support. Groups from CSID and UMER Doctor were responsible for conducting this survey.

Online survey platform

We published the questionnaire on the UMER Doctor platform (http://www.umer.com.cn) for two weeks (from November 16 to 30, 2018). The UMER Doctor application is the largest online learning platform for dermatologists in China, and over 20,000 dermatologists (approximately 24,000 dermatologists in China) have registered with the platform. The UMER Doctor platform provided access to an ample number of Chinese dermatologists to complete this survey. Dermatologists from the UMER Doctor platform were recruited to fill in the questionnaire online and were prompted to complete the questionnaire in 20 minutes. The participated dermatologists also provided their demographic information, professional title, and the hospital name and level.

Division of observations

In this questionnaire, we classified age groups along with the following guidelines: 18–44-year-old as the younger population, 45–59-year-old as the middle-aged population, and ≥60-year-old as the senior population. Hospitals in China are mainly divided into a 3-tier system (primary, secondary, and tertiary hospitals) based on the ability to provide medical care, medical education, and conduct medical research, along with additional services such as community health service stations, private clinics, and village clinics. The professional titles of dermatologists in China include chief physician, associate chief physician, attending physician, resident physician, and other (with a research title such as research fellow, associate research fellow, assistant research fellow, or without a professional title). In order to measure the attention levels of dermatologists towards AI information, we divided the levels of attention into four categories. These categories were active attention (actively search and concern for AI-related information), passive-active attention (reading AI-related information when seen), general attention (sometimes reading AI-related AI information), and unconcerned (ignoring AI-related information). Furthermore, we classified the dermatologists’ attitudes and thoughts regarding AI impact into the following four categories: replace dermatologists’ daily work, assisting the daily diagnosis and treatment activities for dermatologists, useless, and unconcerned.

Statistical analysis

The continuous variables data were shown as mean ± standard deviation (SD), and the categorical variables data were shown in numbers and percentages. Attention levels to AI information and the beliefs about the roles AI from the perspective of Chinese dermatologists were regarded as ordered categorical data in this study. In instances where the objective was to analyze the differences of dermatologists' attitudes towards AI among different groups (stratified by age, gender, hospital level, education degree, professional title, and hospital ownership), the datasets were regarded as one-way ordered categorical data; Mann-Whitney U test was used in the datasets were from two-independent samples, and Kruskal-Wallis H test was used in the datasets were from K-independent samples (K>2). When we attempted to calculate the correlations between stratified factors and dermatologists’ attitudes towards AI or the thought of AI roles from the perspective of Chinese dermatologists, these datasets were regarded as two-way ordered categorical data. In these cases, Spearman’s rank correlation test was used in this study. Statistical package for social science (SPSS), version 22.0 (IBM Corp., Armonk, NY, USA) was used for all analyses. A two-sided P value <0.05 was considered statistically significant in all analyses.

Results

Basic characteristics of participated dermatologists

There were 1,228 valid questionnaires that were completed by Chinese dermatologists from 30 provinces, autonomous regions, municipalities, and other regions (including Hong Kong, Macau, and Taiwan) (). The average age of the participated dermatologists was 36.84 (SD =8.86). Of the 1,228 Chinese dermatologists, the male-to-female ratio was 476:752. Regarding the education of participants, 508 (41.4%) dermatologists held a bachelor’s degree, 485 (39.5%) dermatologists held a master’s degree, 105 (8.6%) dermatologists held a doctorate degree, and 130 (10.6%) dermatologists held other degrees or had no degree. Regarding the professional titles of the participants, 366 (29.8%) dermatologists were resident physicians, 473 (38.5%) were attending physicians, 206 (16.8%) were associate chief physicians, 89 (7.2%) were chief physicians, and 94 (7.7%) had other professional titles or had no professional title. The hospital distribution of dermatologists included 47 (3.8%) dermatologists from primary hospitals, 309 (25.2%) from secondary hospitals, 745 (60.7%) from tertiary hospitals, and 127 (10.3%) from other medical institutions (such as hospitals without a level of determination, or clinics). A total of 1,112 (90.65%) dermatologists were affiliated with public medical institutions, 84 (6.8%) were affiliated with private medical institutions, and 32 (2.6%) were affiliated with other medical institutions (such as a combination of public and private ownership).

Figure 1

The distribution of the dermatologists who participated in the survey by province.

Approaches to obtain AI information by Chinese dermatologists

We investigated how Chinese dermatologists acquire information about AI throughout their day-to-day work and life. The survey results showed that Chinese dermatologists obtained information about AI in a variety of approaches (), mainly through the internet (83.47%) and meetings or forums (73.70%). It is especially interesting that 70.51% of participated dermatologists acquired information about AI by two or more approaches, and that there were some other sources, including advertisements, brochure, course, etc.

Table 1

Approaches of obtaining information about AI by Chinese dermatologists

Approaches	N	Percent (%)	Number of approaches	N	Percent (%)	Cumulative percent (%)
Internet (including by computer and mobile phone)	1,025	83.47	1	362	29.48	29.48
Television	344	28.01	2	321	26.14	55.62
Science fiction movies or novels	136	11.07	3	296	24.10	79.72
Books, newspapers, or periodicals	409	33.31	4	149	12.13	91.86
Meetings, or forums	905	73.70	5	69	5.62	97.48
Others	200	16.29	6	31	2.52	100.00

Attention levels about AI information by Chinese dermatologists

In total, 99.51% of participated dermatologists indicated that they pay attention (general, passive-active, and active attention) to information about AI. We stratified and analyzed the attention levels among Chinese dermatologists by age, gender, hospital level, education degree, professional title, and hospital ownership. Interestingly, stratified analyses showed statistically significant differences in their attention levels (unconcerned, general, passive-active, and active attention) to AI information by gender, hospital level, education degree, and professional title (P values ≤1.79E−02). There were correlations between stratified factors and the levels of attention, and although all P values were significant, but the relationships were extremely weak ().

Table 2

Chinese dermatologists’ attention level concerning information about AI

Dimensions	Attention stratifies	Unconcerned	General attention	Passive-active attention	Active attention	Total	χ2 (Z)	P1	Spearman’s rho	P2
Age	Young age	5	272	278	411	966	5.07	7.94E−02	−0.064	2.47E−02
	Middle age	1	94	61	95	251
	Senior age	0	5	1	5	11
Gender	Male	1	122	102	251	476	−5.46	4.78E−08	−0.156	4.03E−08
	Female	5	249	238	260	752
Hospital level	Other	1	32	39	55	127	12.07	7.15E−03	−0.090	1.51E−03
	Primary hospital	1	11	12	23	47
	Secondary hospital	0	80	80	149	309
	Tertiary hospital	4	248	209	284	745
Education degree	Other	2	27	45	56	130	16.40	9.39E−04	−0.051	7.28E−02
	Bachelor’s degree	1	148	129	230	508
	Master’s degree	3	168	145	169	485
	Doctorate degree	0	28	21	56	105
Professional title	Other	0	25	36	33	94	11.92	1.79E−02	0.089	1.87E−03
	Resident physician	3	120	120	123	366
	Attending physician	2	145	113	213	473
	Associate chief physician	1	57	52	96	206
	Chief physician	0	24	19	46	89
Hospital ownership	Other	0	7	16	9	32	5.51	6.37E−02	−0.049	8.92E−02
	Private medical institution	0	20	18	46	84
	Public medical institution	6	344	306	456	1,112
Total		6	371	340	511	1,228

Unconcerned: ignoring AI-related information; general attention: sometimes reading AI-related information; passive-active attention: reading AI-related information when seen; active attention: actively search and concern for AI information.

The roles of AI from the perspective of Chinese dermatologists

In total, 95.36% of the participated dermatologists believed the role of AI to be in “assisting the daily diagnosis and treatment activities for dermatologists”, whereas only 3.42% thought AI would replace dermatologists’ daily work, 0.98% thought AI is useless, and 0.24% were unconcerned about its role. We also stratified and analyzed the beliefs about AI roles (unconcerned, useless, assist, and replace) from participants of the survey by age, gender, hospital level, education degree, professional title, and hospital ownership. The results show that there was no statistically significant difference except the hospital level (P value =4.09E−03). The correlations between stratified factors and the beliefs about AI roles were weak and without significance ().

Table 3

The role of AI from the perspective of Chinese dermatologists

Dimensions	Role stratifies	Unconcerned	Useless	Assist	Replace	Total	χ2 (Z)	P1	Spearman’s rho	P2
Age	Young age	1	11	921	33	966	1.17	5.58E−01	0.004	9.02E−01
	Middle age	2	1	240	8	251
	Senior age	0	0	10	1	11
Gender	Male	1	5	450	20	476	−0.973	3.31E−01	−0.028	3.31E−01
	Female	2	7	721	22	752
Hospital level	Other	1	2	121	3	127	13.27	4.09E−03	−0.005	8.51E−01
	Primary hospital	0	2	37	8	47
	Secondary hospital	1	6	290	12	309
	Tertiary hospital	1	2	723	19	745
Education degree	Other	2	5	114	9	130	0.28	9.64E−01	−0.004	8.77E−01
	Bachelor’s degree	0	4	487	17	508
	Master’s degree	1	3	467	14	485
	Doctorate degree	0	0	103	2	105
Professional title	Other	0	3	89	2	94	3.31	5.08E−01	0.040	1.66E−01
	Resident physician	0	2	356	8	366
	Attending physician	2	5	445	21	473
	Associate chief physician	0	1	199	6	206
	Chief physician	1	1	82	5	89
Hospital ownership	Other	1	0	31	0	32	4.60	1.0E−01	−0.016	5.73E−01
	Private medical institution	0	0	79	5	84
	Public medical institution	2	12	1,061	37	1,112
Total		3	12	1,171	42	1,228

Assist: assisting the daily diagnosis and treatment activities for dermatologists; Replace: replace dermatologists’ daily work.

Application of AI in hospitals from the perspective of Chinese dermatologists

We investigated the implementation of AI in different levels of the hospital from the perspective of Chinese dermatologists to help determine which level of hospitals might benefit more from AI. The ratio shows that participants believed all levels of hospitals need AI in the clinic, while 788 (64.17%), 734 (59.77%), 593 (48.29%), and 596 (48.53%) dermatologists who participated thought that the secondary hospitals, tertiary hospitals, primary hospitals, and others (community health service stations, private clinics, and village clinics) needed AI application, respectively. These results will help prioritize the future direction of AI application in dermatology.

Application of AI in skin diseases from the perspective of Chinese dermatologists

We investigated the application of AI in skin diseases from the perspective of Chinese dermatologists to determine which kinds of skin diseases would benefit most from AI in the clinic. There were 1,127 (91.78%) participating dermatologists who thought AI should be applied for skin tumors. Additionally, 814 (66.29%), 777 (63.27%), 765 (62.3%), 702 (57.17%), 579 (47.15%), 474 (38.6%), and 351 (28.58%) of participated dermatologists thought AI should be applied to melanonychia, alopecia disease, vitiligo, psoriasis, allergic dermatitis, acne, and other skin diseases (freckle, tinea corporis, and cruris, keratosis pilaris, etc.), respectively. These results indicate the interests and attitudes of Chinese dermatologists in applying AI in skin diseases.

Discussion

To our knowledge, this study is the first web-based survey about Chinese dermatologists’ attitudes towards AI. There were 1,228 Chinese dermatologists from 30 provinces, autonomous regions, municipalities, and other regions (including Hong Kong, Macau, and Taiwan) who participated in this survey. The ratio of female to male was 1.58:1, which is consistent with the general belief that there are more female than male dermatologists in China. Of the participants, most dermatologists had obtained bachelor and graduate degrees, were resident physicians and attending physicians, and came from secondary hospitals and tertiary hospitals. The majority of most of the dermatologists’ hospitals were owned by public medical institutions. These phenomena are all consistent with the demographic distribution of Chinese dermatologists and hospitals in China.

In an era of information explosion, the modern world allows information to be quickly transmitted; therefore, there are various approaches to obtain information about AI. In a multicenter survey, around 52% of medical students were aware of the ongoing discussion about AI in radiology; however, 68% of them stated that they were unaware of the specific technologies involved (23). How Chinese dermatologists find information about AI, and their level of attention to information about AI is still understudied. Because of this, we conducted this research survey. According to the survey results, Chinese dermatologists obtained information about AI mainly through the Internet. Most importantly, 70.51% of dermatologists acquired information about AI using two or more approaches, which indicates that Chinese dermatologists are interested in AI from multiple sources. It is interesting to note that 99.51% of participated dermatologists pay attention (general, passive-active, and active attention) to AI information. Stratified analyses showed statistically significant differences in their attention levels to AI information by gender, hospital level, education degree, and professional title. We hypothesized that the stratified factors affect the Chinese dermatologists’ attention levels to AI-related information, but the correlations between stratified factors and attention were extremely weak. These findings suggest that it is not necessary to classify information about AI using dermatologist-related factors.

AI products have a broad application in dermatology, which will significantly improve doctor ability in diagnosis and treatment. Additionally, AI may also change the doctor's medical behavior patterns, and enable the physicians in primary hospitals to diagnose and treat skin diseases using skin lesion images. What are the AI roles in clinical treatment? We surveyed the beliefs of Chinese dermatologists about the role of AI, except for the hospital level, we found no statistically significant difference concerning beliefs on AI roles among the stratified groups. In addition, correlations between stratified factors and the beliefs on AI roles were weak correlations without significance. There are, however, two noteworthy observations from our study: 95.36% of participated dermatologists thought the role of AI to be in “assisting the daily diagnosis and treatment activities for dermatologists”, and only 3.42% of participated dermatologists thought AI would replace dermatologists’ daily work.

Will AI then replace dermatologists in the near future? In fact, the answer is not necessarily affirmative. Accurate diagnoses are important in clinical patient care, and approximately 10% of patient death and adverse events in the hospital are caused by diagnostic errors (25). Usually, clinicians must manage their patients before making a definitive diagnosis, and the diagnosis often hinges on management decisions (26). Diagnosis is a complex task and clinicians usually must perform a thorough examination of the patient, and not make a conclusion from a single lesion. When making a diagnosis, clinicians will consider additional information, such as the age of the patient, the duration of the disease, medical history, family history, and other symptoms beyond the skin lesion alone. Although AI has reached a performance above their human counterparts in many aspects, the higher diagnostic accuracy with digital images does not necessarily translate into better clinical performance or patient management (20).

Recently, an open, web-based, international, diagnostic study showed that state-of-the-art machine-learning classifiers outperformed human experts in the diagnosis of pigmented skin lesions, and it was recommended that these classifiers should have a more important role in clinical practice (20). The authors stated that a possible limitation of the algorithms that were implemented was due to out-of-distribution images, showing that there is room for improvement in the AI of the future. We investigated the role of AI technology in the clinic from the perspective of Chinese dermatologists. Regarding the dermatologists' understanding of the role of AI, 95.36% of participated dermatologists thought the role of AI to be in “assisting the daily diagnosis and treatment activities for dermatologists”, and only 3.42% of participated dermatologists thought AI would replace the work of dermatologists. In the field of dermatology, there are various kinds of skin diseases, and there are a vast number of patients with skin diseases in each country around the world. Dermatologists have a high patient volume, as described colorfully by Dr. Zhang in “A Day in the Life of a Chinese Dermatologist” (27). We believe AI will be widely applied in medical institutions to assist doctors’ daily work. As Yi et al. stated, the key relationship between AI and Radiology is collaboration (28), and we also recognize that the ideal pattern between AI and dermatologists is mutual cooperation.

As to the question of which level of the hospital most needs AI, our investigation showed that all levels of hospitals would benefit from the assistance of AI in clinical work. From the survey results on AI applications in hospitals, the top two choices from Chinese dermatologists were secondary hospitals and tertiary hospitals. It is speculated that AI is needed in these hospitals due to the large volume of patients. Our survey also examined the kinds of skin diseases that would benefit most from integrating AI into clinical work. We found that the most mentioned diseases for AI applications, as indicated by a dermatologist, were skin tumors, melanonychia, alopecia diseases, vitiligo, psoriasis, allergic dermatitis, and acne. The priorities for the application of AI indicated by the survey correlate closely with the importance and incidence of skin diseases. Skin tumors are exceedingly common and with increasing incidence across the globe, and there is a significant cost burden in the care of skin tumors in many countries (29). Melanonychia and other skin diseases (alopecia diseases, vitiligo, psoriasis, allergic dermatitis, and acne) also show high incidence, especially in China. These survey results will direct our future research about the application of AI in dermatology.

Our study is the first to investigate Chinese dermatologists’ attitudes towards AI. However, there are some limitations to this study. First, most of the participants were from the tertiary hospitals and were young dermatologists. It would have been beneficial to have more responses from secondary and primary hospitals, and more senior dermatologists should have been recruited to participate in this survey. Second, additional questions should have been included in this questionnaire in order to better understand the thoughts of AI from dermatologists in China. Third, though the number of participants in this survey represents a relatively large sample size, a larger scale study should be conducted in the future.

There was a survey conducted among the European Society of Radiology members from November to December 2018 regarding the expectations of AI in 5–10 years, responders showed a generally favorable attitude towards AI (30). With the current speed of technological innovation, AI in dermatology will become one of the most advanced and promising clinical technologies in the medical field. It is necessary that more resources, including government attention, funding input, expertise, and enterprise resource pooling, be integrated in order to further promote the rapid development and application of AI in dermatology.

Conclusions

Our study showed that most Chinese dermatologists are interested in information about AI and obtain this information through a variety of approaches. Almost all dermatologists pay attention to AI-related information, and the majority believe the role of AI to be in “assisting the daily diagnosis and treatment activities for dermatologists”. In the future, AI should be implemented in secondary hospitals and in skin tumors. We believe that AI in dermatology will better assist dermatologists in the diagnosis and treatment of skin diseases and will provide better healthcare to patients in the future.

The article’s supplementary files as