Literature DB >> 30943248

Evaluation of the awareness of novel advanced therapies among family medicine residents in Spain.

Miguel Sola1, Carmen Sanchez-Quevedo2,3, Miguel A Martin-Piedra2,3, Victor Carriel2,3, Ingrid Garzon2,3, Jesus Chato-Astrain2,3, Oscar-Dario Garcia-Garcia2,3, Miguel Alaminos2,3, Fernando Campos2,3.   

Abstract

BACKGROUND: Advanced therapies are increasingly demanded by patients with the intent of treating some incurable conditions. Because family medicine professionals play an important role as health educators, their residency programs should incorporate new knowledge related to advanced therapies. To successfully implement these programs, how family medicine residents perceive these therapies should be investigated. The main components of perception, i.e. conceptual, procedural and attitudinal, refer to knowledge, skills and feelings, respectively. METHODS AND
FINDINGS: We designed a specific questionnaire to assess the components of perceptions of advanced therapies in 300 medical residents enrolled in the Spanish National Family Medicine Residency Program. Each component consisted of 4 or 5 topics and each topic contained 6 items. Respondents scored highest in the procedural component (average 4.12±1.00), followed by the attitudinal (3.94±1.07) and conceptual component (3.04±1.43). Differences among the three components were statistically significant (p<0.00017). Family medicine residents perceived that procedures to implement advanced therapies are well established, especially their application. However, they felt their cognitive background was insufficient to respond efficiently to the expectations generated by these new therapeutic tools, especially in the regulatory framework. High awareness of the risks and limitations of these treatments was reflected by residents' preference for clinically tested therapies. Although they appropriately situated treatment with these therapies within hospital care, they associated the biofabrication of novel products with research centers, although these therapeutic tools can be produced in different facilities.
CONCLUSIONS: These results are potentially useful for designing future training programs and health policies for family medicine residents, and suggest the need to implement specific training programs in advanced therapies at the conceptual, procedural and attitudinal level.

Entities:  

Mesh:

Year:  2019        PMID: 30943248      PMCID: PMC6447282          DOI: 10.1371/journal.pone.0214950

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

In recent decades, genes, cells and tissues have been adapted as new therapeutic tools in medicine. In this new approach, known as advanced therapies, each of these therapeutic agents is termed an advanced therapy medicinal product (ATMP) [1]. As in other medicinal products such as drugs, devices and biological agents, products based on genes, cells and tissues are subject to regulatory requirements that vary widely among countries and product types [2]. The regulatory requirements for ATMPs were established in the European Union by two European Directives (2003/63/EC and 2009/120/EC) and by EC Regulation No. 1394/2007 of the European Parliament and Council. Specific regulations have also been established in different countries, e.g. FDA regulation in the USA [3]. In European countries, marketing authorization must follow a centralized procedure at the European Medicines Agency (EMA), and very precise guidelines must be met for product safety, control of the manufacturing process, and clinical trials [1]. Although these therapies may have great potential, their results thus far have not advanced as much as initially foreseen [4]. Although some scientifically- and clinically-proven gene, stem-cell and artificial tissue-based interventions are being successfully applied, unproven interventions with these therapies are also being sought and used by patients with the intent of treating some degenerative or incurable conditions [5, 6].The consequence is a growing international market in this field, with clinics around the world offering unproven and unapproved cell and tissue therapies for a vast array of conditions without evidence of safety or efficacy for these products. This phenomenon, generally known as ‘‘stem cell tourism”, is a subject of great debate and concern [7-10]. Among the concerns associated with the stem cell tourism market are physical and financial risks for patient and reputational risks for legitimate research on and clinical applications of advanced therapies [5, 11]. A further financial aspect with future implications is when patients return from receiving unproven and unapproved treatments in the private market and then demand follow-up care in publicly funded medical systems [5, 12]. As pointed out by Gunter and colleagues [9], patients need to be equipped to understand the difference between (a) formal clinical trials and the innovative practice of medicine (where their rights are protected and risks are controlled and communicated) and (b) fraudulent cell and tissue therapy practices (where there is no protection or demonstration of competency, and misinformation is the rule). In this context, health education plays a fundamental role not only as an instrument for information and health promotion, but also as a necessary mechanism to guide patients towards the best choice, and thus to contribute to the sustainability of the health system. This is important because of the high costs involved in the implementation of advanced therapy programs in health systems [13]. The role of family medicine physicians in this educational process is highly relevant because they are the basic agents in the interrelation between patients and the health systems in all aspects related to scientific knowledge and their clinical condition. As has been clearly established, family medicine physicians must use data to monitor and manage their patient population, and use well-established science and knowledge to prioritize the clinical services that are most likely to benefit patient health. In addition, patients also expect their family medicine physician to help them prevent, understand and manage their diseases [14]. To equip family medicine physicians to carry out these activities, and therefore to prevent the potential risks of stem cell tourism, residency training programs should incorporate new knowledge and evidence related to advanced therapies, not only regarding the conceptual and procedural components of ATMPs, but also regarding physicians’ attitudinal approach. In the present study we investigate different components of perception (e.g. conceptual, procedural and attitudinal) in family medicine residents in Spain in order to determine the variables or constructs which could serve as a foundation for their future learning processes in advanced therapies [15, 16]. These variables or constructs can be defined as the way in which students conceptualize and relate to the learning process, which is assumed to affect their learning and achievements [17]. Insights into residents’ perceptions will help us to understand their constructs, especially concerning their expectations with regard to the tasks they should learn about and become skilled in. The research reported here was designed to answer to the following question: what are the conceptual, procedural and attitudinal components perceived by family medicine residents regarding treatment with advanced therapies? The results are potentially useful for designing future training programs and health policies in family medicine.

Materials and methods

Sample

The present study was carried out at 20 hospitals and health centers operated by the Public Andalusian Health System (Servicio Andaluz de Salud) and accredited as training centers for family medicine residents. A total of 323 medical residents enrolled in the National Family Medicine Residency Program were invited to participate in the study, whose participation was voluntary. Altogether, 300 (92.9%) of the residents contacted agreed to be included in the study. Average age of the participants was 28.16±4.94 years. Slightly more than one fourth of the participants (84, 28%) were men (average age 28.81±6.11 years) and 216 (72%) were women (average age 27.91±4.38); these numbers are representative of the whole population of family medicine residents in Spain. All participants signed an informed consent form, and all results were analyzed anonymously. The study and the protocol were approved by the Ethics and Research Committee of the University of Granada (ref. 62/CEIH/2016).

Instrument

To evaluate family medicine residents’ perceptions regarding advanced therapies, we designed a specific questionnaire to solicit information on conceptual, procedural and attitudinal components. The conceptual component refers to knowledge (as information recall and remembering) of classifications and categories, principles and generalizations, theories, models and structures [18]. The procedural component reflects knowledge of subject-specific skills and algorithms, subject-specific techniques and methods, and criteria for determining when to use appropriate procedures [18]. The attitudinal component refers to a set of emotions and feelings experienced over time on a specific issue [19]. Each component consisted of 4 or 5 topics and each topic contained 6 items (Table 1). Residents rated each item on a five-point Likert-like scale: 1 = strongly disagree, 2 = disagree, 3 = neither agree nor disagree, 4 = agree and 5 = strongly agree (S1 Table). The questionnaire was given to the residents along with a brief explanation on the purpose of the instrument and instructions about how to complete the questionnaire.
Table 1

Items in the questionnaire corresponding to different components and topics.

For each item, both the full question and its abbreviated item name are shown.

COMPONENTTOPICITEMITEM
CONCEPTUALAdvanced therapiesAdT1Do you know what advanced therapies are?
AdT2Are you familiar with the concept of gene therapy?
AdT3Are you familiar with the concept of somatic cell therapy?
AdT4Are you familiar with the concept of combined advanced therapy?
AdT5Do you know if gene therapy is an advanced therapy?
AdT6Do you know if tissue engineering is an advanced therapy?
Artificial tissuesArT1Are you familiar with the concept of artificial tissue?
ArT2Are you familiar with the concept of biomaterial?
ArT3Are you familiar with the concept of growth factors?
ArT4Do you distinguish conceptually between a natural tissue and an artificial one?
ArT5Are you familiar with the concept of tissue engineering?
ArT6Are you familiar with the concept of regenerative medicine?
Cell and tissue basis of the human bodyCTB1Are you familiar with the concept of cell?
CTB2Are you familiar with the concept of tissue?
CTB3Are you familiar with the concept of stem cell?
CTB4Are you familiar with the concept of embryonic stem cell?
CTB5Are you familiar with the concept of adult stem cell?
CTB6Are you familiar with the concept of IPS cell?
Novel medical productsNMP1Do you know if a cell can be considered a medicine?
NMP2Do you know if a tissue can be considered a medicine?
NMP3Do you know if transplanted organs are medicines?
NMP4Do you know if biomaterials are used to treat diseases?
NMP5Do you know if growth factors are used to treat diseases?
NMP6Do you know if there are benefits of these therapies with respect to current treatment techniques?
Regulatory frameworkRF1Do you know if there is specific EU legislation for advanced therapies?
RF2Do you know what GMP rooms are?
RF3Do you know if it is mandatory to manufacture advanced therapy products considered medicines in GMP rooms?
RF4Do you know if it is mandatory to perform a clinical trial before using advanced therapy products?
RF5Do you know if all advanced therapies require authorization from the Spanish and European agencies for their implementation?
RF6Do you know if advanced therapies are in the service portfolio of the National Health System?
PROCEDURALApplication and use of advanced therapiesAUAT1Would you use the patient's own cells for treatment with cell therapy?
AUAT2Would you use cells from donors to treat a patient with cell therapy?
AUAT3Would you apply cell therapy to treat a disease?
AUAT4Would you apply gene therapy to treat a disease?
AUAT5Would you apply tissue-engineered tissues to treat a disease?
AUAT6Would you apply artificial tissues built with cells, biomaterials and growth factors together to treat a disease?
Application center for advanced therapiesACAT1Would you use hospitals for a cell therapy treatment?
ACAT2Would you use primary care health centers to monitor patients treated with cell therapy?
ACAT3Would you use hospitals for a gene therapy treatment?
ACAT4Would you use primary care health centers to follow up patients treated with gene therapy?
ACAT5Would you use hospitals to treat a patient with artificial tissues generated by tissue engineering?
ACAT6Would you use primary care health centers to monitor patients treated with artificial tissues generated by tissue engineering?
Biofabrication components for advanced therapiesBCAT1Would you use umbilical cord stem cells to build artificial tissues?
BCAT2Would you use bone marrow stem cells to build artificial tissues?
BCAT3Would you use adipose tissue stem cells to build artificial tissues?
BCAT4Would you use dental pulp stem cells to build artificial tissues?
BCAT5Would you build artificial tissues with biomaterials?
BCAT6Would you build artificial tissues with growth factors?
Centers for biofabrication and storage of advanced therapiesCBSAT1Would you store artificial tissues in tissue banks for deferred use?
CBSAT2Would you store cells in tissue banks for deferred use?
CBSAT3Would you store genes in tissue banks for deferred use?
CBSAT4Would you use a primary care health center to build artificial tissues?
CBSAT5Would you use a pharmaceutical company to build artificial tissues?
CBSAT6Would you use a research center to build artificial tissues?
ATTITUDINALResearch interest in advanced therapiesRIAT1Are you interested in cell therapy research?
RIAT2Are you interested in gene therapy research?
RIAT3Are you interested in artificial tissue therapy research?
RIAT4Do you think clinical trials in cell therapy are a good idea?
RIAT5Do you think clinical trials with artificial tissues are a good idea?
RIAT6Do you think clinical trials in gene therapy are a good idea?
Research interest in classical therapiesRICT1Are you interested in research in surgery?
RICT2Are you interested in pharmacotherapy research?
RICT3Are you interested in research in physical medicine and physiotherapy?
RICT4Are you interested in psychotherapy research?
RICT5Do you think clinical trials to test pharmaceutical drugs are a good idea?
RICT6Do you think clinical trials in physical therapy are a good idea?
Valuation of centers for advanced therapiesVCAT1Do you prefer hospitals for the application of cell therapy?
VCAT2Do you prefer hospitals for the application of gene therapy?
VCAT3Do you prefer hospitals for the application of artificial tissue therapy?
VCAT4Do you prefer hospitals for the application of combined advanced therapies?
VCAT5Do you prefer artificial tissues to be manufactured in hospitals?
VCAT6Do you prefer artificial tissues to be manufactured by the pharmaceutical industry?
Valuation of treatment with advanced therapiesVTAT1Do you think cell therapy is a good idea?
VTAT2Do you think gene therapy is a good idea?
VTAT3Do you think therapy with artificial tissues is a good idea?
VTAT4Do you think so-called advanced therapies is a good idea?
VTAT5Do you think therapy with physical medicine is a good idea?
VTAT6Do you think pharmaceutical drug therapy is a good idea?

Items in the questionnaire corresponding to different components and topics.

For each item, both the full question and its abbreviated item name are shown. The set of topics and items included in the questionnaire was initially selected by the authors of the present work, who have a background in advanced therapies and family medicine. To validate the questionnaire prior to its use, the instrument was critically analyzed by a panel of national and international experts in the field. After that, a pilot study was carried out in a group of 30 residents who volunteered to complete the questionnaire, and its internal consistency and reliability were found to be very good (Cronbach’s alpha index of 0.9571). After this preliminary process, the questionnaire was used for the whole study sample. Analysis of the results obtained from 300 residents confirmed the validity of the preliminary results, as determined by a Kaiser-Meyer-Olkin measure of sampling adequacy (KMO) value of 0.8939, a Bartlett's test of sphericity value of 0.0000, and a Cronbach’s alpha index of 0.9561.

Statistical analysis

Average values and standard deviations were calculated for each item, for each topic and for each component for male and female residents separately and for the entire sample together. To identify statistically significant differences between groups, we used ANOVA. This analysis was used to carry out pairwise comparisons of the following groups: 1) components of perception, 2) topics within the same component, 3) items within the same topic, 4) male and female residents. All statistical analyses were two-tailed. To correct for multiple testing, a Bonferroni-adjusted p value below 0.00017 was considered statistically significant.

Results

The results for each component, topic and item are summarized in Tables 2, 3 and 4 and raw data are available in the S1 File.
Table 2

Mean values and standard deviations (SD) for the conceptual component and for each topic and each item included in this component.

In each case, results are shown for male and female residents separately and for all residents together. The last column shows the statistical p value for ANOVA comparisons between genders.

COMPONENTTOPICITEMMEAN MALESSD MALESMEAN FEMALESSD FEMALESMEAL ALL RESIDENTSSD ALL RESIDENTSMALES VS. FEMALES ANOVA p VALUE
CONCEPTUALAdvanced therapiesAdT12.861.312.681.202.731.230.252
AdT23.711.063.391.183.481.160.031
AdT32.541.232.161.142.261.180.012
AdT42.271.202.151.092.181.120.424
AdT52.771.332.721.342.741.330.764
AdT62.681.272.771.332.741.320.596
ALL2.811.312.641.292.691.290.019
Artificial tissuesArT13.461.223.561.203.531.200.556
ArT23.231.263.131.233.151.240.526
ArT34.070.903.880.983.930.960.121
ArT43.581.083.511.163.531.140.636
ArT53.071.263.101.223.091.230.871
ArT63.361.243.091.233.161.240.090
ALL3.461.203.381.213.401.210.176
Cell and tissue basis of the human bodyCTB14.550.724.650.684.620.690.258
CTB24.540.684.640.654.610.660.223
CTB34.440.834.520.744.500.770.429
CTB44.041.053.971.053.991.050.638
CTB53.681.263.581.143.611.170.529
CTB62.001.181.791.071.851.100.134
ALL3.871.323.861.353.861.340.830
Novel medical productsNMP12.951.213.091.253.051.240.379
NMP23.021.233.061.253.051.240.843
NMP32.871.272.761.242.791.240.512
NMP43.631.203.371.293.441.270.110
NMP54.110.964.061.094.081.060.756
NMP62.601.352.671.262.651.280.666
ALL3.201.313.171.313.181.310.690
Regulatory frameworkRF11.981.201.991.171.991.180.924
RF21.621.001.340.771.420.850.010
RF31.610.981.310.721.400.810.005
RF42.821.412.771.412.781.410.771
RF52.651.412.571.382.601.390.652
RF62.241.262.061.182.111.200.263
ALL2.151.302.011.262.051.280.034
CONCEPTUAL COMPONENT 3.101.423.011.433.041.430.009
Table 3

Mean values and standard deviations (SD) for the procedural component and for each topic and each item included in this component.

In each case, results are shown for male and female residents separately and for all residents together. The last column shows the statistical p value for ANOVA comparisons between genders.

COMPONENTTOPICITEMMEAN MALESSD MALESMEAN FEMALESSD FEMALESMEAL ALL RESIDENTSSD ALL RESIDENTSMALES VS. FEMALES ANOVA p VALUE
PROCEDURALApplication and use of advanced therapiesAUAT14.420.984.380.774.390.840.699
AUAT23.951.213.930.963.931.030.842
AUAT34.320.824.270.804.280.800.609
AUAT44.380.854.240.824.280.830.173
AUAT54.430.804.280.754.320.770.126
AUAT64.170.944.100.944.120.940.592
ALL4.280.964.200.854.220.880.100
Application center for advanced therapiesACAT14.330.834.260.754.280.770.486
ACAT24.041.213.931.073.961.110.462
ACAT34.330.834.250.844.270.840.440
ACAT43.991.283.851.143.891.180.355
ACAT54.350.844.260.814.280.820.413
ACAT63.981.263.921.063.941.120.703
ALL4.171.074.080.974.101.000.101
Biofabrication components for advanced therapiesBCAT14.510.754.400.794.430.780.260
BCAT24.550.654.340.774.400.740.029
BCAT34.400.794.130.994.210.950.026
BCAT44.300.854.061.034.120.990.057
BCAT54.250.884.120.994.150.960.279
BCAT64.230.914.130.994.150.970.416
ALL4.370.814.190.944.240.917.08E-05*
Centers for biofabrication and storage of advanced therapiesCBSAT14.380.834.290.814.320.820.396
CBSAT24.430.704.280.824.320.790.149
CBSAT34.151.004.130.964.130.970.812
CBSAT43.801.173.601.153.651.150.177
CBSAT53.051.432.721.232.811.300.047
CBSAT64.270.914.230.864.240.880.708
ALL4.011.143.871.143.911.140.020
PROCEDURAL COMPONENT 4.211.014.090.994.121.003.89E-06*

Statistically significant values (p<0.00017) are highlighted with asterisks (*).

Table 4

Mean values and standard deviations (SD) for the attitudinal component and for each topic and each item included in this component.

In each case, results are shown for male and female residents separately, and for all residents together. The last column shows the statistical p value for ANOVA comparisons between genders.

COMPONENTTOPICITEMMEAN MALESSD MALESMEAN FEMALESSD FEMALESMEAL ALL RESIDENTSSD ALL RESIDENTSMALES VS. FEMALES ANOVA p VALUE
ATTITUDINALResearch interest in advanced therapiesRIAT13.851.203.831.053.831.090.907
RIAT23.901.163.861.073.871.090.732
RIAT33.921.163.791.093.821.110.364
RIAT44.250.924.230.764.230.800.823
RIAT54.330.844.170.824.210.830.119
RIAT64.360.904.110.914.180.910.036
ALL4.101.064.000.974.031.000.053
Research interest in classical therapiesRICT13.651.323.631.253.641.270.878
RICT23.811.213.771.083.781.120.776
RICT33.691.283.841.073.801.130.311
RICT43.701.214.001.043.911.090.037
RICT54.290.954.180.854.210.880.352
RICT64.210.974.220.814.220.860.943
ALL3.891.193.941.053.931.090.445
Valuation of centers for advanced therapiesVCAT13.811.043.741.053.761.040.609
VCAT23.901.033.861.023.871.020.740
VCAT33.870.983.861.003.861.000.922
VCAT43.900.993.830.993.850.990.552
VCAT53.691.133.621.113.641.120.604
VCAT62.541.292.301.182.371.220.133
ALL3.621.183.531.203.561.190.172
Valuation of treatment with advanced therapiesVTAT14.290.824.320.794.310.800.709
VTAT24.121.034.250.844.210.900.273
VTAT34.320.754.270.844.290.820.646
VTAT44.101.034.050.964.060.980.698
VTAT54.350.804.330.764.330.770.868
VTAT64.310.734.280.814.290.780.753
ALL4.250.874.250.844.250.850.944
ATTITUDINAL COMPONENT 3.961.113.931.053.941.070.220

Mean values and standard deviations (SD) for the conceptual component and for each topic and each item included in this component.

In each case, results are shown for male and female residents separately and for all residents together. The last column shows the statistical p value for ANOVA comparisons between genders.

Mean values and standard deviations (SD) for the procedural component and for each topic and each item included in this component.

In each case, results are shown for male and female residents separately and for all residents together. The last column shows the statistical p value for ANOVA comparisons between genders. Statistically significant values (p<0.00017) are highlighted with asterisks (*).

Mean values and standard deviations (SD) for the attitudinal component and for each topic and each item included in this component.

In each case, results are shown for male and female residents separately, and for all residents together. The last column shows the statistical p value for ANOVA comparisons between genders. First, we analyzed the results for the three components evaluated in the questionnaire. Comparisons across the different components showed that the highest scores appeared in the procedural component (average 4.12±1.00), followed by the attitudinal component (3.94±1.07) and the conceptual component (3.04±1.43). Averages and standard deviations are shown in Tables 2–4 and Fig 1A. Tables 2–4 show the statistical p values for the comparison of males vs. females. In this regard, we found that average scores were significantly higher for males than for females only for the procedural component (Table 3).
Fig 1

Boxplots of the results for the components and topics analyzed in this study.

A: Components. B: Topics. Statistically significant differences (p<0.00017) are labeled with asterisks (*).

Boxplots of the results for the components and topics analyzed in this study.

A: Components. B: Topics. Statistically significant differences (p<0.00017) are labeled with asterisks (*). On the other hand, we compared the three components -conceptual, procedural and attitudinal- using the ANOVA test. Results showed statistical differences among the three components, with all comparisons being statistically significant (p<0.00017): conceptual vs. procedural, conceptual vs. attitudinal and procedural vs. attitudinal (Fig 1A). Second, we analyzed the topics. Analysis of the topics in the conceptual component showed the highest scores for the “Cell and tissue basis of the human body” topic, whereas the lowest scores were found for the “Regulatory framework” topic (Table 2 and Fig 1B). Table 2 shows the statistical p values for the ANOVA test for males vs. females. No gender differences were found. When each of the 5 topics in the conceptual component was compared with the other topics in this component, the differences were statistically significant (p<0.00017) for all comparisons (Fig 1B). For the procedural component, the highest scores were found for the “Biofabrication components for advanced therapies” topic, whereas the lowest were found for “Centers for biofabrication and storage of advanced therapies” (Table 3 and Fig 1B). For gender comparisons, we found that males assigned higher scores than females in items under the “Biofabrication components for advanced therapies” topic (statistically significant differences) (Table 3). Pairwise comparisons of these topics revealed statistically significant differences (p<0.00017) for all comparisons except “Application and use of advanced therapies” vs. “Biofabrication components for advanced therapies”, and “Application and use of advanced therapies” vs. “Application center for advanced therapies”, which were nonsignificant (Fig 1B). When topics included in the attitudinal component were analyzed, we found that the highest scores corresponded to the “Valuation of treatment with advanced therapies” topic, while the lowest scores were found for “Valuation of centers for advanced therapies” (Table 4 and Fig 1B). No differences were observed between males and females for any of the topics (Table 4). Pairwise comparisons between specific topics in this component yielded statistically significant differences (p<0.00017) among all topics, except for the comparison between “Research interest in advanced therapies” vs. “Research interest in classical therapies” (Fig 1B). Third, we analyzed the results for each specific item. Averages and standard deviations for each item are shown in Table 2, whereas the statistical p values for the comparison of two specific items are shown in Table 5. In the conceptual component (Fig 2A), we did not found any significant differences between male residents and female residents. For the “Advanced therapies” topic, the highest scores were given to item AdT2 “Are you familiar with the concept of gene therapy?”, which showed statistically significant differences (p<0.00017) compared to the rest of the items in this topic (Table 5). In contrast, items AdT3 “Are you familiar with the concept of somatic cell therapy?” and AdT4 “Are you familiar with the concept of combined advanced therapy?” received significantly lower scores than the remaining items under this topic. For the “Artificial tissues” topic we found the highest score for item ArT3 “Are you familiar with the concept of growth factors?”, which was significantly higher than the remaining item scores, whereas ArT2 “Are you familiar with the concept of biomaterial?”, ArT5 “Are you familiar with the concept of tissue engineering?” and ArT6 “Are you familiar with the concept of regenerative medicine?” had the lowest scores. For the “Cell and tissue basis of the human body” topic, items CTB1 “Are you familiar with the concept of cell?” and CTB2 Are you familiar with the concept of tissue?” had the highest scores of all items in this topic and in the conceptual component overall. However, item CTB6 “Are you familiar with the concept of IPS cell?” scored significantly lower than the remaining items in this topic. For the “Novel medical products” topic, item NMP5 “Do you know if growth factors are used to treat diseases?” scored significantly higher than the other items, whereas NMP6 “Do you know if there are benefits of these therapies with respect to current treatment techniques?” and NMP3 “Do you know if transplanted organs are medicines?” had the lowest scores. Regarding the “Regulatory framework” topic, items RF4 “Do you know if it is mandatory to perform a clinical trial before using advanced therapy products?” and RF5 “Do you know if all advanced therapies require authorization from the Spanish and European agencies for their implementation?” received significantly higher scores than the other items, whereas the lowest scores were found for RF2 “Do you know what GMP rooms are?” and RF3 “Do you know if it is mandatory to manufacture advanced therapy products considered medicines in GMP rooms?”.
Table 5

Statistical p values for pairwise comparisons of two specific items included in each topic of the conceptual component.

Advanced therapiesp valueArtificial tissuesp valueCell and tissue basis of the human bodyp valueNovel medical productsp valueRegulatory frameworkp value
AdT1 vs AdT23.42E-14*ArT1 vs ArT21.74E-04CTB1 vs CTB20.856NMP1 vs NMP20.947RF1 vs RF22.59E-11*
AdT1 vs AdT32.99E-06*ArT1 vs ArT36.95E-06*CTB1 vs CTB33.87E-02NMP1 vs NMP31.05E-02RF1 vs RF32.64E-12*
AdT1 vs AdT42.28E-08*ArT1 vs ArT40.972CTB1 vs CTB43.05E-17*NMP1 vs NMP41.50E-04*RF1 vs RF42.02E-13*
AdT1 vs AdT50.924ArT1 vs ArT51.13E-05*CTB1 vs CTB51.50E-33*NMP1 vs NMP52.30E-25*RF1 vs RF51.04E-08*
AdT1 vs AdT60.873ArT1 vs ArT62.53E-04CTB1 vs CTB64.30E-156*NMP1 vs NMP68.67E-05*RF1 vs RF60.193
AdT2 vs AdT32.19E-33*ArT2 vs ArT36.31E-17*CTB2 vs CTB30.052NMP2 vs NMP31.28E-02RF2 vs RF30.769
AdT2 vs AdT41.31E-38*ArT2 vs ArT41.01E-04*CTB2 vs CTB43.41E-17*NMP2 vs NMP41.18E-04*RF2 vs RF41.68E-40*
AdT2 vs AdT57.18E-13*ArT2 vs ArT50.530CTB2 vs CTB51.12E-33*NMP2 vs NMP51.38E-25*RF2 vs RF53.14E-32*
AdT2 vs AdT67.91E-13*ArT2 vs ArT60.921CTB2 vs CTB67.63E-158*NMP2 vs NMP61.15E-04*RF2 vs RF61.59E-15*
AdT3 vs AdT40.383ArT3 vs ArT44.06E-06*CTB3 vs CTB43.02E-11*NMP3 vs NMP44.56E-10*RF3 vs RF42.60E-42*
AdT3 vs AdT54.86E-06*ArT3 vs ArT51.68E-19*CTB3 vs CTB51.27E-25*NMP3 vs NMP55.51E-37*RF3 vs RF57.58E-34*
AdT3 vs AdT63.08E-06*ArT3 vs ArT61.36E-16*CTB3 vs CTB61.22E-142*NMP3 vs NMP60.156RF3 vs RF61.02E-16*
AdT4 vs AdT55.25E-08*ArT4 vs ArT55.57E-06*CTB4 vs CTB53.23E-05*NMP4 vs NMP56.56E-11*RF4 vs RF50.103
AdT4 vs AdT62.94E-08*ArT4 vs ArT61.50E-04*CTB4 vs CTB68.36E-92*NMP4 vs NMP68.03E-14*RF4 vs RF67.02E-10*
AdT5 vs AdT60.951ArT5 vs ArT60.467CTB5 vs CTB64.26E-63*NMP5 vs NMP66.01E-43*RF5 vs RF66.25E-06*

Statistically significant values (p<0.00017) are highlighted with asterisks (*).

Fig 2

Boxplots of the results for the items included in each topic.

A: Items in the conceptual component. B: Items in the procedural component. C: Items in the attitudinal component.

Boxplots of the results for the items included in each topic.

A: Items in the conceptual component. B: Items in the procedural component. C: Items in the attitudinal component. Statistically significant values (p<0.00017) are highlighted with asterisks (*). Analysis of the items in the procedural component (Fig 2B) disclosed some significant differences. Averages and standard deviations for each item are shown in Table 3, and the statistical p values for the comparison of two specific items are shown in Table 6. When males and females were compared, we did not found any significant differences. In the “Application and use of advanced therapies” topic, item AUAT1 “Would you use the patient's own cells for treatment with cell therapy?” scored significantly higher (p<0.00017; Table 6) than item AUAT2 “Would you use cells from donors to treat a patient with cell therapy?”. Item AUAT2 “Would you use cells from donors to treat a patient with cell therapy?” scored significantly lower than AUAT3 “Would you apply cell therapy to treat a disease?”, AUAT4 “Would you apply gene therapy to treat a disease?” and AUAT5 “Would you apply tissue-engineered tissues to treat a disease?”. Regarding the “Application center for advanced therapies” topic, the three items that mentioned hospitals, e.g. ACAT1 “Would you use hospitals for a cell therapy treatment?”, ACAT3 “Would you use hospitals for a gene therapy treatment?” and ACAT5 “Would you use hospitals to treat a patient with artificial tissues generated by tissue engineering?” received significantly higher scores than the three items on advanced therapies in primary care health centers (ACAT2, ACAT4 and ACAT6). For the “Biofabrication components for advanced therapies” topic, the highest scores were found for items BCAT1 “Would you use umbilical cord stem cells to build artificial tissues?” and BCAT2 “Would you use bone marrow stem cells to build artificial tissues?”. The differences were statistically significant for the comparison between the first of these items and BCAT4 “Would you use dental pulp stem cells to build artificial tissues?”, BCAT5 “Would you build artificial tissues with biomaterials?” and BCAT6 “Would you build artificial tissues with growth factors?”. In addition, the difference between BCAT2 “Would you use bone marrow stem cells to build artificial tissues?” and BCAT4 “Would you use dental pulp stem cells to build artificial tissues?” was statistically significant. For the “Centers for biofabrication and storage of advanced therapies” topic, items CBSAT1 “Would you store artificial tissues in tissue banks for deferred use?”, CBSAT2 “Would you store cells in tissue banks for deferred use?” and CBSAT6 “Would you use a research center to build artificial tissues?” obtained the highest scores, whereas CBSAT5 “Would you use a pharmaceutical company to build artificial tissues?” scored lowest of all items across all procedural topics. The differences were statistically significant for, among others, the comparisons of item CBSAT5 “Would you use a pharmaceutical company to build artificial tissues?”, which received the lowest score, and CBSAT4 “Would you use a primary care health center to build artificial tissues?” vs. the remaining items.
Table 6

Statistical p values for pairwise comparisons of two specific items included in each topic of the procedural component.

APPLICATION AND USE OF ADVANCED THERAPIESp valueAPPLICATION CENTER FOR ADVANCED THERAPIESp valueBIOFABRICATION COMPONENTS FOR ADVANCED THERAPIESp valueCENTERS FOR BIOFABRICATION AND STORAGE OF ADVANCED THERAPIESp value
AUAT1 vs AUAT25.75E-09*ACAT1 vs ACAT23.93E-05*BCAT1 vs BCAT20.608CBSAT1 vs CBSAT20.919
AUAT1 vs AUAT30.123ACAT1 vs ACAT30.879BCAT1 vs BCAT30.002CBSAT1 vs CBSAT30.013
AUAT1 vs AUAT40.106ACAT1 vs ACAT41.49E-06*BCAT1 vs BCAT42.95E-05*CBSAT1 vs CBSAT42.45E-15*
AUAT1 vs AUAT50.309ACAT1 vs ACAT51.000BCAT1 vs BCAT51.25E-04*CBSAT1 vs CBSAT52.22E-53*
AUAT1 vs AUAT62.61E-04ACAT1 vs ACAT61.19E-05*BCAT1 vs BCAT61.29E-04*CBSAT1 vs CBSAT60.289
AUAT2 vs AUAT34.39E-06*ACAT2 vs ACAT31.04E-04*BCAT2 vs BCAT30.007CBSAT2 vs CBSAT30.009
AUAT2 vs AUAT48.26E-06*ACAT2 vs ACAT40.434BCAT2 vs BCAT41.33E-04*CBSAT2 vs CBSAT46.61E-16*
AUAT2 vs AUAT52.59E-07*ACAT2 vs ACAT55.36E-05*BCAT2 vs BCAT50.001CBSAT2 vs CBSAT51.39E-54*
AUAT2 vs AUAT60.021ACAT2 vs ACAT60.798BCAT2 vs BCAT60.001CBSAT2 vs CBSAT60.240
AUAT3 vs AUAT40.920ACAT3 vs ACAT44.66E-06*BCAT3 vs BCAT40.289CBSAT3 vs CBSAT45.33E-08*
AUAT3 vs AUAT50.567ACAT3 vs ACAT50.882BCAT3 vs BCAT50.467CBSAT3 vs CBSAT52.11E-39*
AUAT3 vs AUAT60.022ACAT3 vs ACAT63.43E-05*BCAT3 vs BCAT60.468CBSAT3 vs CBSAT60.146
AUAT4 vs AUAT50.505ACAT4 vs ACAT52.18E-06*BCAT4 vs BCAT50.707CBSAT4 vs CBSAT52.79E-16*
AUAT4 vs AUAT60.030ACAT4 vs ACAT60.595BCAT4 vs BCAT60.707CBSAT4 vs CBSAT64.76E-12*
AUAT5 vs AUAT60.004ACAT5 vs ACAT61.68E-05*BCAT5 vs BCAT61.000CBSAT5 vs CBSAT61.03E-47*

Statistically significant values (p<0.00017) are highlighted with asterisks (*).

Statistically significant values (p<0.00017) are highlighted with asterisks (*). Finally, in the attitudinal component (Fig 2C), we did not found significant differences between the scores given by males and females (Table 4). Averages and standard deviations for each item are shown in Table 4, and the statistical p values for the comparison of two specific items are shown in Table 7. For the “Research interest in advanced therapies” topic, the highest scores were found for items RIAT4 “Do you think performing clinical trials in cell therapy is a good idea?”, RIAT5 “Do you think performing clinical trials with artificial tissues is a good idea?” and RIAT6 “Do you think performing clinical trials in gene therapy is a good idea?”, and some differences compared to the other items in this topic were statistically significant (p<0.00017; Table 7). Analysis of the “Research interest in classical therapies” topic showed that items RICT5 “Do you think performing clinical trials to test pharmaceutical drugs is a good idea?” and RICT6 “Do you think performing clinical trials in physical therapy is a good idea?” had the highest scores, with significant differences compared to most of the remaining items, whereas the lowest values were seen for item RICT1 “Are you interested in research in surgery?”. Regarding the “Valuation of centers for advanced therapies” topic, we found that items VCAT2 “Do you prefer hospitals for the application of gene therapy?”, VCAT3 “Do you prefer hospitals for the application of artificial tissue therapy?” and VCAT4 “Do you prefer hospitals for the application of combined advanced therapies?” received the highest scores, whereas VCAT6 “Do you prefer artificial tissues to be manufactured by the pharmaceutical industry?” had the lowest item score across all attitudinal topics, with significant differences compared to the rest of the items. In the last attitudinal topic, “Valuation of treatment with advanced therapies”, most items received similarly high scores, whereas item VTAT4 “Do you think so-called advanced therapies are a good idea?” had the lowest score.
Table 7

Statistical p values for pairwise comparisons of two specific items included in each topic of the attitudinal component.

RESEARCH INTEREST IN ADVANCED THERAPIESp valueRESEARCH INTEREST IN CLASSICAL THERAPIESp valueVALUATION OF CENTERS FOR ADVANCED THERAPIESp valueVALUATION OF TREATMENT WITH ADVANCED THERAPIESp value
RIAT1 vs RIAT20.682RICT1 vs RICT20.143VCAT1 vs VCAT20.179VTAT1 vs VTAT20.136
RIAT1 vs RIAT30.911RICT1 vs RICT30.104VCAT1 vs VCAT30.230VTAT1 vs VTAT30.686
RIAT1 vs RIAT44.52E-07*RICT1 vs RICT40.004VCAT1 vs VCAT40.279VTAT1 vs VTAT40.001
RIAT1 vs RIAT52.08E-06*RICT1 vs RICT52.61E-10*VCAT1 vs VCAT50.163VTAT1 vs VTAT50.755
RIAT1 vs RIAT62.94E-05*RICT1 vs RICT69.67E-11*VCAT1 vs VCAT69.34E-44*VTAT1 vs VTAT60.680
RIAT2 vs RIAT30.604RICT2 vs RICT30.856VCAT2 vs VCAT30.871VTAT2 vs VTAT30.274
RIAT2 vs RIAT44.42E-06*RICT2 vs RICT40.140VCAT2 vs VCAT40.776VTAT2 vs VTAT40.051
RIAT2 vs RIAT51.76E-05*RICT2 vs RICT52.19E-07*VCAT2 vs VCAT50.007VTAT2 vs VTAT50.071
RIAT2 vs RIAT61.83E-04RICT2 vs RICT69.04E-08*VCAT2 vs VCAT62.05E-50*VTAT2 vs VTAT60.265
RIAT3 vs RIAT42.99E-07*RICT3 vs RICT40.200VCAT3 vs VCAT40.902VTAT3 vs VTAT40.002
RIAT3 vs RIAT51.39E-06*RICT3 vs RICT57.45E-07*VCAT3 vs VCAT50.010VTAT3 vs VTAT50.473
RIAT3 vs RIAT62.02E-05*RICT3 vs RICT63.24E-07*VCAT3 vs VCAT61.63E-50*VTAT3 vs VTAT61.000
RIAT4 vs RIAT50.765RICT4 vs RICT52.69E-04VCAT4 vs VCAT50.014VTAT4 vs VTAT51.63E-04*
RIAT4 vs RIAT60.449RICT4 vs RICT61.46E-04*VCAT4 vs VCAT64.51E-50*VTAT4 vs VTAT60.002
RIAT5 vs RIAT60.641RICT5 vs RICT60.888VCAT5 vs VCAT61.20E-35*VTAT5 vs VTAT60.463

Statistically significant values (p<0.00017) are highlighted with asterisks (*).

Statistically significant values (p<0.00017) are highlighted with asterisks (*).

Discussion

The increasing relevance of gene-, cell- and tissue-based therapies in medicine and the expectations these novel therapies generate in the population of health care users require specific studies in this field. Incorporating knowledge about advanced therapies in training programs for future family medicine physicians will allow these professionals to contribute effectively to health education in the user population. However, before training activities are developed and implemented for family medicine residents, their conceptual, procedural and attitudinal profiles related to these therapies should be investigated. As indicated by different theoretical frameworks in educational research, a wide range of circumstances can potentially promote or limit the learning process in a particular situation [20-22]. Moreover, studies of medical residents’ perceptions regarding professional practice have demonstrated the importance that residents give to the need to overcome shortcomings in their professional behavior, cognitive ability and procedure skills [23, 24]. In the present study we examined how family medicine residents perceive advanced therapies in terms of their knowledge, their approach to implementing these therapies, and their attitudes toward these novel therapeutic tools. According to the overall results of this study, the scores for the procedural component were the highest among the three components of perception in family medicine residents, whereas the lowest scores were found for the conceptual component. Strikingly, although residents perceived that procedures for implementing advanced therapies are well established, probably due to the strict regulation of protocols [1, 25], they also perceived that their cognitive background is insufficient to respond to the expectations generated by these new therapeutic tool. The scores for the attitudinal component were intermediate between the procedural and conceptual components. Attitudes represent a summation of thinking, emotions and feelings about a specific issue–for example, in the context of learning a course [19]. This facilitates not only personal equilibrium, but also the positive coexistence of professional and social values and beliefs. As pointed out by Li et al. [26], the current literature lacks a discussion of the attitudes of the medical community regarding ways to balance cost-effectiveness with equity in the use of and access to treatments. Our results reflect this situation. In fact, the attitudes of family medicine residents who participated in the present study are situated in a prudent balance between what they perceive could be implemented clinically–the procedural component–and what they perceive they know about advances therapies–the conceptual component. When we analyzed the different topics included in the conceptual component, our results highlighted that residents gave the highest values to their perceived knowledge of cells and tissues in the human body, and the lowest values to their knowledge of the regulatory framework for these therapies. After knowledge of cells and tissues, the perception of topics regarding knowledge of artificial tissues, advanced therapies and new medical products received progressively lower scores. These results may be explained by the fact that most of the topics and items our respondents scored highest correspond to concepts that are part of the core curriculum of medical training in medical schools [20, 27], in contrast with other concepts such as GMP facilities, IPs cells or biomaterials. In addition, these findings may have been influenced by the widespread use of growth factors among commonly used advanced therapies [28-30], the wide dissemination of news about gene therapy in the lay media [31, 32], and finally, the application to advanced therapies of regulations and protocols that residents are usually familiar with for ordinary therapies (e.g. clinical trials, authorizations, etc.) [33, 34]. Regarding the topics and items included in the procedural component, the highest and lowest scores were found, respectively, for "biofabrication components for advances therapies" and "centers for biofabrication and storage of advances therapies”. In the former case, there was good correlation with the results for the conceptual component, since the topic with the highest score in this component (knowledge of cells and tissues) constitutes the foundation of knowledge elements that are needed for the biofabrication of ATMPs [1, 25]. In the latter case, procedural knowledge referred to centers for the manufacture and storage of advanced therapies is mostly absent from the training objectives for family medicine residents. These results show that residents are better informed about the procedures needed to apply advanced therapies than about the types of center where each therapy should be applied. This is consistent with the low scores obtained for knowledge of the regulatory framework in the conceptual component, as discussed above. Spanish family medicine residents are willing to consider advanced therapies as a possible tool in the therapeutic management of their patients. However, as deduced from their responses, they seem highly aware of the risks and limitations, given that they indicated their preference for using tools that have been well tested in clinical research, e.g. stem cells from the bone marrow or umbilical cord, and would prefer to use autologous cells instead of donor cells. Nevertheless, this situation is likely to change in the immediate future because some stem cells, which can be cryopreserved and stored in tissue banks, are increasingly used in advanced therapies to treat a variety of oncologic, genetic, hematologic and immune deficiency disorders [35-38]. This means that in the foreseeable future, family medicine physicians will come to play an important role not only in patients’ education–i.e., how to guide patients contemplating unproven and unapproved advanced therapies, and thus avoid medical tourism–but also in patients’ safety at the primary care level, in the daily follow-up of patients treated with this type of therapy [39]. Although some authors have expressed alarm over the decrease in the scope of care being provided by family medicine physicians, the emergence of advances therapies opens new areas of activity within the remit of these professionals–activities, however, that the residents in this study did not seem to significantly perceive at the present time [27, 40, 41]. When topics and items of the attitudinal component were analyzed, we found that the highest scores corresponded to valuation of treatment with advanced therapies, while the lowest scores were seen for valuation of centers where these therapies would be implemented. Again, and in consonance with the tendency observed for the procedural component, residents’ attitude-related responses attributed more value to the possible use of these new treatments than to the logistic support that makes these treatments possible. However, they expressed a preference for hospitals as the most appropriate setting for the application of advanced therapies, and were less supportive of the manufacture of artificial tissues as medical products by the pharmaceutical industry. In addition, residents valued research in advanced therapies more highly than research in classical therapies. Although it has been suggested that family medicine residents are less interested in research than other graduates, our results showed that they not only had a positive attitude towards new therapies, but also expressed a more favorable attitude towards research in new therapies than towards research in classical therapies [42, 43]. The attitudes reported by the residents in our sample again showed that they are aware of the need to use proven therapeutic tools for both classical and advanced therapies. This finding argues very strongly in favor of efforts to involve family medicine physicians in health education programs for these new therapies. Family medicine professionals should act as qualified medical educators able to guide patients regarding proven and unproven advanced interventions, and to advise patients on cost-effectiveness in the use of and access to treatments [26, 40, 41, 44, 45]. Regarding gender, our results showed very few differences between male and female residents. Significant differences were found only for the procedural component and for the “Biofabrication components for advanced therapies” topic, but not for the conceptual and attitudinal components. These findings are consistent with the patterns usually described in relation to gender and medicine [15, 46–48]. Our results can contribute to a better understanding of residents’ profiles regarding advanced therapies, and the slight gender differences detected in our respondents should be taken into account when new training programs are implemented in this area. Although differences between genders remain poorly understood, they may result from factors such as role modeling and socialization by family, teachers, peers and the media, rather than from “innate or natural differences” between women and men [48, 49]. In conclusion, this questionnaire-based study provides evidence that can be used to establish profiles associated with the conceptual, procedural and attitudinal components of Spanish family medicine residents’ views on advanced therapies. Although they perceived that procedures to implement advanced therapies are well established, especially in terms of application, they feel their cognitive background is not strong enough to efficiently respond to the expectations generated by these new therapeutic tools, and perceive themselves to be especially underprepared regarding their knowledge of the regulatory framework. In their attitudinal responses, residents gave more value to the possible use of these new treatments than to the logistic support that makes these new therapies possible, and on a secondary level, they also gave more value to research in advanced therapies than in classical therapies. Their keen awareness of the risks and limitations of these treatments was reflected by their preference for using cells that have undergone thorough clinical testing. Although they appropriately situated treatment with these therapies at the hospital level, it is important to note that they significantly associated biofabrication with research centers, although these therapeutic tools can also be produced at different types of facilities. One of the limitations of this study is the use of a questionnaire designed and validated originally in the Spanish language. Although the most relevant concepts are accurately translatable into English, care should be exercised before using the translated questionnaire for native English speakers, since some items may not perfectly match the answers provided by the Likert-like scale used here. Future work should aim to ensure the accurate translation and cultural adaptation of the questionnaire for respondents in specific settings. Versions of the questionnaire in other languages should be used only after an appropriately validated translation process. Another limitation is the use of the same response scale for all conceptual, procedural and attitudinal items, some of which may require specific answer options. However, using the same scale favored homogeneity and comparability among the items, topics and components. Despite these limitations, we conclude that the results of this study are potentially useful to support the design of future training programs and health policies of family medicine residents, in view of the rapid development of these treatments, the expectations they raise in patients, and the responsibility of professionals to use these complex therapies in an equitable and cost-effective manner.

Raw data showing the scores assigned by each resident to each item of the questionnaire.

(XLSX) Click here for additional data file.

Questionnaire used in the present study, with the different components, topics, items and abbreviated item names used in the tables.

(PDF) Click here for additional data file.
  43 in total

1.  Clinical translation of stem cell therapies: a bridgeable gap.

Authors:  Natividad Cuende; Ander Izeta
Journal:  Cell Stem Cell       Date:  2010-06-04       Impact factor: 24.633

2.  Medicine. A history lesson for stem cells.

Authors:  James M Wilson
Journal:  Science       Date:  2009-05-08       Impact factor: 47.728

Review 3.  The "Growing" Reality of the Neurological Complications of Global "Stem Cell Tourism".

Authors:  Katie Julian; Nick Yuhasz; Ethan Hollingsworth; Jaime Imitola
Journal:  Semin Neurol       Date:  2018-05-23       Impact factor: 3.420

4.  Andalusian initiative for advanced therapies: fostering synergies.

Authors:  Natividad Cuende
Journal:  Stem Cells Transl Med       Date:  2013-04-01       Impact factor: 6.940

5.  Reassessing direct-to-consumer portrayals of unproven stem cell therapies: is it getting better?

Authors:  Ubaka Ogbogu; Christen Rachul; Timothy Caulfield
Journal:  Regen Med       Date:  2013-05       Impact factor: 3.806

Review 6.  Healthcare professionals' knowledge, attitudes and skills regarding patient safety: a systematic literature review.

Authors:  Indre Brasaite; Marja Kaunonen; Tarja Suominen
Journal:  Scand J Caring Sci       Date:  2014-04-08

7.  Wide Gap between Preparation and Scope of Practice of Early Career Family Physicians.

Authors:  Lars E Peterson; Bo Fang; James C Puffer; Andrew W Bazemore
Journal:  J Am Board Fam Med       Date:  2018 Mar-Apr       Impact factor: 2.657

8.  Global Tissue Engineering Trends: A Scientometric and Evolutive Study.

Authors:  Antonio Santisteban-Espejo; Fernando Campos; Laura Martin-Piedra; Daniel Durand-Herrera; Jose Antonio Moral-Munoz; Antonio Campos; Miguel Angel Martin-Piedra
Journal:  Tissue Eng Part A       Date:  2018-05-24       Impact factor: 3.845

Review 9.  What do we know about Canadian involvement in medical tourism?: a scoping review.

Authors:  Jeremy Snyder; Valorie A Crooks; Rory Johnston; Paul Kingsbury
Journal:  Open Med       Date:  2011-08-16

10.  Effects of age, gender and educational background on strength of motivation for medical school.

Authors:  Rashmi Kusurkar; Cas Kruitwagen; Olle ten Cate; Gerda Croiset
Journal:  Adv Health Sci Educ Theory Pract       Date:  2009-09-23       Impact factor: 3.853

View more
  1 in total

1.  Information and Scientific Impact of Advanced Therapies in the Age of Mass Media: Altmetrics-Based Analysis of Tissue Engineering.

Authors:  Antonio Santisteban-Espejo; Miguel Angel Martin-Piedra; Antonio Campos; Julia Moran-Sanchez; Manuel J Cobo; Ana I Pacheco-Serrano; Jose A Moral-Munoz
Journal:  J Med Internet Res       Date:  2021-11-26       Impact factor: 5.428

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.