Literature DB >> 26557206

Analysis of Soccer Players' Positional Variability During the 2012 UEFA European Championship: A Case Study.

Felipe Arruda Moura1, Juliana Exel Santana2, Nathália Arnosti Vieira2, Paulo Roberto Pereira Santiago3, Sergio Augusto Cunha2.   

Abstract

The purpose of this study was to analyse players' positional variability during the 2012 UEFA European Championship by applying principal component analysis (PCA) to data gathered from heat maps posted on the UEFA website. We analysed the teams that reached the finals and semi-finals of the competition. The players' 2D coordinates from each match were obtained by applying an image-processing algorithm to the heat maps. With all the players' 2D coordinates for each match, we applied PCA to identify the directions of greatest variability. Then, two orthogonal segments were centred on each player's mean position for all matches. The segments' directions were driven by the eigenvectors of the PCA, and the length of each segment was defined as one standard deviation around the mean. Finally, an ellipse was circumscribed around both segments. To represent player variability, segment lengths and elliptical areas were analysed. The results demonstrate that Portugal exhibited the lowest variability, followed by Germany, Spain and Italy. Additionally, a graphical representation of every player's ellipse provided insight into the teams' organisational features throughout the competition. The presented study provides important information regarding soccer teams' tactical strategy in high-level championships that allows coaches to better control team organisation on the pitch.

Entities:  

Keywords:  heat map; match analysis; principal component analysis; tactics

Year:  2015        PMID: 26557206      PMCID: PMC4633258          DOI: 10.1515/hukin-2015-0078

Source DB:  PubMed          Journal:  J Hum Kinet        ISSN: 1640-5544            Impact factor:   2.193


Introduction

Researchers in sports science, particularly those who study team sports, have attempted to yield quantitative data about technical, physical and tactical aspects of performance during competitive situations. The technical elements of player’s performance in soccer, such as control, passing, a shot-to-goal ratio and fouls, are measured by notational systems and have been widely studied to identify patterns of play (Barros et al., 2006; Bate, 1988; Hughes and Franks, 2005; Yamanaka et al., 1993). Video-based systems can also automatically and accurately gather players’ positional data to obtain the distances they cover and their velocities for use as indicators of an athletes’ physical condition (Barros et al., 2007; Bradley et al., 2009; Di Salvo et al., 2007; Di Salvo et al., 2009). Positional data have also been used extensively to study tactical issues in team sports such as basketball (Bourbousson et al., 2010), futsal (Moura et al., 2011) and soccer (Moura et al., 2013; Moura et al., 2012; Okihara et al., 2004; Yue et al., 2008). These studies present information about team organisation and tactical dynamics during matches. Furthermore, tactics in team sports have been evaluated using a dynamical systems approach (Bourbousson et al., 2010; Gréhaigne et al., 1997; McGarry et al., 2002). Dyads of players and/or teams have been considered in these investigations to analyse a team’s organisational level during attack plays that precede goals (Gréhaigne et al., 1997). However, from players’ trajectories, it is also possible to analyse movement variability during matches. Such variability has been studied to understand the main factors and constraints that affect players’ actions. Considering the tactical behaviour of players, the variability of players’ trajectories can be viewed as an interesting indicator in characterising soccer players within their specific tactical zones (Couceiro et al., 2014). The study of individual movement variability can explain how players performance in complex and dynamic environments, such as soccer matches, can manage space and time as a function of specific constraints (Davids et al., 2005; Silva et al., 2014). From players trajectories obtained using GPS devices during small-sided games, a recent study (Silva et al., 2014) evaluated players’ movement variability as a function of changes in field dimension and compared the behaviour of players of two different levels (national and regional). The authors’ presented linear (percentage of coefficient variation) and nonlinear (Shannon and sample entropies) analyses to examine the variability of the players’ spatial-temporal characteristics. The main result indicated that increases in pitch size resulted in more restricted action zones for both groups. National players were more sensitive to pitch modifications and displayed more variability than regional players did in small and intermediate pitches. In another recent investigation (Couceiro et al., 2014), the concept of stability for soccer was presented as not only the resistance to a perturbation, but also a player’s capability to maintain his trajectory within a specific region (such as his tactical position on the field). The existence of a stable equilibrium point implies the existence of a “restoring force” that is directed towards the equilibrium point. Thus, players usually converge at an equilibrium point that is defined by their tactical position. Using entropy measures from players’ trajectories, the authors presented stability differences among soccer positions that may be related to their specific tactical missions. Furthermore, a previous study applied principal component analysis (PCA) to players’ positional data to understand tactical performance in soccer (Barros et al., 2006). PCA is a multivariate statistical method of data analysis that transforms a set of observations of different variables into a set of uncorrelated variables, called principal components. The principal components are linear combinations of the original variables and are orthogonal to each other. The observations are then projected onto each principal component, yielding a new variable of which variance is the highest among all possible choices for each component (Jolliffe, 2002). Barros and colleagues (2006) analysed players’ positional variability on the pitch, based on players’ planar coordinates when performing a technical action, by applying PCA. The authors graphically represented the two principal components related to 2D positional data and indicated the directions on the pitch where players performed their technical actions. Despite the importance of these studies and results, they depend on players’ 2D planar coordinate data to investigate positional variability during a match. However, it is possible that coaches do not have access to such technology to obtain players’ trajectories data. Additionally, coaches may need to investigate adversary tactical behaviour, such as players’ positional variability, previous to a match, but clearly they cannot collect such information. As an alternative solution, advances in data collection technologies for team sports have allowed for access to performance indicators online during matches. In 2012, the UEFA European Championship official website provided several match statistics as well as information about team and player performances. One of these performance indicators was the heat map of each player, which indicates the frequency of a player’s position at a given location on the pitch. Thus, the region where a player visited most may represent the equilibrium point that is defined by his tactical position (Couceiro et al., 2014). Although the heat maps do not provide player coordinates as a function of time to allow for the quantification of positional variability during a match, using image processing it is possible to detect the pitch location that a given player visited most. The same procedure can be performed during a given championship, and player positional variability throughout the matches can be described. Furthermore, the player heat maps are calculated and presented on an individual basis and, consequently, do not provide collective information about how a team was organised during a match or how this organisation evolved during the championship. The representation of team data can be helpful information for coaches to obtain knowledge on regarding team tactics and can facilitate the analysis of collective behaviour changes during each match. In this sense, PCA applied to heat maps over the course of a championship can provide the overall directions of highest variability for each player and yield a portrait of team tactics throughout an entire competition. Therefore, the aim of this study was to propose an analysis of players’ positional variability during the 2012 UEFA European Championship (EURO 2012) by applying PCA to the data provided by heat maps posted on the UEFA official website.

Material and Methods

We analysed the heat maps of the starting players for the teams from Spain, Italy, Germany and Portugal during the EURO 2012. Once Spain and Italy reached the finals, we analysed their six matches, whereas Portugal and Germany only had five matches that could be analysed. The heat map figures of the players for each match were publically available on the UEFA official website (www.uefa.com) throughout the course of the competition. A player’s heat map is a 2D shaded-surface plot that represents the locations on the pitch that the player “visited” most frequently. Usually, this information is obtained by video-based tracking methods that provide a player’s position as a function of time. On a heat map, the pitch locations the player covered most frequently are coloured red, whereas the locations never frequented by the player are coloured black (Figure 1).
Figure 1

Example of the treatment of heat map images and the identification of a 2D player position for further PCA application.

To identify a player’s main position during a match, based on his heat map, a Matlab® algorithm was created to automatically recognise red pixels in the figure. Thus, each image was imported into the Matlab® software as an array with dimensions of 135 × 202 × 3. The first and second elements represented the pixel resolution of the heat maps, and the third element represented the red, green and blue intensities of each pixel. The figure was imported as an 8-bit RGB image in which the colour components were represented as integers in the range [0, 255]. In the algorithm employed, the red pixels were recognised using a filter to identify integers greater than 240 for the red array, lower than 35 for the blue array and lower than 10 for the green array (see appendix). After obtaining the 2D coordinates that represented the red pixels, we calculated the mean coordinate values that represented player positions in each match (indicated by a white asterisk in Figure 1). Finally, these mean coordinates were converted from pixels to metres based on the dimensions of a standard football pitch, i.e., 110 × 75 m. Principal component analysis was applied to identify player position variability during the competition, using each player’s mean position on the pitch (see appendix). The data set consisted of one matrix for each player R(x(i), y(i)), where x(i) and y(i) represent the mean coordinates on the pitch during the match, with i=1,…,N, where N is the total number of matches (N = 6 for Spain and Italy and N = 5 for Germany and Portugal). We applied PCA to the covariance matrix of the R input data set, and the following variables were obtained: a) the principal components of the new coordinate system, the eigenvectors u and v, and b) the eigenvalues (λ1 and λ2) corresponding to the total variability explained by each principal component. With these variables, a graphical representation was created for each player. Two orthogonal segments were centred on the mean position of each player for all matches (i.e., the mean values of R). The segments’ directions were driven by the eigenvectors of the PCA, and the length of each segment was defined as one standard deviation (σ1 and σ2) around the mean, which was calculated by extracting the square root of each eigenvalue, λ1 and λ2. Figure 2 presents a graphical representation of the orthogonal segments for one player. Each small circle represents the player’s mean coordinates during each match.
Figure 2

Graphical representation of player’s position variability resulting from PCA. The small circles represent the player’s mean position obtained from each of six matches. The black line segments inside the ellipse represent the variability associated with the first and second principal components.

Finally, to quantitatively analyse player position variability during the competition, three variables were registered: elliptical area (given by the expression A=π*σ1*σ2), which represents each player’s general variability, first component length (σ1) and second component length (σ2), which represent the amount of variability in the two directions that varied the most. Through descriptive analysis, the values of these variables obtained for each team and for each position group were expressed by the median and interquartile range calculated according to McGill et al. (1978).

Results

Figure 3 presents the PCA results obtained for the players from Spain, Italy, Germany and Portugal during all EURO 2012 matches. The figure depicts each team’s organisation on the pitch during the competition, as well as all players’ positional variability. The largest individual elliptical areas and their orthogonal segments represent major changes to the teams’ organisational patterns. As a result, it is possible to visually confirm that Italy implemented significant changes in its players’ positions as PCA of the data resulted in the largest ellipses and orthogonal segments. By contrast, small ellipses can be observed for the other teams, representing reduced variability during the competition.
Figure 3

PCA calculated for each of the 11 players on the teams from Spain, Italy, Germany and Portugal during EURO 2012.

To better comprehend the teams’ variability in a player position during the competition, Table 1 presents the median and the interquartile ranges of all variables for each team analysed and the values obtained for each player. The quantitative results confirm that Italy, which exhibited the largest elliptical areas and length values for the components, did in fact demonstrate the highest variability among all the teams analysed. Furthermore, Portugal, which exhibited the smallest elliptical areas and first and second segment lengths, demonstrated the lowest variability. Additionally, Figures 4, 5 and 6 present boxplots that represent players’ variability according to a playing position. The results show that the external midfielders and external defenders presented the greatest variability throughout the championship compared with that observed for the other positions, mainly due to the elliptical area and first component length (Figures 4 and 5, respectively).
Table 1

Players’ position variability determined for the finalist teams of EURO 2012, represented by the median (interquartile range) of elliptical areas and first and second eigenvalue lengths obtained by PCA

TeamsPlayersEllipsis Area (m2)Variables First Component Length (m)Second Component Length (m)
SpainGoalkeeper3.61.90.6
External defender141.015.32.9
External defender95.911.02.8
Central Defender54.27.52.3
Central Defender62.45.63.6
Central Midfielder97.98.13.8
External Midfielder54.65.93.0
External Midfielder124.09.14.3
Forward40.54.62.8
Forward136.110.94.0
Forward21.14.81.4
Median (IQR)62.4 (73.5)7.5 (5.5)2.9 (1.3)

ItalyGoalkeeper7.84.30.6
External defender132.813.23.2
External defender117.415.12.5
Central Defender240.212.46.2
Central Defender103.816.12.1
Central Defender202.914.44.5
Central Midfielder84.48.43.2
External Midfielder106.58.63.9
External Midfielder177.914.24.0
Forward215.514.74.7
Forward118.69.73.9
Median (IQR)118.6 (92.2)13.2 (5.7)3.9 (1.7)

GermanyGoalkeeper4.72.60.6
External defender47.59.71.6
External defender54.05.33.2
Central Defender15.43.41.4
Central Defender37.44.62.6
Central Midfielder60.65.43.5
Central Midfielder49.75.82.7
Central Midfielder97.28.83.5
External Midfielder307.812.38.0
External Midfielder72.56.33.7
Forward47.013.81.1
Median (IQR)49.7 (29.7)5.8 (4.8)2.7 (2.1)

PortugalGoalkeeper2.93.20.3
External defender30.94.72.1
External defender69.311.61.9
Central Defender17.03.11.7
Central Defender12.44.50.9
Central Midfielder65.25.53.7
External Midfielder216.015.14.6
External Midfielder113.211.43.2
Forward34.65.62.0
Forward220.89.27.6
Forward33.55.71.9
Median (IQR)34.5 (81.8)5.6 (6.3)2.0 (1.8)
Figure 4

Players’ position variability determined for the finalist teams of EURO 2012, represented by the elliptical areas obtained by PCA.

Figure 5

Players’ position variability determined for the finalist teams of EURO 2012, represented by the first component length obtained by PCA.

Figure 6

Players’ position variability determined for the finalist teams of EURO 2012, represented by the second component length obtained by PCA.

Discussion

The aim of this study was to analyse players’ positional variability during the 2012 UEFA European Championship (EURO 2012) by applying PCA to heat maps to evaluate the teams’ tactical behaviour patterns throughout the competition. Specifically, we analysed the teams that reached the competition’s final and semi-final rounds. Portugal presented the lowest variability, followed by, in ascending order, Germany, Spain and Italy. External midfielders and external defenders presented the greatest variability among all positions. The analysis of the results must be interpreted carefully because variability has been studied from different viewpoints. From a traditional motor learning perspective, variability has been considered to be an essential element of the healthy function of a system under investigation and consequently offers flexibility in adapting to perturbations (Hamill et al., 1999; van Emmerik and van Wegen, 2000; Wilson et al., 2008). When addressing movement coordination from a dynamical systems perspective, measures of variability become critical to understanding movement dynamics (Hamill et al., 2000). Specifically to soccer, players’ positional variability characterises the tactical zones where they play during matches and competition (Couceiro et al., 2014) and may allow for the stratification of the behaviour of players from different skill levels (Silva et al., 2014). Thus, it is essential in such an analysis that the role of variability within the system is identified, but it is difficult to determine whether this variability is beneficial. In the current study, the variability of parameters related to tactical behaviour in soccer presents advantages and disadvantages. Low variability could indicate pattern maintenance by a team throughout a match or competition. Teams with small principal component lengths and elliptical areas could be characterised as systems not only with a high level of organisation but also with predictable behaviour, which could facilitate a precise evaluation of their performance by their opponents. High variability could signify a team’s difficulty in maintaining a set formation. On the other hand, significant changes in a team’s structure or behaviour could yield unpredictability or a higher capacity of adaptation to unexpected situations during a match or championship. From a dynamical systems perspective, variability is not inherently good or bad, but rather reflects the variety of patterns used to complete a task (Haken et al., 1985), suggesting that the system is flexible enough to search for the optimal solution (Miller et al., 2010). The manner in which principal components and their elliptical areas are distributed on the pitch can also reveal interesting visual features about tactical patterns. The Spanish and German players, for example, exhibited ellipses that were more distant from each other and that had few intersections between them. Such an outcome may indicate that the players’ positions were well defined throughout the championship, in stark contrast to those of players from Italy and Portugal. Both Italy and Portugal, in this case, displayed ellipses that overlapped regularly, which could mean that their players changed playing positions at some point or even that they played in the same position as other teammates during the competition. This type of information could be quite helpful to coaches and assistants who need to determine whether the tactics adopted or proposed were executed by their players as a training control parameter. Our results also provided the positional variability discriminated by a player position. Although previous studies (Barros et al., 2006; Couceiro et al., 2014) had reported variability analyses based on players’ positions, to the best of our knowledge, this study was the first that presented an analysis of positional variability throughout a championship. Our findings indicate that external midfielders and external defenders exhibited the greatest variability, corroborating the study of Barros and colleagues (Barros et al., 2006). Indeed, during a match, each player has a specific tactical mission and an intervention region that provides some organisation to a team’s collective dynamics. Although each player moves to support the defensive and offensive phases, the player eventually returns to his main tactical region due to his positional role (Couceiro et al., 2014). This behaviour becomes very clear when each match is submitted to variability analysis, as presented by Couceiro and colleagues using players’ planar coordinates and heat maps (Couceiro et al., 2014). However, when we consider players’ behaviour over the course of an entire championship, the tendency to return to the same region, for the external midfielders and external defenders, for example, is not as distinct. This outcome may be related to these players’ tactical roles. Once the other positions have well-defined functions (i.e., only to attack or to defend) during a match, the external defenders, for example, not only usually adopt a defensive role but also support the midfielders during attack phases (Couceiro et al., 2014). Thus, it is possible that during the championship, for some matches, these players adopted a more defensive role, whereas in other matches, they adopted a more offensive role, therefore explaining their variability. Similarly, it is important to interpret an ellipse’s shape, as shown graphically by Figure 3. An ellipse’s shape is defined by its component lengths. This parameter is related to the eccentricity of the area covered tactically by a player and is related to the ratio of the variances associated with the first and second components (Barros et al., 2006). In other words, a more “stretched” ellipse represents greater variability in one direction, whereas a more “circular” ellipse represents proportional variability in both directions. For example, a previous study (Barros et al., 2006) reported that external defenders presented lower eccentricity than players in other positions due to their main role, which essentially is to move in one direction during attacking and defending actions. This behaviour also explains why players’ trajectories are more unpredictable for one direction than for another (Couceiro et al., 2014). Thus, the ellipses of Figure 3 represent the magnitude of the positional variability and also provide information regarding how this variability occurred. The present study employed an innovative approach using broadcast data provided online during matches to quantify tactical issues in soccer. By applying an image-processing algorithm to heat maps published online by UEFA during EURO 2012, we could calculate the variability of players’ tactical patterns using PCA applied to each player’s position. PCA is a statistical method used to reduce data dimensions to represent them as components that contain the greatest amount of data set variability (Barros et al., 2006; Daffertshofer et al., 2004). However, in this study, we did not reduce the data dimensions. Instead, we used the components to represent player position variability throughout the competition. One of the advantages of this particular method is that the information describing the variability of each individual data set is maintained. Thus, the variability of a player’s position is not represented in just one external, unique and predefined coordinate system, such as the field coordinate system. The data sets generate a coordinate system from their own distribution (Barros et al., 2006). This new coordinate system is associated with the percentage of total variability explained by both principal components. From these parameters, coaches can obtain the directions of highest variability and associate them with their players’ positions. The other notable benefit of the presented method is its graphical representation of positional data. This representation is relevant to practical applications as, in addition to pattern variability, it can be related to a team’s organisation on the pitch. Additionally, it may yield intuitive ideas about the tactical systems predominantly adopted. Although we have analysed team behaviour without considering opponents’ tactical organisation, further investigations should be performed to analyse positional variability considering the interaction between teams and their adversaries. Thus, the features of space-sharing between teammates and opponents may explain why some players present greater variability than others during a given match or competition. The presented method is a viable tool that provides coaches with important information regarding soccer team’s tactical aspects during matches and even over the course of an extended competition. This tool can also be useful to coaches and assistants in preparing for future competitions as a method for evaluating and controlling their own team’s tactical behaviour as well as understanding that of their opponents.
  15 in total

1.  Sport competition as a dynamical self-organizing system.

Authors:  Tim McGarry; David I Anderson; Stephen A Wallace; Mike D Hughes; Ian M Franks
Journal:  J Sports Sci       Date:  2002-10       Impact factor: 3.337

2.  Quantitative analysis of Brazilian football players' organisation on the pitch.

Authors:  Felipe Arruda Moura; Luiz Eduardo Barreto Martins; Ricardo de Oliveira Anido; Ricardo Machado Leite de Barros; Sergio Augusto Cunha
Journal:  Sports Biomech       Date:  2012-03       Impact factor: 2.832

3.  Variability in kinematic coupling assessed by vector coding and continuous relative phase.

Authors:  Ross H Miller; Ryan Chang; Jennifer L Baird; Richard E A Van Emmerik; Joseph Hamill
Journal:  J Biomech       Date:  2010-06-11       Impact factor: 2.712

4.  Performance characteristics according to playing position in elite soccer.

Authors:  V Di Salvo; R Baron; H Tschan; F J Calderon Montero; N Bachl; F Pigozzi
Journal:  Int J Sports Med       Date:  2006-10-06       Impact factor: 3.118

5.  High-intensity running in English FA Premier League soccer matches.

Authors:  Paul S Bradley; William Sheldon; Blake Wooster; Peter Olsen; Paul Boanas; Peter Krustrup
Journal:  J Sports Sci       Date:  2009-01-15       Impact factor: 3.337

6.  Analysis of the distances covered by first division brazilian soccer players obtained with an automatic tracking method.

Authors:  Ricardo M L Barros; Milton S Misuta; Rafael P Menezes; Pascual J Figueroa; Felipe A Moura; Sergio A Cunha; Ricardo Anido; Neucimar J Leite
Journal:  J Sports Sci Med       Date:  2007-06-01       Impact factor: 2.988

Review 7.  Dynamic-system analysis of opponent relationships in collective actions in soccer.

Authors:  J F Gréhaigne; D Bouthier; B David
Journal:  J Sports Sci       Date:  1997-04       Impact factor: 3.337

8.  A spectral analysis of team dynamics and tactics in Brazilian football.

Authors:  Felipe Arruda Moura; Luiz Eduardo Barreto Martins; Ricardo O Anido; Paulo Régis C Ruffino; Ricardo M L Barros; Sergio Augusto Cunha
Journal:  J Sports Sci       Date:  2013-04-30       Impact factor: 3.337

9.  A theoretical model of phase transitions in human hand movements.

Authors:  H Haken; J A Kelso; H Bunz
Journal:  Biol Cybern       Date:  1985       Impact factor: 2.086

10.  A dynamical systems approach to lower extremity running injuries.

Authors:  J Hamill; R E van Emmerik; B C Heiderscheit; L Li
Journal:  Clin Biomech (Bristol, Avon)       Date:  1999-06       Impact factor: 2.063

View more
  8 in total

1.  Soft-assembled Multilevel Dynamics of Tactical Behaviors in Soccer.

Authors:  Angel Ric; Carlota Torrents; Bruno Gonçalves; Jaime Sampaio; Robert Hristovski
Journal:  Front Psychol       Date:  2016-10-05

2.  Changes in Effective Playing Space when Considering Sub-Groups of 3 to 10 Players in Professional Soccer Matches.

Authors:  Bruno Gonçalves; Hugo Folgado; Diogo Coutinho; Rui Marcelino; Del Wong; Nuno Leite; Jaime Sampaio
Journal:  J Hum Kinet       Date:  2018-06-13       Impact factor: 2.193

3.  Trends of Goal Scoring Patterns in Soccer: A Retrospective Analysis of Five Successive FIFA World Cup Tournaments.

Authors:  Alliance Kubayi; Abel Toriola
Journal:  J Hum Kinet       Date:  2019-10-18       Impact factor: 2.193

4.  Analysis of the Variability of the Game Space in High Performance Football: Implementation of the Generalizability Theory.

Authors:  Rubén Maneiro; Ángel Blanco-Villaseñor; Mario Amatria
Journal:  Front Psychol       Date:  2020-03-25

5.  Match Analysis of Soccer Refereeing Using Spatiotemporal Data: A Case Study.

Authors:  Bruno Gonçalves; Diogo Coutinho; Bruno Travassos; João Brito; Pedro Figueiredo
Journal:  Sensors (Basel)       Date:  2021-04-05       Impact factor: 3.576

6.  A Systematic Review of Methods and Criteria Standard Proposal for the Use of Principal Component Analysis in Team's Sports Science.

Authors:  Daniel Rojas-Valverde; José Pino-Ortega; Carlos D Gómez-Carmona; Markel Rico-González
Journal:  Int J Environ Res Public Health       Date:  2020-11-24       Impact factor: 3.390

7.  Effects of the Pitch Surface on Displacement of Youth Players During Soccer Match-Play.

Authors:  Ângelo Brito; Paulo Roriz; Pedro Silva; Ricardo Duarte; Júlio Garganta
Journal:  J Hum Kinet       Date:  2018-12-31       Impact factor: 2.193

Review 8.  Training Design, Performance Analysis, and Talent Identification-A Systematic Review about the Most Relevant Variables through the Principal Component Analysis in Soccer, Basketball, and Rugby.

Authors:  José Pino-Ortega; Daniel Rojas-Valverde; Carlos D Gómez-Carmona; Markel Rico-González
Journal:  Int J Environ Res Public Health       Date:  2021-03-05       Impact factor: 3.390

  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.