Cross-Cultural Validation of the Inventory of School Motivation (ISM) in the Asian Setting: Hong Kong and the Philippines.

Students' achievement goals in school have received increasing research attention because they have been shown to be important in predicting important outcomes. As such, there has been a growing interest in measuring and comparing them across different cultural groups. However, these comparisons cannot be made until validity evidence has been attained to support the use of an instrument in the new cultural setting. In this study, we investigated the cross-cultural applicability of the Inventory of School Motivation (ISM, McInerney et al. American Educational Research Journal 34:207-236, 1997) in the Hong Kong Chinese and Philippine contexts using both within-network and between-network approaches to construct validation. The ISM measures four types of achievement goals: mastery, performance, social, and extrinsic goals. 1,406 high school students from Hong Kong (n = 697) and the Philippines (n = 709) participated. Results of the within-network test showed that the ISM had good internal consistency reliability and the confirmatory factor analysis provided support for the hypothesized four-factor model. Multigroup confirmatory factor analyses supported invariance of factor loadings across the two samples. The between-network test also indicated that these achievement goals correlated systematically with different aspects of students' self-concepts. These findings support the applicability of the ISM among Hong Kong Chinese and Filipino students.

Introduction

Students attend school driven by different kinds of goals. Some students go to school with the goal of developing their skills and competence, some with the intention of outperforming others and demonstrating their smartness, others with the end of just being with their friends and peers, and still others to get some sort of reward for their effort. Within the confine of the classrooms, the extent of students’ academic engagement and well-being is assumed to be heavily influenced by their goals in school (see Maehr and Zusho 2009 for a review). This underscores the central role played by students’ achievement goals, which are defined as the reasons for students’ engagement and/or non-engagement in academic-related tasks (Pintrich 2000).

Research on achievement goals has proven generative in educational psychology leading to well over 1,000 published studies and dissertations in the past 25 years since its inception (Hulleman et al. 2010). Achievement goals have been shown to predict both achievement-related and well-being outcomes (Dweck and Legett 1988; Elliot et al. 1999; Kaplan and Maehr 1999; Lau et al. 2008; McGregor and Elliot 2002; McInerney 2008; Sideridis 2005). More specifically, achievement goals have been linked to outcomes such as self-esteem (e.g. Robins and Pals 2002), general well-being (e.g. Dykman 1998; Kaplan and Maehr 1999; Sideridis 2005; Tuominen-Soini et al. 2008), socio-emotional functioning (e.g. Roeser et al. 2002) learning strategies (e.g. Wolters 2004), self-regulated learning (e.g. Pintrich 2000), grades (e.g. Elliot and Murayama 2008), emotions in school (e.g. Pekrun et al. 2006, 2009), self-related beliefs (e.g. Pajares et al. 2000) and other valued educational outcomes (see Elliot 2005 for a review). Despite this productivity, a limitation of achievement goal research is that it only focuses on two types of goals: usually mastery and performance goals. Students with mastery goals want to develop their competence and improve their skill, whereas students with performance goals want to demonstrate their competence before other people and focus on outperforming others (Elliot 2005). Although more recent theorizing on achievement goals has bifurcated the mastery-performance dichotomy into their approach-avoidance dimensions, the central focus of this line of inquiry remains to be these two goals. A focus on these two types of goals seems limiting however when investigating the motivation of students from different cultural settings. Mastery and performance goals have a strong individualist flavor as both give priority to the goals of the individual student with little attention paid to more socially oriented types of goals which are more salient for students from collectivist settings (Tao 2003; Tao and Hong 2000; Watkins et al. 2002a, b). Cross-cultural researchers have noted that other types of goals such as extrinsic goals which entails studying in order to get social recognition and to get material rewards from adults and social goals which focus on achieving for the sake of others are also salient in motivating students from various cultural settings (Dowson and McInerney 2001, 2003, 2004; Salili 1994, 1995; Salili et al. 2001). Kumar and Maehr (2007, p.54) asserted that among students from collectivist cultures, “the motivational goals promoting achievement behavior are extrinsic, utilitarian, and social. They are directed toward achieving upward mobility, recognizing parental sacrifices, fulfilling familial obligations of achieving success, and making the family proud—particularly in social comparisons with other families. Achievement and the motives to achieve are, therefore, more social and less individual in collectivistic societies that endorse interdependent selves.” Therefore, aside from examining mastery and performance goals, it also seems imperative to assess other types of goals such as social goals and extrinsic goals especially for students from collectivist cultures.

Personal investment theory was designed as an extension of achievement goal theory to specifically address the limitations discussed above (see Maehr and McInerney 2004; McInerney and Liem 2009 for reviews). From its inception, personal investment theory was developed to be a cross-culturally relevant model of students’ achievement goals. In this model, four types of goals are proposed to be important in understanding student motivation in school: mastery goals, performance goals, social goals, and extrinsic goals. Each of these goals, in turn, is comprised of two facets (See Table 1).

Table 1

Four types of achievement goals in personal investment theory

Achievement goal	Facet	Definition	Sample items
1. Mastery goals	Task involvement	interest in the task	“The more interesting the schoolwork the harder I try.”
	Effort	willingness to expend effort for schoolwork	“I always try hard to understand something new in my schoolwork.”
2. Performance goals	Competition	competitiveness in learning	“I like to compete with others in school.”
	Social power	seeking status through group leadership	“I like being in charge of a group.”
3. Social goals	Affiliation	belonging to a group when doing schoolwork	“I can do my best work at school when I work with others.”
	Concern	concern for other students	“I like helping other students with their schoolwork.”
4. Extrinsic goals	Token	seeking tangible rewards for schoolwork	“Getting a reward for my good schoolwork is important to me.”
	Praise	seeking social recognition for schoolwork	“I work best when I am praised in school.”

In line with this, the Inventory of School Motivation (ISM) was then developed to assess the constructs salient to this model (McInerney et al. 1997). It is a 43-item instrument that measures four types of achievement goals: mastery (task and effort), performance (competition and social power), social (affiliation and social concern), and extrinsic goals (praise and token)1. Although there is a preponderance of achievement goal measures in the literature (e.g. Elliot and Murayama 2008; Midgley et al. 2000), most of these instruments have been created in the Western context. To the best of the authors’ knowledge, only the Inventory of School Motivation (ISM) was specifically developed to look at achievement goals in cross-cultural settings. The ISM incorporates scales that are relevant to examining students’ motivation in different cultural contexts (McInerney et al. 2005; 2001; 2003). Research using the ISM has also found consistent relationships between these four types of achievement goals and other valued educational outcomes (Watkins, McInerney, and Boholst 2003; Watkins et al. 2002a, b). For example, the mastery goals scale in the ISM are strongly positively correlated with deep and achieving learning strategies, and negatively correlated with surface strategies. Performance goals and social goals were also positively correlated with deep and achieving learning strategies. Extrinsic goals were positively associated with the surface learning strategies (see McInerney and Liem 2009 for a review). McInerney (2008) found that mastery goals were positively associated with well-being in school, while performance, social, and extrinsic goals were not significantly associated with well-being. Mastery goals were also the strongest predictors of educational outcomes such as grades, intention for further schooling, and valuing for school, while the other types of goals such as performance, social, and extrinsic goals were weaker predictors of these outcomes. In an earlier study, McInerney and Sinclair (1991) showed that mastery goals were the strongest predictors of intention to complete high school education among Aboriginal, migrant, and Anglo Australians. Although performance, social, and extrinsic goals were also positive predictors, their effects were weaker and less consistent.

The ISM has been used in Australia involving Aboriginal, Anglo, and migrant-background students (McInerney 2008; McInerney and Sinclair 1991); the United States, involving Navajo and Anglo-American students (McInerney et al. 2001); South Africa, involving both Black and White students (Watkins, McInerney, Akande et al. 2003) and also students from other African countries such as Malawi and Zambia (Watkins et al. 2002a). However, there is still a dearth of studies with regard to the psychometric properties of this instrument in the Asian setting (see Watkins, McInerney, and Boholst 2003 for an exception). Maneesriwongul and Dixon (2004, p. 175) noted that, “Research instruments must be reliable and valid in each culture studied.” A further danger inherent in using a psychometric approach in cross-cultural settings is that an assumption may be made by researchers that items and constructs developed and standardized on one particular cultural group are broadly universal when in fact there is no attempt made to demonstrate the applicability of the constructs or instruments used to new groups (see McInerney et al. 2001). It is becoming increasingly clear that the methodological and conceptual difficulties involved in capturing behaviors, attitudes and values in cross-cultural studies have been discussed in a lot of studies (van de Vijver and Hambleton 1996; van de Vijver and Poortinga 1982). In response to this observation, it is important that the issue of validity is addressed before the results of such psychological tests with different cultures can be interpreted (Hambleton 2001; van de Vijver and Tanzer 2004). The cross-cultural applicability of the ISM still needs further exploration especially when administered to Asian students. Therefore, in this study, we explored the cross-cultural validity of the ISM in the Chinese and Filipino settings.

Approaches to Construct Validation

The present study adopts a construct validation approach (Marsh 1997; Martin 2007) to the empirical assessment of the cross-cultural applicability of the ISM in the Hong Kong Chinese and Filipino settings. Studies that adopt this approach can be classified as within-network or between-network studies. Within-network construct validation, also called internal construct validation refers to the examination of the factor structure and factor correlation matrix. On the other hand, between-network or external construct validation approach entails examining patterns of relationships between the scales and other theoretically related constructs. The present study uses both approaches. First, we conducted a within-network study using confirmatory factor analysis to test the four factor structure of the ISM separately in the two contexts followed by multigroup confirmatory factor analysis to assess the invariance of the instrument across the two cultures. Consistent with the construct validation approach, it is not only important to address validity within an instrument (within-network validity) but it is also imperative to explore the possible differential relationships between the four types of goals and a set of theoretically relevant measures (between-network validity). In our study, we assessed how the factors in the ISM are related to different aspects of a students’ self concept. We expect that these four types of achievement goals will be positively correlated with positive self-concept and negatively correlated with negative self-concept. Positive self-concept refers to positive cognitions about one’s ability in school, while negative self-concept refers to negative beliefs about one’s ability in school (McInerney 2008). Many studies have shown that self-concept is related to the achievement goals that one adopts (Liem et al. 2008; Pajares et al. 2000; Wolters 2004). Although these studies mostly focused on the relationship of self-related constructs to mastery and performance goals, it is reasonable to assume that the four types of achievement goals (mastery, performance, social, and extrinsic) will all be positively related to positive self-concept and negatively related to negative self-concept given that these four achievement goals have been shown to be adaptive in collectivist societies (e.g. Cheng 2005; Kumar and Maehr 2007; Tao 2003; Tao and Hong 2000) and have been found to be related to other positive outcome measures (McInerney 2008; Watkins, McInerney, and Boholst 2003).

The Current Study

This paper adopts both within-network and between-network construct validation approaches to assess the applicability of the ISM in the Chinese and Filipino settings. More specifically, this paper aims to investigate (a) the extent to which the four-factor structure of the ISM which has been found in previous research will be replicated in a Chinese and a Filipino sample, (b) how the interpretations of the different factors of the ISM are different and similar across these two samples, and (c) how the four achievement goals are related to the positive and negative aspects of students’ self-concepts in both contexts.

Method

Participants

Convenience sampling method was used in this study. The Hong Kong Chinese sample consisted of 697 high school students (M age = 13.43 years, SD = 1.37 years, median = 14 years). The sample consisted of 356 women (51.07%) and 341 men (48.92). Of these 241 were from a high-ability school, 230 from a medium-ability school, and 226 were from a low ability school2. The Filipino sample, on the other hand, consisted of 709 high school adolescent students (M age = 14.56 years, SD = 0.89 years, median age = 14 years) of which there were 195 males (27.50%) and 514 (72.49%) females. The Filipino students were approximately equally distributed between those from private schools and public schools3. Taken together, there were 1,406 adolescent high school students which comprised the participants of this study.

Procedure

Students were required to complete the inventory as part of the class requirement. They were assured that their responses would remain confidential and would not, in any way, influence their course grade. The measures described below were completed by students from both contexts.

Measures

In this study, we utilized the Chinese version (Watkins et al. 2002a) and Filipino version (Ganotice et al. 2010) of the Inventory of School Motivation for the Hong Kong and Filipino students respectively. It is rated on a 5-point Likert scale with 1 as “strongly disagree” and 5 as “strongly agree.” Higher scores would entail a greater endorsement of the relevant construct. Table 2 contains sample Chinese and Filipino items for each of the constructs.

Table 2

Sample items for the Chinese and Filipino versions of the ISM

Achievement goals	English version	Sample item (Chinese)	Sample item (Filipino)
Mastery Goals	I like being given the chance to do something again to make it better.	我希望被给予机会去重做某些事情以将其改善.	Gusto kong mabigyan ng pagkakataon na gawing muli ang isang bagay nang mas magaling.
Performance Goals	Winning is important to me.	获得胜利对我来说是重要的.	Ang magtagumpay ay importante sa akin.
Social Goals	It is very important for students to help each other at school.	在学校,同学们互相帮助是非常重要的.	Napaka-importante para sa mga estudyante na mag tulungan ang bawat isa sa paaralan.
Extrinsic Goals	Praise from my teachers for my good schoolwork is important to me.	我重视老师对我良好学业表现的赞赏.	Ang mga papuri mula sa aking mga guro tungkol sa aking mabuting schoolwork ay importante sa akin.

Aside from the ISM, we also administered the positive and negative self-concept subscales of the Sense of Self (SoS) Scale. We administered the Chinese version (Watkins et al. 2002a) to the Hong Kong students and the Filipino version (Ganotice and Bernardo 2010) to the Filipino students. Positive self-concept measures the students’ positive cognitions about general academic ability in the school setting (e.g. “I can succeed at whatever I do in school.”) while negative self-concept measures negative cognitions about general academic ability at school (e.g. “I often make mistakes at school.”). Reliabilities for these scales were generally acceptable. For the HK sample, the Cronbach’s alpha for negative self-concept was .58 and .70 for positive self-concept. For the Filipino sample, the alpha for the negative self-concept was .80 and .75 for the positive self-concept.

Results

Preliminary Analysis

Preliminary analysis was performed to check the properties of data. No outliers were found. Tables 3 and 4 present descriptive statistics and internal consistency coefficients for the different subscales in the ISM in the two cultural contexts. Cronbach’s alpha coefficients were calculated for each of the scales for the data on English and Filipino versions. Reliability estimates were all acceptable and varied from .70 to .83 for the Hong Kong data .72 to .84 for the Philippine data.

Table 3

Descriptive statistics and internal consistency coefficients for the Hong Kong sample (N = 697)

	Mean	SD	Cronbach’s alpha
1. Mastery goals	3.72	.45	.74
2. Performance goals	3.01	.57	.82
3. Social goals	3.53	.48	.73
4. Extrinsic goals	3.09	.57	.83

Table 4

Descriptive statistics and internal consistency coefficients for the Philippine sample (N = 709)

	Mean	SD	Cronbach’s alpha
1. Mastery goals	3.34	.39	.72
2. Performance goals	3.89	.30	.78
3. Social goals	3.07	.52	.73
4. Extrinsic goals	2.90	.60	.84

Confirmatory Factor Analysis (CFA)

Normality was assessed by examining skewness and kurtosis values for each item. Absolute values of skewness and kurtosis beyond 2 and 7, respectively, may imply a lack of univariate normality (Finney and DiStefano 2006). For the HK data, skewness values ranged from -.64 to .23; while kurtosis values ranged from -.07 to 1.04. For the Philippine sample, skewness ranged from .19 to .98, while kurtosis ranged from -.56 to 1.31. Skewness and kurtosis values for the two samples did not exceed the recommended values.

We also checked for outliers by looking at the Mahalanobis distance (D2). Values that stand distinctively apart from other values can be considered outliers. No such outliers were found for both the Hong Kong and Philippine samples. Given that the data appear normally distributed, maximum likelihood (ML) estimation was employed to estimate model parameters and fit indices.

Two separate CFAs were first conducted, one for the Hong Kong sample and the other for the Filipino sample. All the calculations were done using AMOS 16.0 (Arbuckle 2007) The CFA procedure was used to assess the extent to which the observed data reflected or fit the proposed four-factor model or structure of the 43-item ISM. Bagozzi and Heatherton (1994) suggested that it is quite likely that having more than five indicators per factor in a large sample would to lead to an unsatisfactory fit in the measurement model. To address this issue, we aggregated the items to form item “parcels” as indicators in the CFA. A parcel is defined as an aggregate-level indicator comprised of the sum or average of two or more items, responses, or behaviors. To create the parcels, we randomly assigned each item in a factor to one parcel grouping. Random assignment of two to four items to parcels should, on average, lead to parcels that contain roughly equal common factor variance (Little et al. 2002). This method of parceling was recommended by Little et al. (2002) when all items are answered on the same metric and when items can be considered unidimensional (for example, as verified through previous studies involving exploratory factor analysis). Given that all the items in the ISM were answered using a 5-point Likert scale and that previous studies have identified its four-factor structure (e.g. McInerney and Ali 2006), we decided to use random assignment of parcels. Using parcels is believed to increase the reliabilities of the indicator variables, and reduces the likelihood that parameters will be affected by item-specific variance (Lance et al. 1991). Moreover, the distribution of the parcels are more likely to approximate a normal distribution better than the distribution of individual items, and the results based on parcels are more likely to be stable (i.e. generalizable) across samples (West et al. 1995). Eleven parcels were created from the 43 items of the Inventory of School Motivation. There were three to four randomly assigned items for each parcel, with the average of the items being used as the parcel score.

Several goodness-of-fit indices were used to determining the model fit, based on the understanding that multiple indices provided a comprehensive evaluation of model fit (Hu and Bentler 1995, 1999). The following fit indices used were: the chi-square (χ 2), ratio of chi-square values to the degrees of freedom (χ 2/df); root mean square error of approximation (RMSEA), goodness of fit index (GFI), comparative fit index (CFI), normed fit index (NFI), incremental fit index (IFI), Tucker-Lewis Index (TLI), and the comparative fit index (CFI). The criterion values were set based on the prescriptions summarized in Schermelleh-Engel et al. (2003; see also Bentler 1990). The chi square statistic should be non-significant. For RMSEA, values less than.08 indicate acceptable fit. GFI, NFI, IFI, TLI, and CFI values higher than .90 shows acceptable fit. The fit indices for the CFAs for the two language version data are shown in Table 5.

Table 5

Summary of the goodness-of-fit statistics

Model	χ 2	df	χ 2 /df	p	RMSEA	GFI	NFI	IFI	TLI	CFI
Hong Kong	201.333	38	5.298	p < .001	.079	.950	.936	.948	.924	.947
Philippines	170.551	38	4.488	p < .001	.070	.953	.949	.960	.942	.960

χ chi-square, df degrees of freedom; χ /df chisquare to degrees of freedom ratio; RMSEA root mean square error of approximation; NFI normed fit index; IFI incremental fix index; TLI Tucker-Lewis index; CFI comparative fit index

Results of the separate confirmatory factor analysis for the Hong Kong and the Philippine samples indicated a good fit. GFI, NFI, IFI, TLI, and CFI were all above .90, while RMSEA was below .084. Only the chi square statistic was not satisfactory in the CFA (See Table 5). A statistically non-significant chi square value indicates that the model is a reasonably satisfactory representation of the data. However, as noted by Anderson and Gerbing (1988), the value of the chi-square statistic is dependent on sample size. As such, data that involve a large sample size will likely have a chi-square statistic that is significant although there are only minor discrepancies between the model and the data. Because of this, we decided to focus on the other goodness of fit indices which all indicate a good fit. The results showed good fit indices for both the Chinese and Filipino versions. The results of the CFA shows strong support for the four-factor structure of both the Chinese and Filipino versions of ISM (see Figs. 1 and 2).

Fig. 1

Confirmatory factor analysis of the 11 parcels of the Chinese version of the Inventory of School Motivation (ISM) with 4 factors. Inter-factorial correlations and factor loadings indicated are all significantly different from zero at p < .001 Note: Mast = mastery goals, Perf = performance goals, Soc = social goals, Ext = extrinsic goals, P = parcel, d = error or disturbance

Fig. 2

Confirmatory factor analysis of the 11 parcels of the Filipino version of the Inventory of School Motivation (ISM) with 4 factors. Inter-factorial correlations and factor loadings indicated that they are all significantly different from zero at p < .001 Note: Mast = mastery goals, Perf = performance goals, Soc = social goals, Ext = extrinsic, P = parcel, d = error or disturbance

Multigroup Confirmatory Factor Analysis Results

To test for the invariance of the ISM across the two cultural contexts, we followed a stepwise procedure. For the first model, we tested for configural invariance which indicates whether the number of factors and pattern of indicator-factor loadings is identical. The second model holds the factor loadings invariant, the third model holds both factor loadings and factor variances and covariances invariant. Although the chi-square difference test has traditionally been used in multigroup CFA to test between competing models, Cheung and Rensvold (2002) argued that from an applied perspective this may be overly restrictive. They indicated that a decrease of 0.01 in the CFI is evidence for lack of invariance. Following this suggestion, the results show that there is invariance of factor loadings for the Hong Kong and Filipino samples (See Table 6). However, there was no evidence of structural invariance. It appears that the relationships among the latent factors were not similar in the two cultural settings.

Table 6

Invariance testing across Hong Kong Chinese and Filipino students

Model	χ 2	df	χ 2 /df	p	RMSEA	GFI	NFI	IFI	TLI	CFI	Change in CFI
1. Configural invariance	371.885	76	4.893	p < .001	.053	.953	.943	.954	.933	.954
2. Invariant factor loadings	407.325	83	4.908	p < .001	.053	.949	.938	.950	.933	.949	.005
3. Invariant factor variances and covariances	506.149	93	5.442	p < .001	.056	.937	.922	.936	.924	.936	.013

χ chi-square, df degrees of freedom; χ /df chisquare to degrees of freedom ratio; RMSEA root mean square error of approximation; NFI normed fit index; IFI incremental fix index; TLI Tucker-Lewis index; CFI comparative fit index

Between-Network Construct Validity Results

To assess between-network validity, we examined the relationship of the ISM scales to positive and negative self-concept. It is assumed that the four types of achievement goals will be positively correlated to students’ positive self-concept and negatively correlated with negative self-concept. Results of the bivariate correlations generally supported this assumption.

Results of the between-network construct validation indicate a generally similar pattern of relationships between students’ self-concepts and the four types of motivational goals (See Tables 7 and 8). Broadly speaking, the four types of achievement goals were positively correlated with positive self-concept and negatively correlated with negative self-concept. However, there was a slight difference with regard to the relationship between performance goals and negative self-concept. The relationship was not significant in the HK sample but significant in the Philippine sample. Extrinsic goals were negatively correlated to negative self-concept in the Philippine sample but not in the HK sample.

Table 7

Zero-order correlations among the ISM goals and students’ self-concepts in the Hong Kong sample

	Positive self-concept	Negative self-concept
1. Mastery goals	.306***	−.162***
2. Performance goals	.274***	.067
3. Social goals	.252***	−.195***
4. Extrinsic goals	.218***	.090

***p < .001

Table 8

Zero-order correlations among the ISM goals and students’ self-concepts in the Philippine sample

	Positive self-concept	Negative self-concept
1. Mastery goals	.387***	−.396***
2. Performance goals	.430***	−.369***
3. Social goals	.364***	−.384***
4. Extrinsic goals	.394***	−.326***

***p < .001

Discussion

The central objective of this inquiry was to examine the cross-cultural validity of the ISM in the Chinese and Filipino contexts using both within-network and between-network construct validation approaches. Overall, results supported the validity of this instrument in the two cultural contexts.

For the within-network test, we focused on the Cronbach’s alpha reliabilities and the separate CFA results of the ISM in the two cultural settings. The Cronbach’s alpha reliabilities for the ISM subscales in the Hong Kong setting were acceptable ranging from .73 to .83. For the Philippine sample the reliabilities ranged from .72 to .84. These values are generally similar to what has been reported previously in the literature when ISM was used with different cultural groups such as Australian, Aboriginal Australian, Anglo-American, and American Indian students (see McInerney and Ali 2006 for a summary). With regard to the separate CFAs, the data confirmed a good fit of the four-factor achievement goal model in both the Hong Kong and Philippine samples. The four-factor structure of achievement goals posited in Maehr and McInerney’s (2004) personal investment theory was replicated in these two samples. Mastery goals, performance goals, extrinsic goals, and social goals represent distinct but inter-related constructs. The RMSEAs were lower than the cutoff of .08 for an adequate model (RMSEAs = .079 and .070 in Hong Kong and the Philippines respectively). In addition, the GFI, IFI, TLI, and CFI were all above .90 in both samples.

The replication of the four-factor structure of achievement goals in our study is important because most of the achievement goal measures in the literature (e.g. Elliot and Church 1997; Elliot and Murayama 2008; Midgley et al. 2000) only focus on mastery and performance goals although more recent scales have included the approach and avoidance dimensions of these two goals. However, mastery and performance goals even including their approach avoidance dimensions still give too much priority to the goals of the individual. Extrinsic goals such as studying in order to get social recognition and material rewards from adults and social goals which focus on enhancing a sense of membership to the group have been found to be especially salient in collectivist settings (Bernardo 2008; Bernardo et al. 2008; Chang and Wong 2008; Yu and Yang 1994). Therefore, aside from examining mastery and performance goals, it also seems imperative to assess other types of goals such as social goals and extrinsic goals especially for students from collectivist cultures. Social goals and extrinsic goals are also important facets of student motivation thus a fuller picture can be captured if the ISM were used because it can measure a wider range of goals compared to that normally investigated within achievement goal theory. An argument that frequently comes up with the use of a more complex perspective like personal investment theory and the use of the lengthier ISM is that it sacrifices parsimony and researchers wonder whether such a sacrifice is justified. McInerney and Liem (2009, p. 230) in their debate with more traditional achievement goal theorists wrote, “Effectively PI theory is far more complex than goal theory, but life and motivated behaviours are complex and should not be reduced to simple dimensions.” They argue further that in cross-cultural settings, personal investment theory offers a “potentially, a far richer and more sensitive source of information on the motivational determinants of achievement behaviour. Particularly…in socioculturally diverse settings.” It seems that ISM has an advantage over other achievement goal measures in that it can also capture social and extrinsic goals while at the same time taking into account mastery and performance goals which have been the focus of most achievement goal theorists. Such an approach offers a more nuanced perspective on student motivation. Studies using the ISM have supported the benefits of using this instrument. For example, researchers have acknowledged that social goals are also important factors to consider in examining student motivation. However, to date, there is still a dearth of knowledge with regard to how social goals influence important academic outcomes (Urdan and Maehr 1995). Studies using the ISM in diverse cultural settings has shown that social goals are also related to positive learning outcomes such as deep learning strategies (Watkins et al. 2002a, b).

Eccles et al. (1998) claimed that “categorizing children’s goals as ego (performance) or task involved (mastery) oversimplifies the complexity of motivation” (p. 1032). In addition, Maehr (1984) argued that although gaining (i.e. mastery goals) and demonstrating academic competence (i.e. performance goals) may be of concern to all individuals some of the time, it is not necessarily the central concern in any given setting or time. He argued that “other goals, other intentions, other attractions, continually intrude” (p. 116). The ISM offers a viable alternative to the other achievement goal measures in the literature that only focus on mastery and performance goals.

Through the multigroup CFA, we found evidence of configural invariance and weak measurement invariance. Configural invariance refers to the invariance of the model configuration, i.e. the pattern of free and fixed model parameters. Weak measurement invariance means that the factor loadings were equivalent in the two cultural contexts. We did not find structural invariance or invariance of factor variances and covariances. The correlations among the four goals were different for Hong Kong Chinese and Filipino students. In most cases, weak measurement invariance is the minimum requirement for making cross-group comparisons. The differences in terms of the correlations among the four factors might be due to cultural differences, which can manifest themselves in the form of different correlations between psychological constructs. However, a look at the fit indices when the factor variances and covariances are constrained still indicate a relatively good fit. The RMSEA is below the cutoff point of .08, while the GFI, NFI, IFI, TLI, and CFI are well above .90. Clearly, additional research is needed in order to uncover the relationships among the different types of goals in various cultural contexts.

One of the interesting findings to come from this investigation is the positive correlation among the four types of achievement goals. That is, mastery goals, performance goals, social goals, and extrinsic goals were all positively correlated to each other which corroborated the observation and/or research findings on achievement goals involving Asian students (see Bernardo 2003, 2008; Chan and Lai 2007; Chang and Wong 2008; Tao and Hong 2000). It seems that these distinct types of goals are more positively correlated with each other among non-Western students. Among Western students, we would expect the correlations among these four types of goals to be weaker or to be non-significant as evidenced in previous studies (Elliot and Murayama 2008; Miller et al. 1996; Urdan 1994). Western constructs of achievement goals and learning approaches may not function in the same direction or generate the same effects in non-Western students due to differences in culture (Ho and Hau 2008). Early studies within achievement goal theory have found that the scores of Western students on mastery goals and performance goals are negatively correlated with each other. Results of the between-network construct validity indicate that the four achievement goals were related to students’ self-concepts. It seems that these four achievement goals are positively related to a student’s positive self-concept. Students with a healthy sense of self in school are also more likely to pursue the different types of achievement goals. On the other hand, negative self-concept was generally negatively related to these achievement goals although performance goals and extrinsic goals were not significantly related to negative self-concept in the Hong Kong sample. It appears that for students with a negative self-concept are less likely to endorse these achievement goals in school. The difference in performance goals and extrinsic goals in the Hong Kong and Filipino samples deserves more research.

Limitations and Future Directions

A limitation of this study was that we only had positive and negative self-concept as measures in the between-network validity study. Future studies could widen the range of theoretically relevant constructs examined by investigating the relationship of these four types of achievement goals with other outcomes such as well-being in school (Dykman 1998; Kaplan and Maehr 1999; Sideridis 2005), academic achievement (e.g. Elliot and Murayama 2008), academic emotions (e.g. Pekrun et al. 2006, 2009, 2007), and self-esteem (e.g. Robins and Pals 2002). Furthermore, only Hong Kong students were examined in the Chinese context. This limits the generalizability of our results for the Chinese sample. Future studies could sample a wider range of Chinese high school students by including students from other places such as Mainland China, Taiwan, and Macau. With regard to the Filipino sample, we only sampled students from the Metro Manila area, which may limit the generalizability of our findings for the Philippines. Future studies could draw from a more heterogenous sample of students.

There may also be sampling biases involved given the larger proportion of females in the Filipino sample. However, previous studies have shown that gender differences in motivational variables are usually minimal. In addition, gender differences usually have more impact in terms of mean level differences and not on the factor structure (e.g. Martin 2007).

Conclusion

Students’ achievement goals are considered crucial to understanding motivation and well-being in the classroom. However, most of the instruments used to measure achievement goals have been developed in the West and have not been validated in the new cultural contexts where they are used. Such an approach may render the results of these studies somewhat ambiguous. Thus, it is necessary to first validate an instrument when it is to be used in a new setting. This study supported the cross-cultural validity of the ISM among Hong Kong Chinese and Filipino adolescent high school students. Chinese and Filipino researchers may now use the validated measure in their quest to explore the role of achievement goals in students’ academic-related and non-academic outcomes and towards the attainment of improved performance and well-being. Together, the analyses suggest rich implications for guidance counselors and classrooms teachers as well. School psychologists and guidance counselors, with the use of the instrument, may be able to profile the achievement goals of the students. The general picture of students’ achievement goals can be used to support the development of students’ adaptive achievement goals as they face the challenges of schooling. Further, on the part of the classroom teachers, they can work with school/educational psychologists and counselors in thinking of teaching strategies that are supportive of adaptive achievement goals. As a final note, we hope that this study represents an important step in adapting a foreign-made instrument in the study of school motivation in Asian context in particular. With the increasing interest in cross-cultural research, the challenge to produce psychometrically and psychologically sound instrument for another cultural group almost requires more effort than a literal translation (van de Vijver and Hambleton 1996). We hope the Chinese and Filipino versions of the ISM works to the direction of that challenge.