Evaluation of Sustainability Information Disclosure Based on Entropy.

Disclosure of sustainability information is important for stockholders and governments. In order to evaluate the quality of sustainability information disclosure in heavily polluting industries, the quality of the disclosure is proposed to be evaluated from completeness, adequacy, relevance, reliability, normativeness and clarity aspects. The corresponding evaluation indicator system is constructed. Due to the ambiguity and complexity of the evaluation information, the intuitionistic fuzzy sets are applied to model the linguistic ratings. Entropy is used to derive the weight of experts, the object weight and the subject weight of the indicators. which are integrated when dealing with the evaluation information. The quality of sustainability information disclosure of seven representative companies in heavily polluting industries is evaluated. The importance of indicators and ranking of the companies are derived. Based on the evaluation results, the discussion and suggestions are also provided.

1. Introduction

In recent years, the sustainability has attracted a significant attention [1,2,3]. Sustainability information is used more and more in different stakeholders’ decisions [4]. Companies are advised to voluntarily disclose matters regarding their sustainability. The disclosure improves the accountability and transparency of companies’ operations and make the investors’ valuation proper [5]. More and more companies have begun to pay attention to their sustainability information disclosure [6,7,8,9,10,11]. For heavily polluting industries, its environmental impact, employees’ occupational health plans, and product safety issues are part of sustainability information. Therefore, the quality of sustainability information disclosure in heavily polluting industries are more concerned.

Since the disclosure of sustainability information is not compulsive, the quality of disclosed sustainability information is various [12,13,14]. High quality disclosure indicates that enterprises are willing to shoulder social responsibilities and establish a good corporate image. It will help attract investment, improve risk management ability, and enhance enterprise management performance [6]. The quality of the disclosure of sustainability information needs to be evaluated. Using the evaluation results, the stakeholder can comprehensively and directly understand the sustainability of the company. Meanwhile, it is also the valuable reference for the improvement of disclosure of sustainability information.

Researches have been put on the quality of sustainability information disclosure. Most focus on the impact of company or industry characteristics on the quality of sustainability information disclosure. For example, Brammer and Pavelin studied the impact of the nature of business activities, the environmental performance, firm size, company ownership etc. on the quality of corporate environmental information disclosure [6]; Orazalin and Mahmood used the largest oil and gas company in Russia as a sample to study the potential impacts of sustainability information quality [7]; Martínez-Ferrero et al., reveals the effect of financial reporting quality on sustainability information disclosure [9]. Michelon & Parbonetti examine the relationship of board composition, leadership and structure on sustainability disclosure [10]. Cuadrado-Ballesteros et al. study the relationship between the media pressure and the disclosure of sustainability information [11]. Dilling studies the characteristics of corporations that impact the quality of sustainability reports [15].

The research on the evaluation of quality of disclosures is relatively few. For example, Romolini et al., used inductive methods to measure the quality of disclosures in sustainability reports by assessing current disclosures of Global Reporting Initiative (GRI) indicators [13]; Manes-Rossi et al., selected 50 European companies to assess their disclosure levels by studying compliance with their annual reports and comprehensive reports on EUG [14]. The evaluations in these researches are based on the compliance of case companies to relevant indicators. It only evaluates from the integrity and standardization aspects, which are not complete. In fact, there are many other indicators to be paid attention to. For example, the accordance with relevant indicators can only reflects whether corresponding contents are disclosed. The degree of detail of the disclosure cannot be reflected. Obviously, different level of detail of the disclosure will lead to significant differences in the quality of the disclosure of sustainability information. But the in previous methods, it cannot be reflected. Moreover, the evaluation is performed by one or two persons [13,14]. As very few people participated in the evaluation, there is probably bias in the judgement due to limited levels of expertise. Aggregating the opinions of multiple experts will ease the bias of a single person to the greatest extent and make the evaluation more objective.

In order to resolve the problem, this paper proposed the approach to evaluating the quality of sustainability information disclosure. With the proposed method, the quality of the disclosure can be evaluated directly and more comprehensively.

Firstly, aspects of the evaluation are determined, which guides the construction of the indicator system. It focuses more on the quality of information disclosure. Then the corresponding indicators tied to sustainability for the evaluation of quality of sustainability information disclosure is derived. It is fully considered that the contents of the evaluation are sustainability information. With the analysis and extension of the existing literatures [8,16,17,18], the derived six aspects are completeness [16], adequacy [8], relevance [17], reliability [17], normativeness [18] and clarity [17]. Completeness refers to the breadth of the report disclosure [16]. Adequacy reflects the depth of disclosure of the report. Relevance shows the usefulness of the report disclosure to the reader [8]. Reliability is the trustworthiness of the reader to the content of the report [17]. Normativeness describes the compliance of the report with the G3.1 indicator disclosure requirement [18]. Clarity indicates the reader’s ability to comprehend the sustainability reporting [17].

Afterwards, the novel evaluation method is proposed to deal with the evaluation information, which not only considers the weight of experts but also subject and object weights of indicators. In the method, a group of experts are invited to give the evaluation information. Since the linguistic terms are preferred in the evaluation, the intuitionistic fuzzy sets are used to model the linguistic ratings. Not only the membership and nonmembership but also the hesitation is used to characterize the vagueness and uncertainty [19,20,21,22]. The evaluation information can be modeled more comprehensively. Different expertise and knowledge lead to different level on the accuracy of opinions. The weights of experts are calculated based on entropy [23]. Moreover, indicators play different roles in the discrimination of candidates. The subject weight representing the importance and the object weight representing the discrimination capability are often integrated as the weight of indicators [24,25]. However, in intuitionistic fuzzy setting, they are treated separately in current researches [23,26]. In the study, the two kinds of weights are integrated based on entropy. Finally, the opinions of multiple experts are integrated as the final evaluation results with the weight of experts and indicators.

Finally, the seven representative companies are selected as the case company to verify the proposed approach. Meanwhile, the evaluation results are analyzed and suggestions are given for further improvement.

The rest of this paper is organized as follows. Section 2 introduces the entropy and intuitionistic fuzzy sets. Section 3 builds evaluation indicator system from six aspects. Section 4 proposes the evaluation method. Section 5 is the application of the proposed approach. The conclusion along with future research are given in Section 6.

2. Entropy and Intuitionistic Fuzzy Sets

In decision making, exact numeric values are always difficult obtained because of the uncertainty and fuzziness [27,28,29,30,31,32]. In order to resolve the problem, the intuitionistic fuzzy set was newly put forward [33]. Intuitionistic fuzzy set is the generalization of fuzzy set. In fuzzy set, the membership of an element to a fuzzy set is ranging from zero to one [34,35,36,37]. But sometimes, the sum of the degree of membership and the degree of nonmembership may not be equal to 1. There may be some hesitation. Therefore, the degree of non-membership is added to the fuzzy set to construct intuitionistic fuzzy set [33]. It is more useful in dealing with vagueness and uncertainty and has been widely used in decision situations [22,26,38,39]. Considering the ratings in the study are in the linguistic form, the intuitionistic fuzzy set is applied to model the linguistic ratings more comprehensively. In order to discriminate the experts and indicator, the entropy, which is proposed to measure the discriminatory power in decision making [40,41,42,43,44,45], is used. Entropy and intuitionistic fuzzy sets are reviewed briefly as follows [40,41,46,47,48,49,50].

[ where

[

Assume

[

For intuitionistic fuzzy set where

[

The entropy weight of where

[ where

3. Construction of Indicator System

Sustainability information disclosure essentially belongs information disclosure related to sustainability. Therefore, there needs to determine the aspects of information disclosure firstly. Based on the literatures [8,16,17,18], the six aspects including completeness [16], adequacy [8], relevance [17], reliability [17], normativeness [18] and clarity [17] are determined. In the work [16], the completeness is used to measure the environmental information disclosure. The adequacy is used in the work [8] to evaluate the environmental performance information disclosure. Relevance, reliability and clarity are used for the evaluation of quality of social responsibility information disclosure [17]. Normativeness is derived from the work [18], which is used to assess the quality of sustainability reporting.

Based on the above aspects and the information tied to sustainability, the sustainability information disclosure quality evaluation indicator system is built, which is directly related to sustainability information disclosure. For example, sustainability information usually includes social, economic and environmental aspects. Therefore, in the aspect of completeness, there are the degree of disclosure of economic information and social information. The environmental information is subdivided into dye emissions, total emission reduction. It can be seen that the indicators are closely related to sustainability information.

The quality evaluation indicator system for sustainability information disclosure is shown in Table 1 and the detailed illustration are as follows.

Table 1

Quality Evaluation Indicator System for Sustainability information Disclosure.

Aspects	Indicators
Completeness (B1) [16]	The length of the sustainability report (C1)
	Degree of disclosure of negative information (C2) [8]
	Degree of disclosure of economic information (C3) [12]
	Degree of disclosure of social information (C4) [12]
	Degree of disclosure of corporate environmental policies and objectives (C5) [55]
	Degree of disclosure of corporate environmental responsibility and obligations (C6) [55]
	Degree of disclosure of pollutant discharge compliance (C7) [16]
	The degree of disclosure of the completion of the total emission reduction task (C8) [16]
	The degree of disclosure of the implementation of the “three simultaneous” system (C9) [16]
Adequacy (B2) [8]	Environmental information space accounts for the proportion of sustainable development report (C10)
	Method of information disclosure (consolidated report, supplementary report or independent report) (C11) [16]
	Substantial disclosure of major environmental problems (C12) [8]
	Substantial disclosure of environmental risks (C13)
	Substantial disclosure of environmental impact (C14) [8]
Relevance (B3) [17]	Timeliness of disclosure (C15) [17]
	Expected environmental risk (C16)
	The importance of disclosure (C17) [52]
Reliability (B4) [17,53]	The degree of disclosure of the third-party audit (C18)
	The degree of disclosure of the ISO environmental system certification (C19) [55]
	Neutrality of disclosure (C20) [17]
	Verifiability of disclosure (C21) [17]
	Authenticity of disclosure (C22) [17]
Normativeness (B5) [8,18]	The degree of disclosure of the GRI indicator index (C23) [8]
	The normalization and rigor of language expression (C24)
	Systematic of disclosure (C25)
Clarity (B6) [17]	Readability of disclosure (C26) [17,54]
	Innovative of disclosure (C27) [17]

Completeness [16]

Completeness refers to the breadth of the report disclosure. Sustainability reports generally cover social, economic and environmental aspects [12]. For the heavily polluting industry, the most important is its environmental information. In the “Guidelines for Environmental Information Disclosure of Listed Companies” (Draft for Comment) issued by the Ministry of Environmental Protection of China in 2010 [51], the 16 heavily polluting industries identified by their classification must disclose the degree of disclosure of pollutant discharge compliance, the degree of disclosure of the completion of the total emission reduction task, the degree of disclosure of the implementation of the “three simultaneous” system etc [16].

Adequacy [8]

Adequacy refers to the depth of disclosure of the report. For heavily polluting enterprises, the part that should be substantially disclosed is the environmental part. Generally speaking, the larger the proportion of environmental information, the more adequate the information disclosure. In addition, the way information is disclosed also determines the adequacy of information disclosure to a certain extent. At present, there are three main ways of environmental information disclosure, including consolidated reports, supplementary reports and independent reports [16]. Compared with consolidated reports and supplementary reports, corporate disclosures using independent reports will be more fully disclosed.

Relevance [17]

Relevance is the usefulness of the report disclosure to the reader, which generally includes three aspects: timeliness [17], predictability and importance [52]. For matters happening in the enterprise, timely disclosure should be made. The more timely the disclosure, the higher the quality of the report [17]. The content of the report should be predictive. For heavily polluting industries, the predictability is mainly reflected in whether the expected environmental risks are disclosed. In addition, issues of concern to stakeholders should be substantively disclosed in accordance with the principle of importance.

Reliability [17,53]

Reliability is the trustworthiness of the reader to the content of the report. Mainly depends on the neutrality, verifiability and authenticity of the report [17]. In addition, whether the company passes the ISO (International Organization for Standardization) environmental system certification [54] and reports whether it is audited by an independent third party will also affect the reliability of the report. For heavily polluting enterprises, environmental problems are the most important problems they face, and the ISO environmental system certification can prove that the organization has reached an international level in environmental management, which can enhance readers’ conviction on reports. And if the report is audited by an independent third party, it can also enhance the reliability of the report and improve the quality of the report.

Normativeness [8,18]

Currently, there are no uniform disclosure standards for sustainability reports. Different companies have different disclosure standards, guidelines, and specifications. In addition, the reporting language also has problems such as normativeness and rigor. In recent years, as GRI guidelines have become more widely used, more and more companies are providing GRI indicator index in their report appendix [8]. This index describes the compliance of the report with the G3.1 indicator disclosure requirements, which to some extent enhances the normative nature of the report and improves the quality of the report.

Clarity [17]

Clarity is the reader’s comprehensibility of sustainability reporting. When preparing a sustainability report, it is necessary to give practical consideration to the reader’s ability to understand [17,54]. If the disclosed report is difficult to understand, it loses its meaning. Therefore, it is necessary to use an easy-to-understand language when disclosing, and to make necessary explanations for unavoidable technical terms and abbreviations. In addition, the sustainability report should not be limited to a fixed form. Personalized disclosure should be encouraged to avoid the same content that is disclosed each year, so that readers can have a deeper understanding of the sustainable development of the company through reading reports [17].

4. Evaluation Method

The indicators in Table 1 are qualitative. It is difficult to get exact numerical judgements. Instead, linguistic assessments are preferred. Because the ratings are in linguistic form, intuitionistic fuzzy sets are applied to model the linguistic ratings comprehensively. The intuitionistic fuzzy entropy is used to discriminate the experts and indicators. Since expertise level and familiarity degree are probably not identical, experts need to be discriminated [23]. The stronger consistency of opinions indicates the expert is more reliable [23]. The corresponding expert will be given a higher weight. The two kinds of expert weights are derived by the ratings of enterprise and indicators respectively based on intuitionistic fuzzy entropy [23]. Moreover, the weights of indicators are also not same [24]. The weight of indicators should include the importance and the discrimination [24]. The importance named as subject weight is often rated by experts. The discrimination capability named as object weight is often derived by calculating the discrimination capability of the indicator. In intuitionistic fuzzy settings, these two kinds of weight are used separately in current researches [23,26]. In order to get a more comprehensive weight of indicators, in the study, the object weight [41] and subject weight [23,56] are derived with intuitionistic fuzzy entropy and integrated as the weight of indicators. Firstly, the weight of experts and the corresponding weighted score and weighted importance of the indicator are derived [23]. The object weight of the indicator is calculated [41]. Then the weighted importance and object weight of the indicator are integrated as the weights of the indicator [25]. Finally, the evaluation results are derived by aggregating ratings. The detailed steps are given as follows.

Let be the set of evaluators, be the set of alternatives, and be the set of indicators. Assume that the weight vector for the score with respect to indicator of m alternatives can be expressed in , where and , and the score for importance of indicator of enterprise can be expressed in , where . The K evaluators are invited to evaluate the score with respect to indicator of enterprise and the score for importance of indicator of enterprise separately. Then obtain the intuitionistic fuzzy decision matrix and by evaluator , where the intuitionistic fuzzy set can be expressed in IFS (intuitionistic fuzzy sets) . And , , respectively express the satisfaction, dissatisfaction and hesitancy degree of evaluator under the indicators of the enterprise , , , , .

Step 1. Assume that the scoring with respect to indicator of enterprise given by the evaluator can be expressed in IFS , the scoring for importance of indicator given by the evaluator can be expressed in IFS . Therefore, the corresponding intuitionistic fuzzy decision matrix and can be shown concisely in matrix in the following form. where , .

Step 2. Obtain intuitionistic fuzzy entropy of the scoring of enterprise. According to the evaluator evaluation results of the scoring with respect to indicator of alternative , calculate the intuitionistic fuzzy entropy and then obtain the entropy weight of indicators [56] as the weight of evaluator on the enterprise score by the following formula.

Step 3. Calculate the weighted evaluation value for the scoring of enterprise. Based on the weight of evaluator on the enterprise score and the enterprise scoring information, with Equation (3), calculate the weighted evaluation value of indicators of enterprise on the enterprise scoring . where .

Step 4. Obtain the entropy weight on the enterprise scoring. Based on the weighted evaluation value , with Equations (6) and (7), calculate the entropy weight with respect to indicators of all enterprises on the enterprise scoring by using the following formula [41].

Step 5. Obtain intuitionistic fuzzy entropy of the scoring for importance of indicators. According to the evaluator evaluation results of the scoring for importance of indicator of enterprise , calculate the intuitionistic fuzzy entropy and then obtain the entropy weight of indicators [56] as the weight of evaluator on the scoring for importance of indicator by the following formula.

Step 6. Calculate the weighted evaluation value for the scoring for importance of indicators. Based on the weight of evaluator on the enterprise score and the importance of indicator scoring of enterprise information, with Equation (3), calculate the weighted evaluation value of indicators on the scoring for importance of indicator as the weight of indicators. where .

Step 7. Obtain the weight of indicators. Based on the entropy weight of the enterprise scoring and the weighted evaluation value for the scoring for importance of indicators, with Equation (3), obtain the weight of indicators .

Step 8. Calculate the weight of indicators. According to the weight of indicators , with Equation (8), calculate the corresponding score value.

Step 9. Obtain the final evaluation results. Based on the weight of enterprise scoring and the weight of indicators , with Equation (2), obtain the final evaluation results by using the following formula.

Step 10. Calculate the final evaluation score of enterprise . According to the final evaluation results , with Equation (8), calculate the final evaluation score of enterprise by using the score function as follows.

5. Illustrative Example

China is a developing country. Many of the resources used in heavily polluting industries are scarce and non-renewable, and many companies do not make efficient use of resources. Moreover, a large amount of pollution will be generated in the production process and cause great damage to the environment. Therefore, it is not doing well in terms of sustainable development. In recent years, as China’s attention to sustainable development has increased, the sustainability requirements for heavy polluting industries have increased accordingly. For some companies with serious pollution, they have also been rectified accordingly. Therefore, stakeholders are very concerned about sustainability information disclosure in heavily polluting industries. Therefore, from the heavy pollution industry, this paper selected seven representative companies for evaluation.

5.1. Evaluation

According to the “Guidelines for Environmental Information Disclosure of Listed Companies” (Draft for Comment) issued by the China’s Ministry of Environmental Protection in 2010 [51], heavy pollution industry is divided into 16 sub-sectors. We select seven industries that involve non-renewable energy as raw materials, and considers that these industries will pay more attention to their sustainability information, and select one representative enterprise from each of the seven sub-sectors to conduct research for the sample company. The enterprises to be evaluated in this article include Zijin Mining Group, Shandong Hongqiao, Baoshan Iron & Steel Co., Ltd., Shaanxi Coal and Chemical Industry Group, Sinopec Group, Conch Cement Co. Ltd., and Boway Alloy Material Co., Ltd. (,,,,,,). A group of 12 experts (,,…,) are invited to evaluate the importance of the indicators and score the seven enterprises according to indicators using the linguistic terms in Table 2. The following is the specific evaluation process.

Table 2

Linguistic term sets.

Linguistic Terms for Weight of Indicators	Linguistic Terms for Quality Level	IFNs
Very important (VI)	Very high (VH)	(0.90, 0.05, 0.05)
Importance (I)	High (H)	(0.75, 0.20, 0.05)
Medium (F)	Medium (F)	(0.50, 0.40, 0.10)
Unimportance (U)	Low (L)	(0.25, 0.60,0.15)
Very unimportant (VU)	Very low (VL)	(0.10, 0.80, 0.10)

Step 1. Construct the intuitionistic fuzzy decision matrix of information quality level of the enterprise and the intuitionistic fuzzy decision matrix of weight of indicators by using the linguistic terms in Table 2, based on the evaluation result of experts. The intuitionistic fuzzy decision matrices of weight of indicators obtained is shown in Table 3.

Table 3

The intuitionistic fuzzy decision matrix of weight of indicators.

	c_1	c_2	c_3	c_4	c_5	c_6	c_7	c_8	c_9
e_1	(0.5,0.4)	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)
e_2	(0.75,0.2)	(0.25,0.6)	(0.5,0.4)	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)
e_3	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)
e_4	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.5,0.4)	(0.5,0.4)	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)
e_5	(0.25,0.6)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.5,0.4)
e_6	(0.75,0.2)	(0.9,0.05)	(0.5,0.4)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)
e_7	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)
e_8	(0.5,0.4)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)
e_9	(0.5,0.4)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)
e_10	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.5,0.4)
e_11	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)
e_12	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)
	c_10	c_11	c_12	c_13	c_14	c_15	c_16	c_17	c_18
e_1	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)
e_2	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.25,0.6)	(0.25,0.6)	(0.25,0.6)	(0.25,0.6)	(0.5,0.4)	(0.25,0.6)
e_3	(0.5,0.4)	(0.5,0.4)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)
e_4	(0.75,0.2)	(0.5,0.4)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)
e_5	(0.25,0.6)	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)
e_6	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)
e_7	(0.5,0.4)	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.5,0.4)	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)
e_8	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)
e_9	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)
e_10	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)
e_11	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.5,0.4)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)
e_12	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)
	c_19	c_20	c_21	c_22	c_23	c_24	c_25	c_26	c_27
e_1	(0.9,0.05)	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)	(0.5,0.4)	(0.5,0.4)	(0.25,0.6)
e_2	(0.5,0.4)	(0.5,0.4)	(0.5,0.4)	(0.5,0.4)	(0.5,0.4)	(0.5,0.4)	(0.5,0.4)	(0.25,0.6)	(0.5,0.4)
e_3	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.5,0.4)	(0.5,0.4)	(0.25,0.6)	(0.75,0.2)	(0.25,0.6)
e_4	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)
e_5	(0.75,0.2)	(0.5,0.4)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)	(0.25,0.6)	(0.5,0.4)	(0.5,0.4)	(0.25,0.6)
e_6	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)
e_7	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.5,0.4)
e_8	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.5,0.4)	(0.9,0.05)	(0.25,0.6)
e_9	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)
e_10	(0.75,0.2)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)
e_11	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.5,0.4)	(0.5,0.4)	(0.75,0.2)	(0.9,0.05)
e_12	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.9,0.05)	(0.75,0.2)	(0.75,0.2)	(0.75,0.2)	(0.5,0.4)

Step 2. Obtain the weight of experts on the enterprise score with Equations (9) and (10), where . The result is shown in Table 4.

Table 4

The weight of experts on the enterprise score.

	e_1	e_2	e_3	e_4	e_5	e_6	e_7	e_8	e_9	e_10	e_11	e_12
P_1	0.081	0.080	0.088	0.081	0.083	0.081	0.082	0.086	0.086	0.081	0.082	0.088
P_2	0.083	0.080	0.085	0.082	0.080	0.081	0.082	0.088	0.085	0.081	0.086	0.087
P_3	0.080	0.082	0.087	0.079	0.081	0.085	0.081	0.089	0.085	0.086	0.081	0.084
P_4	0.083	0.081	0.087	0.080	0.080	0.081	0.082	0.088	0.085	0.080	0.084	0.088
P_5	0.084	0.082	0.085	0.081	0.078	0.086	0.081	0.086	0.086	0.081	0.084	0.086
P_6	0.083	0.082	0.086	0.081	0.081	0.084	0.082	0.084	0.086	0.080	0.085	0.087
P_7	0.083	0.080	0.084	0.082	0.081	0.087	0.080	0.085	0.084	0.085	0.083	0.086

Step 3. Calculate the weighted evaluation value for the scoring of enterprise with Equations (11). The result obtained is shown in Table 5.

Table 5

The weighted evaluation value for the scoring of enterprise.

	c_1	c_2	c_3	c_4	c_5	c_6	c_7	c_8	c_9
P_1	(0.74,0.19)	(0.40,0.50)	(0.63,0.29)	(0.77,0.18)	(0.64,0.28)	(0.72,0.20)	(0.68,0.24)	(0.62,0.29)	(0.71,0.22)
P_2	(0.63,0.28)	(0.27,0.60)	(0.49,0.41)	(0.64,0.29)	(0.66,0.27)	(0.64,0.29)	(0.66,0.25)	(0.41,0.47)	(0.33,0.55)
P_3	(0.71,0.20)	(0.27,0.61)	(0.59,0.31)	(0.72,0.21)	(0.75,0.17)	(0.68,0.24)	(0.66,0.25)	(0.59,0.30)	(0.39,0.49)
P_4	(0.57,0.33)	(0.39,0.52)	(0.60,0.31)	(0.71,0.22)	(0.64,0.29)	(0.65,0.27)	(0.53,0.36)	(0.49,0.41)	(0.37,0.51)
P_5	(0.74,0.20)	(0.45,0.44)	(0.59,0.33)	(0.72,0.21)	(0.72,0.22)	(0.67,0.27)	(0.62,0.31)	(0.60,0.32)	(0.48,0.42)
P_6	(0.55,0.36)	(0.18,0.69)	(0.55,0.36)	(0.73,0.20)	(0.55,0.36)	(0.61,0.31)	(0.58,0.32)	(0.55,0.36)	(0.35,0.53)
P_7	(0.18,0.69)	(0.29,0.59)	(0.66,0.24)	(0.52,0.37)	(0.43,0.46)	(0.47,0.42)	(0.34,0.55)	(0.34,0.55)	(0.38,0.51)
	c_10	c_11	c_12	c_13	c_14	c_15	c_16	c_17	c_18
P_1	(0.67,0.25)	(0.64,0.28)	(0.48,0.43)	(0.40,0.46)	(0.51,0.38)	(0.68,0.26)	(0.44,0.45)	(0.71,0.22)	(0.50,0.40)
P_2	(0.68,0.24)	(0.64,0.27)	(0.34,0.55)	(0.34,0.55)	(0.40,0.47)	(0.60,0.32)	(0.47,0.42)	(0.57,0.35)	(0.43,0.47)
P_3	(0.77,0.16)	(0.74,0.19)	(0.37,0.52)	(0.42,0.47)	(0.46,0.42)	(0.71,0.23)	(0.45,0.44)	(0.69,0.23)	(0.54,0.37)
P_4	(0.55,0.36)	(0.64,0.28)	(0.35,0.53)	(0.31,0.55)	(0.33,0.54)	(0.71,0.22)	(0.44,0.45)	(0.61,0.31)	(0.46,0.43)
P_5	(0.59,0.32)	(0.72,0.20)	(0.49,0.41)	(0.43,0.46)	(0.43,0.46)	(0.69,0.24)	(0.44,0.45)	(0.65,0.28)	(0.60,0.32)
P_6	(0.60,0.31)	(0.63,0.29)	(0.23,0.64)	(0.29,0.57)	(0.25,0.60)	(0.69,0.25)	(0.33,0.54)	(0.58,0.33)	(0.41,0.48)
P_7	(0.27,0.60)	(0.36,0.53)	(0.33,0.55)	(0.38,0.50)	(0.36,0.52)	(0.58,0.34)	(0.46,0.43)	(0.52,0.38)	(0.48,0.42)
	c_19	c_20	c_21	c_22	c_23	c_24	c_25	c_26	c_27
P_1	(0.67,0.25)	(0.52,0.38)	(0.64,0.28)	(0.63,0.30)	(0.45,0.45)	(0.69,0.25)	(0.71,0.22)	(0.77,0.18)	(0.53,0.38)
P_2	(0.73,0.19)	(0.57,0.35)	(0.62,0.31)	(0.66,0.26)	(0.57,0.33)	(0.65,0.28)	(0.66,0.28)	(0.72,0.20)	(0.64,0.28)
P_3	(0.74,0.19)	(0.64,0.27)	(0.62,0.31)	(0.65,0.28)	(0.66,0.26)	(0.76,0.19)	(0.71,0.22)	(0.76,0.19)	(0.74,0.19)
P_4	(0.70,0.22)	(0.58,0.34)	(0.58,0.34)	(0.58,0.33)	(0.60,0.31)	(0.65,0.27)	(0.62,0.31)	(0.76,0.18)	(0.64,0.27)
P_5	(0.76,0.18)	(0.67,0.24)	(0.67,0.27)	(0.68,0.24)	(0.67,0.27)	(0.71,0.23)	(0.69,0.25)	(0.76,0.18)	(0.70,0.22)
P_6	(0.63,0.28)	(0.55,0.37)	(0.64,0.27)	(0.61,0.31)	(0.53,0.37)	(0.69,0.25)	(0.64,0.29)	(0.69,0.25)	(0.49,0.41)
P_7	(0.28,0.60)	(0.56,0.34)	(0.52,0.38)	(0.,0.28)	(0.27,0.60)	(0.62,0.31)	(0.55,0.37)	(0.65,0.28)	(0.33,0.56)

Step 4. Obtain the entropy weight on the enterprise scoring with Equations (12) and (13).

Step 5. Obtain intuitionistic fuzzy entropy of the scoring for importance of indicators with Equations (14) and (15).

Step 6. Calculate the weighted evaluation value for the scoring for importance of indicators with Equation (16).

Step 7. Obtain the weight of indicators with Equation (17).

Step 8. Let . Calculate the score value of the weight of indicators with Equation (19), as is shown in Table 6.

Table 6

The score value of the weight of indicators.

s(β_j)	Score	Rank	s(β_j)	Score	Rank	s(β_j)	Score	Rank
s(β_1)	−0.452	24	s(β_10)	−0.456	25	s(β_19).	−0.429	8
s(β_2)	−0.431	9	s(β_11)	−0.443	18	s(β_20)	−0.439	15
s(β_3)	−0.449	22	s(β_12)	−0.422	3	s(β_21)	−0.434	11
s(β_4)	−0.445	21	s(β_13)	−0.426	5	s(β_22)	−0.420	2
s(β_5)	−0.435	12	s(β_14)	−0.431	10	s(β_23)	−0.438	14
s(β_6)	−0.429	7	s(β_15)	−0.425	4	s(β_24)	−0.450	23
s(β_7)	−0.416	1	s(β_16)	−0.443	20	s(β_25)	−0.458	26
s(β_8)	−0.427	6	s(β_17)	−0.439	16	s(β_26)	−0.443	19
s(β_9)	−0.441	17	s(β_18)	−0.437	13	s(β_27)	−0.468	27

Steps 9 and 10. Let , obtain the final evaluation results with Equation (19) and calculate the final evaluation score of enterprises with Equation (20). The results are shown in Table 7 and Figure 1.

Table 7

Evaluation results of seven enterprises.

	P_1	P_2	P_3	P_4	P_5	P_6	P_7
Evaluation results	(0.60,0.27)	(0.57,0.30)	(0.61,0.26)	(0.57,0.29)	(0.61,0.26)	(0.54,0.31)	(0.48,0.36)
Score value	0.168036	0.134568	0.170304	0.136327	0.17417	0.115692	0.061866
Rank	3	5	2	4	1	6	7

Figure 1

Evaluation results of seven enterprises.

5.2. Discussion

According to Table 6, it can be seen that among the 27 secondary indicators, the most important indicator is the degree of disclosure of pollutant discharge compliance. This is mainly because the indicator system of this paper is used to evaluate the quality of sustainability information disclosure in heavy polluting industries. Stakeholders in heavily polluting industries are highly concerned about their pollutant emissions. The second important indicator is the authenticity of disclosure. There is information asymmetry between companies and stakeholders. Stakeholders mainly understand the company through the information disclosed by the company. Therefore, the authenticity of the company’s disclosure content is particularly important. In addition, the importance of indicators such as the substantial disclosure of major environmental problems and the timeliness of disclosure is also high. Relatively speaking, the innovative of disclosure and the systematic of disclosure are not very important. It can be seen that the attention paid to the language of the disclosure is not high.

According to Table 7 and Figure 1, it can be seen that among the seven case companies, the highest quality of sustainability information disclosure is Sinopec Group, followed by Baoshan Iron & Steel Co., Ltd., and Zijin Mining Group again. The disclosure quality of Shaanxi Coal and Chemical Industry Group, Shandong Hongqiao and Conch Cement Co. Ltd. is medium. The quality of Boway Alloy Material Co., Ltd.’s disclosure is the lowest, and its score is far from that of other companies, this shows that the quality of sustainability information disclosure between different enterprises is still wide. The low quality of Boway Alloy Material Co., Ltd. information disclosure is greatly affected by its disclosure method, which only uses a small amount of supplementary disclosure in its annual report. Except for Boway Alloy Material Co., Ltd., the other six companies have issued independent reports to disclose their sustainability information, which greatly enhances the quality of sustainability information disclosure. In addition, during the research, it was found that even companies with high quality of sustainability information disclosure like Sinopec Group disclosed only one page of disclosure on the rupture and explosion of oil pipelines in 2013. It can be seen that there is a problem of simplifying the disclosure of negative information at the time of disclosure. At the time of the study, it was found that the sustainability information of most enterprises was not audited by independent third parties, which shows that the reliability of the disclosure information is questionable. Moreover, the heavily polluting industries should focus on their environmental impact at the time of disclosure, but it was found that their environmental disclosure was not sufficient.

Based on the above analysis, suggestions for sustainability information disclosure in heavily polluting industries are proposed: (1) The state should formulate uniform disclosure standards to avoid the large difference in the quality of sustainability information disclosure between different companies; (2) When companies disclose sustainability information, they should use independent reports to disclose them; (3) The company should disclose the negative information in detail to reduce the degree of information asymmetry; (4) The company’s sustainability information should be audited by an independent third party; (5) Heavy polluting industries should increase the disclosure of their environmental information.

6. Conclusions

This paper proposed an approach to evaluating the quality of sustainability information disclosure of listed companies in heavy polluting industries. It is evaluated from the aspects of completeness, adequacy, relevance, reliability, normativeness and clarity. Considering the ambiguity and complexity of evaluation information, intuitionistic fuzzy sets is applied to model linguistic ratings and entropy is used to derive the weight of experts, the object weight and the subject weight of the indicators. The corresponding method is proposed to aggregate the evaluation information. The case study verifies the proposed approach. It also shows that most heavily polluting companies do a good job in sustainability information disclosure, but there is still a large gap in the quality of sustainability information disclosure between different companies. From this study, the quality of the disclosure of sustainability information can be evaluated more comprehensive. The six evaluation aspects along with the criteria can be valuable references for the research of disclosure of other information. The proposed evaluation method can effectively integrate experts’ opinions. Entropy plays a more important role in it. Through the entropy, the importance of expert opinions is distinguished, and the weights of indicators are measured. The study provides a new application field of entropy. The proposed evaluation method has good applicability and enriches the research on decision making. It is universal and can be used to aggregate the ratings in the field of linguistic evaluation.

With the proposed approach, the quality of disclosure of sustainability information can be grasped comprehensively and directly. It will be the value basis of future improvement for disclosing the sustainability information and have important influence on the stakeholders’ decision making. In the future research, the proposed approach can be used in more companies to make further verification and improvements.