Evaluating web accessibility of educational institutions websites using a variable magnitude approach.

The World Wide Web serves as an excellent platform for information dissemination. Educational institutions such as universities are utilizing the web medium to reach their target audience. In the post-Covid-19 scenario, the web medium has obtained increased significance as it has become the primary access channel to reach these institutions. In this backdrop, it becomes essential to analyze the accessibility of these sites for students with special needs. This paper presents an approach to compute the accessibility of web pages for persons with disabilities. A variable magnitude approach is proposed in this paper for the computation of accessibility barrier count as a combination of two different components. The proposed approach is experimented with top ranked higher educational institution websites of India. Based on the inferences from the results and inputs received from students with disabilities, a set of suggestions have been compiled by this paper to minimize the barriers faced by persons with disabilities in consuming these web resources.

Introduction

The prolific expansion of World Wide Web (WWW) has positioned it as an important platform to reach large number of users instantly. The spectrum of services that are running on the web is unprecedented in nature. The World Wide Web is rendering various services such as banking, e-commerce and educational services. Global reach through a wide spectrum of devices constitutes the uniqueness of the web.

Though the World Wide Web has its reach at the global scale, it shall pose barriers to specific group of users such as persons with disabilities, if not designed properly. As envisaged by the inventor of the web Sir Tim Berners Lee, the World Wide Web should remain a platform which shall be utilized by everyone irrespective of their physical disabilities1.

The World Wide Web has been in active use for the past few decades. However, with the onset of Covid-19 pandemic, the global scenario has mutated into a new dimension. Earlier, in many cases, the web was utilized as an ancillary channel of service delivery. But in the post Covid-19 scenario, the World Wide Web has become the primary channel of service delivery. In such a scenario, it becomes critical to maintain the web channel of access in a barrier-free manner for all groups of users which certainly includes persons with disabilities.

In the post-Covid-19 scenario, educational institutions across the globe have resorted to the web channel of access. The primary access to educational institutions such as universities is now through their official websites. All of the critical information such as admission-related information, course materials dissemination, examination-related information is provided to both the currently enrolled students and the potential students through the university websites.

The World Health Organization has stated that 15% of the world population is experiencing some sort of disabilities, which scales up to 1 billion2. In other words, one in seven persons in the global population has some sort of disabilities. This significant chunk of human population should not be left facing barriers in accessing these critical information resources.

With respect to the Indian context, the official census statistics of 2011 states that 26.8 million persons are experiencing some sort of disabilities, as shown in Table 1. It shall be observed from Table 1 that out of 26.8 million population, 15.0 million people are from the rural regions. It puts an increased emphasis that while designing the web pages, the bandwidth requirements of this population also need to be taken into consideration.

Table 1

Population of persons with disabilities rural and urban (in millions)

Residence	Male	Female	Total
Urban	8.2	3.6	11.8
Rural	10.4	4.6	15.0
Total	18.6	8.2	26.8

The Government of India has been running mission-critical projects such as Digital India3 and Accessible India4 . The primary objective of Digital India is to facilitate providing the services through the digital ecosystem. The accessible India campaign aims to enable the persons with disabilities by providing them a barrier-free environment across three dimensions, including built-environment, transportation and cyberspace. This paper deals with one of the components of cyberspace accessibility, i.e., website accessibility.

India has a demographic advantage of youth population. This ratio holds in persons with disabilities as well. Accessibility of both physical infrastructure and that of digital infrastructure are two major factors determining the educational choices of students with disabilities. In this study, the focus is on one of the important components of cyber infrastructure, i.e., the websites which serves as an entry point of information and access. As the current study is focusing on students with disabilities, the percentage of students under each category of disability is as shown in Table 2.

Table 2

Proportion of categorywise students with disabilities

Disability type	Percentage of students
Persons with visual impairments	28.0
Persons with hearing impairments	32.5
Persons with speech impairments	37.2
Persons with loco-motor impairments	19.7
Persons with mental retardation	24.5
Persons with mental illness	9.3
Persons with other forms of disability	37.4
Persons with multiple disabilities	15

It shall be observed from Table 2 that there exists a significant portion of students under each types of disabilities. In order to cater to the needs of these students, it becomes mandatory that the access to the websites should be made barrier-free to build an inclusive ecosystem for students with disabilities. Information technology and its associated tools are serving as a great enabler to students with disabilities. In that respect, websites also serve as an easier channel of information access for students with disabilities. However, the need for designing websites with proper accessibility features becomes paramount important. With the recent launch of Self Reliant India project, it is absolutely necessary that this significant population of the country should be made self-reliant and for that reason education is an important enabler. To make persons with disabilities self-reliant, providing a barrier-free web ecosystem is essential.

Though the aforementioned statistics are provided for the Indian scenario, the requirements of students with disabilities at the global scenario also remain similar.

Inclusion is the key

One of the important advantages of the web is the ability to reach a wider spectrum of audience with diverse abilities. With the prolific expansion of digital platforms that enabled different educational approaches, it becomes mandatory to keep the web resources fully accessible to persons with disabilities.

The first step in achieving this target is to make the web pages of the educational institutions fully accessible to persons with disabilities. To make the pages accessible, the barriers which are currently posed by these pages need to be measured. If we need to enhance something, then the current status needs to be measured first. In that perspective, the web accessibility barrier measurement of educational websites gains significance.

In this paper, the critical tasks of measuring the barriers rendered by web pages in terms of accessibility are given primary importance. Inclusion is the key to make the every learner feel comfortable and empowered.

The major objectives of this paper are as listed below:The remainder of this paper is organized as follows: motivational works which have led to the conduct of this study are presented in Sect. 2. Popular accessibility evaluation tools are explored in Sect. 3. The web accessibility barrier computation procedure along with the mathematical and algorithmic representations is provided in Sect. 4. The web accessibility analysis of websites is provided in 5. Potential suggestions to improve the web accessibility of educational institution websites are given in Sect. 6. Conclusions and future directions are addressed in Sect. 7.

To propose a variable magnitude approach to compute the accessibility barrier count;

To evaluate the web accessibility of the top ranked educational institution websites with the proposed score;

To provide a list of suggestions to make the web pages of educational institutions such as universities, barrier-free for students with disabilities.

Motivational works

Accessibility Computing has evolved into an active research area which falls under the Human Computer Interaction Domain [4]. This domain majorly focuses on empowering the persons with disabilities by using technology as an enabler [20]. The primary advantage of using technology as an enabling tool is that it reduces the dependency on human assistance which might not be available at all times. Moreover, technology can be replicated to reach a large number of people once its development is completed. Accessibility analysis is the primary objective of this paper. Accessibility analysis has been carried out by various research groups across the globe [1, 3, 7, 9, 10, 12, 19, 21, 30, 33].

Analyzing the educational institution websites has also been explored by various research studies [2, 5, 14–17, 26, 32]. There are studies conducted on library websites of educational websites focusing on accessibility [23]. These studies have focused on a group of websites belonging to a particular country or geographical regions. There are some studies which have focused on the leading universities of the world [6, 18].

There are studies which have focused on longitudinal comparison of results. One of the important studies in this domain is conducted with a longitudinal analysis which has compared the accessibility status of universities between 2005 and 2015 [6]. Studies have been conducted on the evaluation of readability which is also a factor in enhancing content accessibility [24].

India-specific web accessibility analysis has also been carried out either focusing at specific websites under a university or under a region or of a particular type [21, 22]. Apart from educational websites, there are accessibility studies available for other sites such as tourism and studies on specific applications to assist persons with disabilities [11, 28].

In addition to website accessibility analysis on desktop and laptop browsers, there are studies which have focused on the accessibility of the mobile web [8, 29]. As mobile devices have become increasingly popular, these studies address the specific requirements of users who utilize mobile devices [25, 27, 31].

Accessibility has also been studied along with the cyber security combination as well. These studies focus on specific problems and how they can affect persons with disabilities navigating the cyberspace [13].

It shall be inferred from the aforementioned discussions that the web accessibility analysis has become an important research issue which has been addressed by researchers across various countries. However, there are still many unsolved issues and due to the mammoth number of websites, accessibility remains a relevant problem. This paper has also attempted to take a small step toward contributing to the study of web accessibility by proposing a variable weight approach to compute the accessibility barrier score and to suggest the enhancements to make these resources barrier-free.

Accessibility evaluation tools

To perform accessibility evaluation of web pages, there exist an array of tools5. In this paper, the following two tools as shown in Table 3 are adapted to fetch the accessibility level of components and thereby to build an integrated score.

Table 3

Web accessibility evaluation tools

Tool name	URL	Open source	Browser plugin support
AChecker	https://achecker.ca/checker/index.php	Yes	No
WAVE	https://wave.webaim.org/	No	Yes

The primary reason for selecting these two tools is that they provide evaluation results in a structured manner. Another reason is the ability to interact with these tools through programmatic interfaces such as APIs (application programming interfaces).

When accessed through a web browser, the interface provided by these tools has the feature to enter an URL and get the results. The screenshots of AChecker and WAVE tools are as shown in Figure 1 and Figure 2.

Fig. 1

Screenshot of AChecker

Fig. 2

Screenshot of WAVE tool

The AChecker tool can be configured in the local system also. WAVE provides a browser plugin using which the accessibility analysis of the current page can be carried out.

Accessibility barrier computation

This paper proposes a method to compute the accessibility barrier count of a web page. The accessibility barrier count is computed as a combination of two different scores. The first score is based on the evaluation components returned by AChecker, and the second is based on evaluation components returned by WAVE. The accessibility barrier count indicates the magnitude of accessibility errors posed by the web page for persons with disabilities.

Accessibility barrier count—AC

The URL of the web page for which accessibility barrier count is to be computed is passed as input to the AChecker. The rule set selected is Web Content Accessibility Guidelines (WCAG 2.0) with Level AA6. The output from AChecker consists of three components as shown in Eq. 1.In Eq. 1, indicates the Known Errors, indicates Likely Errors and refers to Potential Errors. This model approaches the computation of accessibility barrier with a variable magnitude approach. The severity of errors () is in the descending order of magnitude as shown in Eq. 2.To factor this into the computation of accessibility barrier, three different weight coefficients are introduced.

The is multiplied by the weight coefficient as shown in Eq. 3.The weight coefficient for likely errors is scaled-down with the severity factor , as shown in Eq. 4.The is multiplied by the weight coefficient as shown in Eq. 5.Similarly, the severity factor for potential errors is further scaled down and multiplied by weight vector, as shown in Eq. 6 and Eq. 7.All of these three components are summed up to generate the score (), as shown in Eq. 10.

The procedure ComputeBarrier.AC to compute is listed in Algorithm 1.

Accessibility Barrier Count: WA

The computation of accessibility barrier count: WA () is based on the two important components returned by WAVE. These two components are Errors and Contrast Errors. Similar to the AChecker-based barrier computation, WAVE-based barrier computation also involves variable weights and severity factor. The score () is computed as shown in Eq. 9.The procedure ComputeBarrier.WA to compute the score is shown in Algorithm 2.

The overall accessibility barrier count score () is computed using Eq. 10. Here and indicates the weight coefficients which enables a variable magnitude approach. In case where the score is to computed as the mathematical average, then these weight coefficients shall be initialized to one.The complete procedure to compute the accessibility barrier count score () is shown in Algorithm 3.

Accessibility analysis

As this paper focuses on the educational web domains, experiments were conducted the homepages of Top 25 Indian institutions websites taken from NIRF (National Institutional Ranking Framework) 2020 ranking7. The URLs of these websites are listed in Table 4

Table 4

Top 25 institution home page URLs

Rank	URL
1	https://www.iisc.ac.in/
2	https://www.jnu.ac.in/main/
3	https://www.bhu.ac.in/
4	https://www.amrita.edu/
5	http://www.jaduniv.edu.in/
6	https://www.uohyd.ac.in/
7	https://www.caluniv.ac.in/
8	https://manipal.edu/mu.html
9	http://www.unipune.ac.in/
10	https://www.jmi.ac.in/
11	http://www.du.ac.in/du/
12	https://www.annauniv.edu/
13	https://www.b-u.ac.in/
14	http://www.hbni.ac.in/
15	https://www.bits-pilani.ac.in/
16	https://vit.ac.in/
17	https://www.amu.ac.in/
18	https://www.ictmumbai.edu.in/
19	https://www.andhrauniversity.edu.in/
20	https://www.soa.ac.in/
21	http://jamiahamdard.edu/
22	https://www.unom.ac.in/
23	https://www.keralauniversity.ac.in/
24	https://kiit.ac.in/
25	https://www.sastra.edu/

The computation of was carried out using the ComputeBarrier.AC procedure, and the results are shown in Table 5.

Table 5

Computation of

ID	Known	Likely	Potential	ρ_AC
1	3	0	496	7.96
2	42	1	246	44.56
3	1342	6	1136	1353.96
4	30	0	825	38.25
5	14	0	441	18.41
6	34	6	404	38.64
7	20	1	474	24.84
8	54	0	825	62.25
9	27	5	396	31.46
10	62	0	658	68.58
11	507	0	0	507
12	18	0	148	19.48
13	37	0	730	44.3
14	12	0	20	12.2
15	14	0	1085	24.85
16	46	5	707	53.57
17	56	1	803	64.13
18	376	0	0	376
19	101	2	919	110.39
20	28	0	0	28
21	515	36	1971	538.31
22	80	3	515	85.45
23	89	0	664	95.64
24	68	1	935	77.45
25	12	0	642	18.42

An illustration of the score in the form of a circle packing chart is provided in Figure 3. The bigger the radius of the circle, the greater is the barrier score. The corresponding website IDs are provided inside the circle for easier reference.

Fig. 3

Circle packing chart of accessibility barrier count: AC

The computation of was carried out using the ComputeBarrier.WA procedure, and the results are shown in Table6. The circle packing chart illustration of the analysis is presented in Figure 4. The overall accessibility barrier count () is computed as per Algorithm 3 (Table 7).

Table 6

Computation of

Id	Error	Contrast	ρ_WA
1	60	224	82.4
2	11	4	11.4
3	87	23	89.3
4	34	5	34.5
5	9	4	9.4
6	7	7	7.7
7	15	13	16.3
8	24	41	28.1
9	34	5	34.5
10	93	70	100
11	12	4	12.4
12	19	4	19.4
13	17	4	17.4
14	4	17	5.7
15	13	9	13.9
16	28	71	35.1
17	38	24	40.4
18	41	9	41.9
19	30	48	34.8
20	28	20	30
21	263	9	263.9
22	69	16	70.6
23	17	22	19.2
24	17	32	20.2
25	10	0	10

Fig. 4

Circle packing chart of accessibility barrier count: WA

Table 7

Computation of accessibility of barrier count

ID	URL	Score
1	https://www.iisc.ac.in/	45.18
2	https://www.jnu.ac.in/main/	27.98
3	https://www.bhu.ac.in/	721.63
4	https://www.amrita.edu/	36.375
5	http://www.jaduniv.edu.in/	13.905
6	https://www.uohyd.ac.in/	23.17
7	https://www.caluniv.ac.in/	20.57
8	https://manipal.edu/mu.html	45.175
9	http://www.unipune.ac.in/	32.98
10	https://www.jmi.ac.in/	84.29
11	http://www.du.ac.in/du/	259.7
12	https://www.annauniv.edu/	19.44
13	https://www.b-u.ac.in/	30.85
14	http://www.hbni.ac.in/	8.95
15	https://www.bits-pilani.ac.in/	19.375
16	https://vit.ac.in/	44.335
17	https://www.amu.ac.in/	52.265
18	https://www.ictmumbai.edu.in/	208.95
19	https://www.andhrauniversity.edu.in/	72.595
20	https://www.soa.ac.in/	29
21	http://jamiahamdard.edu/	401.105
22	https://www.unom.ac.in/	78.025
23	https://www.keralauniversity.ac.in/	57.42
24	https://kiit.ac.in/	48.825
25	https://www.sastra.edu/	14.21

The circle packing chart illustration of the overall score () is given in Figure 5.

Fig. 5

Circle packing chart of overall score

Accessibility enhancement suggestions

In this section, a list of suggestions are provided to enhance the accessibility of the web pages. These suggestions are derived based on the feedback received from students with disabilities and the inferences from the web accessibility analysis.The aforementioned suggestions shall enhance the accessibility of web pages for persons with disabilities. Though they are given here in the context of educational web pages, they shall be adapted for any web page that is targeted to have an universal accessibility.

Text Alternatives: One of the important elements of web accessibility is the presence of text alternatives for non-textual contents such as images, animations. If such a textual description is not available, then it would be very difficult for the students with disabilities to understand the contents of such non-textual resources. Hence, leaving out any images used for decorative purposes, all other elements need to be assigned a textual description so that it would be barrier-free for students with disabilities who are consuming these contents through screen reader in an aural mode;

Providing Text-Based PDFs: Websites includes resources such as PDF (portable document format) files. Particularly in educational institution websites these files are used to distribute information, learning resources, etc. When uploaded as image-based pdfs by simply scanning hard copy resources, they would not be read properly by screen readers. It would be optimal for screen reader users when the text-based pdfs are utilized which can be read using a screen reader;

Keyboard-only Navigation: For persons with visual impairments navigating, the web pages through mouse movements are not feasible. Hence, they depend on the keyboard based navigation. The focus would shift from one element to another when the Tab key is pressed. If the focus order is maintained properly, then this navigation through keyboard would be made much simpler. This option would be very much useful not only for persons with visual impairments but also for persons who have difficulty in controlling the mouse movements because of various physical conditions;

Custom Color Contrast : One of the important attributes of accessibility is that it does not follow a one-size-fits-all model. The needs of various users would be different based on their specific requirements. Keeping this in mind, adjusting the color contrast based on the user preference is one of the important factors. Many websites have provided such a feature to adjust text-size and color contrast. Wherever they are absent, these features shall be added so that the persons with disabilities can tune it as per their specific requirements. It shall also be selected based on the devices that they are using for browsing the web pages. On a smaller sized display, text size and contrast requirements would be different from a bigger display. It can be different based on ambient lighting conditions, etc.

Proper Structuring of Forms: In web pages, Forms are the mechanism to receive user input. In such a scenario, proper labelling of form elements, placement and size of the elements shall also be kept at a comfortable level so that persons with disabilities can interact with the contents in a seamless manner;

Multimodal alerts: Indicating alerts with a specific representation such as color is not accessible for persons with visual impairments. For example, in some scenarios green is used to indicate success and red color is used to indicate failure of an operation. This form of color only alert mechanism is inaccessible. In these circumstances, alternative ways of alerts such as audio, textual and haptics shall be incorporated to enhance accessibility of web resources for persons with disabilities;

Multimedia Accessibility: The multimedia components shall be better accessible, if the following features are added: Captions should be made compulsory for all videos so that persons with hearing impairments shall understand the audio contents of the video. Similarly, audio descriptions about the happenings of the video shall be provided so that persons with visual impairments can completely understand such contents;

Multilingual accessibility: When web pages are translated from one language to another, the alt-text should be given enough focus so that in the target language also it is able to give the proper description. As the alt-text is shorter in nature, translation from one language to another needs to be done precisely so that persons with disabilities who are depending only on it would be able to get the correct meaning based on the context;

Accessible Learning Materials: The most important advantage of digital learning materials is that if designed properly, they can be accessed by persons with disabilities in a better manner comparing the physical paper-based resources. Some of the important guidelines are as follows:

Ensuring proper heading structure of the documents so that the screen reader users can navigate in an effective manner;

Table headers need to be given in a semantic manner so that understanding becomes easier;

Placement of floating boxes shall be avoided so that the reading order can be maintained properly;

In case of links in the documents proper hyperlinks text should be placed;

Readability level of these documents needs to be maintained in accordance with the levels that can be easily understood by the target audience;

Before uploading the resources the default accessibility testing features of authoring tools shall be utilized to validate the accessibility.

Conclusion and future directions

This paper has presented the web accessibility analysis of educational websites in India. In this paper, a variable weight approach is presented to compute accessibility barrier count.

Two different approaches of computing the scores are presented through two algorithms. In both of these algorithms, a method to compute the accessibility barrier score is presented. Various components of the accessibility evaluation tools AChecker and WAVE are adopted to compute the score.

With a data set of the top twenty five Indian educational institutions website homepages, the accessibility barrier count was computed which involved three components and a severity factor to scale down the weights based on the importance. Similarly, the accessibility barrier count component was computed. These two component scores were utilized to build the integrated score.

In line with the feedback received from students with disabilities, various suggestions were presented to enhance the accessibility of web pages for persons with disabilities.

The future directions for this research work shall include the development of an accessibility score for multilingual web pages by incorporating various features specific to multilingual web pages. Incorporation of specific scores for various categories of persons with disabilities shall also be taken as a future enhancement.

The approach presented in this paper is aimed toward building awareness on web accessibility among the webmasters and web developers, particularly during the ongoing Covid-19 scenario, so that the information access needs of students with disabilities shall be satisfied in an efficient manner.