Artificial Intelligence and Human Rights: Are There Signs of an Emerging Discipline? A Systematic Review.

AIM: Our systematic review seeks to understand the linkages and reciprocal relationships between the artificial intelligence (AI) and human rights (HRs) and to unveil the signs of emergence of a new discipline at the crossroads of these two disciplines.
BACKGROUND: AI and HRs have evolved in parallel as two fields, with AI technology engineers eventually interested in the consequences of their products on HRs, while more recently HRs experts have been exploring the benefits and threats of AI technologies on the protection and promotion of HRs.
METHODS: A broad range of databases within the fields of legal sciences, social sciences, health-care sciences and the more general sciences practitioner base "Web of Science" were explored. Articles were selected according to strict inclusion/exclusion criteria and systematically analyzed regarding their content and authorship.
RESULTS: The crossroad between AI and HRs is a dynamic field where researchers from different disciplines have been exploring issues such as autonomous lethal weapons, privacy protection, discriminatory decision-making in the insurance and finance systems, intellectual property, and legal personality of the robots. Signs of the emergence of a new discipline were identified.
CONCLUSION: Identifying appropriate strategies to consolidate this emerging discipline seems necessary: one could be the development of academic programs at the crossroad of these two fields.

Introduction

Over the past decades Artificial Intelligence (AI) has invaded and transformed our way of life, of communication, of care and of education, as well as our industrial production procedures, our leisure time, our cultural realizations, even our intimacy.1–4

From a strategic and organizational perspective, it should be recalled that the political, economic, military, regional or global organizations not only are aware of the potential but also of the possible threats of the AI on our societies. Indeed, in 2015, the United Nations opened in The Hague the Center for Artificial Intelligence and Robotics at the United Nations Interregional Crime and Justice Research Institute (UNICRI);5 and in 2018 it convened an international conference bringing together 32 agencies of the UN system to serve as a platform for exchanges between the United Nations and its various branches on its future AI strategy.6

After setting up its strategy on the AI in April 2018, the European Union (EU) made two significant steps forward, by organizing two months later a high-level experts group on the subject and by publishing in February 2019 its first coordinated action-plan7,8 promoting trustworthy AI through ethics guidelines, policy and investment recommendations. The proposed ethical orientations are:

Develop, deploy and use AI systems in accordance with the following ethical principles: respect for human autonomy, prevention of any infringement, fairness and explainability. Recognize and resolve potential tensions between these principles.

Pay particular attention to situations concerning more vulnerable groups such as children, people with disabilities and other groups historically disadvantaged or exposed to risk of exclusion, and in situations characterized by asymmetries of power or information, by example between employers and workers, or between businesses and consumers.

Recognize and be aware that AI systems certainly bring considerable benefits to individuals and society, but that they also present certain risks and may have negative impacts, including impacts that may be difficult to anticipate, determine or to be measured (for example impacts on democracy, the rule of law and distributive justice, or on the human mind itself). Adopt appropriate measures to mitigate these risks, if appropriate, in a manner commensurate with the magnitude of the risk.9

Which brings us to fundamental human rights (HRs). Indeed, those recommendations underscore the link between AI and basic HRs, be they considered:

- In a naturalistic perspective, ie. human rights are rights possessed by all human beings (at all times and in all places), simply in virtue of their humanity.10

- In a legalistic perspective, ie, the existence of a series of law-making international instrument enumerating, analyzing, and clarifying generations of human rights such as The International Covenant on Economic, Social and Cultural Rights, The International Covenant on Civil and Political Rights and The Optional Protocol to the Covenant on Civil and Political Rights.11

- In a jurisprudential perspective fundamental human rights are rights that take precedence over all other rights as suggested by various authors,12,13 which in turn implies justiciability of HRs.14

These different perspectives help consider human rights as universally recognized and accepted principles that should allow everyone to realize his full potential of life in an environment of freedom, justice, security and peace.15

As for the link between AI and HRs, Liu and Zawieska in 2017 reported, while studying the impact of the reversal of power between human rights and new technologies on the protection of fundamental human rights (HRs) that artificial intelligence (AI) is on the cusp of exerting a growing influence for the promotion of HRs, as well as enhancing potential violation of HRs. They argued for a new set of HRs capable to deal with the robotics and the AI.16 In 2018, Chakraborty & Bhojwani critically analyzed the effects of AI on HRs under the angle of economic structures, labor relations, job, as well as worktime and remuneration models, which are all expected to undergo major changes due to an increased use of AI.17 Reisse studied similar aspects while taking a time perspective: the short-term effects relate to the use of discriminatory algorithms affecting nearly all the rights contained in the Universal Declaration of Human Rights (UDHR); the medium-term challenges notably include changes of working conditions, possibly excluding from work large parts of the population; on the long-run there is the perspective that humans might have to work (and live) with machines which are intellectually and morally superior to humans.18 Reisse insists upon the necessity of instigating more interest in AI within the human rights community.19

In an academic perspective, this raises several questions, notably:

First, what is the level of knowledge regarding the links between AI on HRs (and vice versa)?

Second, are there signs of the emergence of a new scientific discipline that encompasses AI and HRs?

Third, what are the conditions susceptible to strengthen research and action specifically addressing the link between AI and HRs?

Our study explores the linkages and reciprocal relationships between the AI and HRs and looks for signs of the emergence of a new discipline at the crossroads of these two disciplines through a systematic review of the scientific literature over the past decades.

Methods

Research Design and Strategy

The study is a systematic review of literature. The used search strategy is based on the well-established methodology referred to as Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) model and it unfolds in 4 steps:20

First, key words covering the two areas of research are identified as well as their synonyms and related concepts.

Second, a search strategy including the identified key words is formulated.

Third, this search strategy is applied with any relevant adaptation to the modalities or requirements of each database.

Fourth, the articles/publications obtained from the query of each database are pooled to generate a single file that can be used for detailed analyses.

In the present case, the search strategy (including the key words used) has been formulated as follows “artificial intelligence” or “robot” or “intelligent agent” or “machine learning” or “data mining” or “autonomous vehicles” or “autonomous weapons” or robotics or “artificial general intelligence” “super-intelligence” or “digital society” or “digital era” or “computer reasoning” or “machine intelligence” or “artificial intelligence system” AND “human rights” or “human right” or “civil rights” or “political rights” or “economic rights” or “social rights” or democracy or “fundamental rights” or “freedoms”.

The equation has been applied to a broad range of databases falling within the fields of legal sciences (LexisNexis, Westlaw and HeinOnline), of International Bibliography of the Social Sciences (IBSS), of health care sciences (Embase) and on the more general sciences practitioner base known as “Web of Science”.

The literature search was carried out by two groups of experts of the libraries of the Faculty of Medicine and of the Faculty of Social Sciences and Humanities of the University of Geneva between November 2019 and January 2020.

The research covered a period of 70 years from 1 January 1949 to 31 December 2019 and was limited to work published in English and French. The whole process is synthesized in Figure 1.

Figure 1

Research strategy and results.

Exclusion Criteria

A set of exclusion criteria to be applied were identified, ie: articles without abstract, press releases, newspaper editorials, technical reports, summaries of symposia, books, chapters, letters to the editor, glossaries, judicial decision, and duplicates.

Analyzing Process

Guided by the principles and best practices suggested by previous models,21 two of the authors (QS and EKM) designed a reading grid for each article. Based on this reading grid, the research team:

- Retained the year of publication, the names of the first author, the name of the journal, the country of residence of the first author such as identified or provided by the bibliographic references.

- Classified the journal in which the article was published in one or another of the pre-established categories which were Law journals, International Relations and Security journals, Human Rights journals, Ethics journals, journals of Sociology, engineering sciences journals, and others (biomedical and social insurance journals).

- Identified the design of each study through either self-contained indication in the title or any relevant classification made in the research database. The design of studies included review such as ethical, sociological, legal, political, epistemological, psychological, historical analyses as well as case studies, literature reviews and documentary analyses.

- Noted the major topics of AI addressed as well as the HRs mentioned.

- Created an Excel database containing, for each publication the elements of analysis presented above. One of the co-authors reviewed this database to prune any encoding error. The cleaned data were subsequently exported to IBM-SPSS 19.0 for descriptive analyses.

Results

A total of 157 articles met the inclusion criteria out of 1299 articles. No article prior to 1994 did. All but one were written in English. More than half of the articles were published between 2017 and 2019 (n = 90 or 57.3%). Approximately one-third (28%) had been published between 2014 and 2016, and 15.2% during the 1994–2013 period. The list of studied articles appears in .

Disciplinary Specifications

The distribution of these articles according to their disciplinary specification can be summed up as follows: approximately half of the studies (51.5%) were legal analyses, followed by political (16.5%) and by sociological studies (10.1%) whereas epistemological studies and literature reviews represent a smaller percentage (4% and 3.1% respectively). The remaining 14.8% include case studies as well as articles with a historical, psychological, or documentary perspective.

Journals Where Articles Have Been Published

Almost 7 articles out of 10 (68.1%) have been published in law journals; 10.8% in journals specialized in international relations and security; 7.6% in human rights journals. The remainder of the articles appeared in ethics, sociology, bio-medical, insurance and engineering journals.

Institutional Affiliation of First Author

Close to the half of all articles (46.4%) were written by authors affiliated to an US institution; 11.4% by author from the United Kingdom and 5.73% from the Netherlands. The remaining 36.3% include work by authors from 24 different countries.

Topics Studied

Regarding the research topics studied in the various articles, 24.8% have explored concerns related to autonomous weapon systems. The second group has focused on the issues related to the collection, storage, analysis and use of big data (15.9%). An approximative similar share of work (15.3%) has focused on the use of algorithms in decision-making processes in various life sectors (justice, medicine, finances …). The need for regulation has been studied in 12.1% of the papers. The issues related to robotics was discussed in 11.4% of the articles and the issues related to AI in the media in 10.2%. Further topics included mobility issues or intellectual property rights for example (Table 1).

Table 1

Topics Studied

Topics	(N)	(%)
Autonomous Weapon Systems	39	24, 8%
Big Data	25	15.9%
Algorithms	24	15.3%
Regulations	19	12.1%
Robots	18	11, 4%
Media	16	10, 2%
Self driving cars	7	4.5%
Intellectual property	6	3.8%
Geolocation	2	1.3%
Total	157	100%

Human Rights Addressed

The right to life (21.4%) and the right to security (19.4%) are the most frequently mentioned rights, followed by the right of the privacy (14.3%), and the right to justice (9.3%). Less frequently, the right to health (4.3%), the right to democratic participation (4.0%) or the right to non-discrimination (3.6%) and the protection of intellectual property (3.6%) have been discussed in the various articles (Table 2).

Table 2

Human Rights Addressed

Rights Addressed	(N)	(%)
Right to life	64	21.4%
Right to security/safety	58	19.4%
Protection of privacy	43	14.3%
The right to justice	28	9.3%
Right to health	13	4.3%
Right to democratic participation	12	4.0%
General (all rights)	12	4.0%
Non-discrimination	11	3.6%
Intellectual property	11	3.6%
Right to work	07	2.3%
Right to information	06	2.0%
Right to personal identity	06	2.0%
Freedom of movement	05	1.6%
Humanitarian rights	05	1.6%
Right of election and eligibility	03	1.0%
Freedom of expression	01	0.3%
Right to food	01	0.3%
Protection against torture	01	0.3%
Total	299	100%

Impact of AI on HRs

Analyzing the content of the studied articles showed that the impact of AI on HRs was twofold: on one hand, there were identified opportunities, on the other hand, clearly identified threats (Table 3).

Table 3

Impact of AI on HRs

Application Areas	Effects of AI	Protected Rights	Rights Under Threat
1. Agriculture	- Increased productivity- Increased food security- Improved food quality control	Right to life; Right to health,Right to security, right to work, Right to Dignity	Right to work, Right to HealthRight to Life, Right to Culture, Right to Dignity
2. Health and health care	- Improved diagnostics- Geographical access to care- Increased safety in care- Strengthening and precision in prevention- Improved quality control of care- Improving health promotion	Right to health; Right to lifeRight to information, right to work, Right to participate	Right to work, Right to HealthRight to Culture, Right to LifeRight to Non-Discrimination
3. Mobility	- Increased safety in transport- Decrease in transport accidents- Reducing mortality- Likely cost reductionAccessibility to economic, social and cultural goods	Freedom of movementRight to life, Right to Education, Right to Work, Right to Health, Right to Safety and Security, Right to Association and Meeting	Right to Life, Right to HealthRight to Non-DiscriminationFreedom of movement
4. Environment	- Refinement of predictions of natural disasters- Improved civil protection control- Improved environmental research- Contribution to the protection of sensitive environments- Helping justice in the face of environmental damage- Improved energy consumption	Right to Life, Right to the Environment, Right to Health, Right to Safety and Security, Right to Food, Right to Participation, Right to Information	Right to work, right to life, right to health
5. Governance and Democracy	- Strengthening the efficiency of public services- Accessibility of services and procedures- Better mobilization of resources and allocation- Effective state management control	Right to participation, right to information, Freedoms of expression, association and assembly	Privacy and data protection; Right to safety and security,Right to Life, Right to Dignity and Right to Non-Discrimination
6. Education and Training	- Increased personalization of education processes- Solutions to the challenges of lifelong learning- Progress in equity in training- Accessibility to training programs- Better contextualization of program content- New forms of student-teacher collaboration	Right to Education, Right to Participation, Right to Enjoy benefits of Science, Right to Work	Right to Non-DiscriminationRight to cultureRight to educationRight to work
7. Banks and Finance	- Improved access to banking and financial systems- Access to credit- Data reliability- Increased data processing capacity- Improved prevention of fraud.	Right to Education, Right to LifeRight to Health, Right to Work,Right to enjoy the benefits of science	Right to equal treatment before the lawRight to Non-DiscriminationRight to work, Freedom of association, demonstration or assembly, Freedom of opinion
8. Economy	- Increased productivity- Technological innovations and social transformations- Reducing social inequalities- Reducing the cost of producing goods and services- Automation of production processes	Right to Life, Right to Enjoy the Benefits of Science, Right to Work, Right to Food, Right to Health, Right to Education	Right to work, Right to safety and security of the person, Right to Non-discrimination
9. Arts	- Stimulating creativity in the arts (Music, painting…)- Democratization of access to works of mind- Massification of the production of works- Improved copyright management processes- Lower costs of producing works of art	Right to work; The right to participate in cultural life; Right to benefit from scientific progress and its applications; copyright	CopyrightRight of access to cultural propertyRight to Non-DiscriminationRight to work,
10. Human security	- Improving the prevention of security threats- Lower monitoring and response costs- Improved decision-making tools (crossing sources)- Saves time in enforcement of decisions- Decision tracking and accountability- Support for other sectors of social life (Justice…)	Right to life, right to life and security, right to work, right to development and right to peace, right to fair trial and due process of law	Right to life, right to life and safety,Right to Health, Right to Non- discrimination, right to work.

Discussion

To respond to the question of whether the results of our study reflect the emergence of AI & HRs as a scientific discipline, it is important to look first at the concept of discipline and at the conditions for the emergence of scientific disciplines in general as well as at the fundamental characteristics of a scientific discipline.

The Concept of Discipline

A discipline corresponds to the structuring of professional and research practices around paradigms, which means that the concept of discipline is closely linked to the production of new knowledge.21 A discipline can also be seen as an institutionalization of teaching and research as proposed by Affergan et Valade.22

The Concept of Emerging Discipline

From the point of view of the history and sociology of science, scientific disciplines emerge in different ways: some grow in niches within established disciplines; other develop on the margins of two or more disciplines; some result from schisms; other are the results of random encounters; some develop in response to external conditions; others surface because of new and changing techniques or technologies.23

In an analytical perspective, the conditions for the emergence of a scientific discipline relate to the main dimensions characterizing a given set of knowledge, ie:

a. Extending specialization and increasing scientific professionalization

b. A set of knowledge operating within social and scientific

c. Organization around a “scientific community” whose members are in competition to produce knowledge and to exercise a control (peer-review) on each other research and teaching

d. Possession of a “self-reference”: eg, widespread scientific recognition such as specific concepts and theories, specific glossaries, specific journals and books, citations by peers

e. Obtaining an academic recognition as a domain of research and teaching.24

For the time being, those conditions are not met by the domain “AI & HRs”. Indeed, it lacks specific academic recognition, demonstrates lack of professionalism, has only sparse specific research projects or teaching programs. Regarding training for example: teaching programs are rare, with but a few initiatives exist like the AI, HRs and migration program of the School of Law, at the Queen Mary London University25 or like the Master of Arts Human Rights in the Digital Society offered by the School of Governance, Law and Society of Tallinn University in Estonia.26

Data Related Considerations

Yet the present work shows that the seeds of a new scientific discipline have been planted and that it is important now to take care of this burgeoning tree and its emerging buds to ensure full disciplinary development through theoretical, organizational as well as institutional support and policies.

Topics Investigated

Indeed, the present study shows that there is a scientific literature covering various topics linking AI & HRs, such as automatic weapon systems or big data, but also intellectual property or geographic localization and that many basic human rights are concerned such as the right to life, the right to security, the right to privacy, the right to justice, but also the right to health and the right to non-discrimination.

For example, the issue of the development and use of automatic weapon systems, dealt with in 24.3% of the articles reviewed, can be linked to the considerations of Sychev who reports on a letter signed by 16,000 personalities from around the world sounding the alarm of the dangers that these automatic weapon systems represent for the civilian populations and even for the survival of humanity,27 thus potentially infringing the right to life.

Another example: Big data (analytics), dealt with in 16.0% of the reviewed articles, is another critical issue regarding human rights. It may, for example, create “inherent risks and tensions around privacy”,28 a fundamental human right. Indeed, as stated by some authors:

information technology is considered a major threat to privacy because it enables pervasive surveillance, massive databases, and lightning-speed distribution of information across the globe.29

Increased Numbers of Publications

The study also shows that there is an increasing scientific production over the decades with an exponential increase over the past five years, reflecting an increased research interest in investigating AI&HRs from researchers from various disciplines (law, sociology, philosophy, engineering, etc.). This increase is also closely correlated to the technical developments of AI and its applications as highlighted by Anand.30 A growing interest shown by national and international institutions for the effects of AI on labor, safety or democracy might also have contributed to it as outlined in the Villani Report of 201831 or in reports from various United Nations Agencies.32,33

The Type of Studies

Most articles were legal analyses. Interestingly 1 paper out of 6 (16.5%) reported effects of AI in politics: be it considering the impact of AI on electoral processes, on public administration, on national security or on international geostrategy, eg:

- The emergence of robots as candidates for elective office and the possible manipulation of results constitute/might constitute some serious threats to the foundations of democratic societies.34

- The implementation of new technologies (robotics, artificial intelligence) raises legitimate concerns about its impact on public employment for example.35

- The international order might be determined by AI for decades to come, technology and power mutually reinforcing each other; thus, possibly transforming geopolitics through new relationships between spatiotemporal dimensions and immateriality.36

Affiliations of Authors

Not surprisingly the majority of authors are affiliated to American and British academic institutions as has been reported in scientific publications in general by authors like Gupta et al (US authors representing 28.6% and British authors 8.9% of all science and technology publications);37 another factor possibly being the important AI investments made in the USA (445 billion euros in 2016) compared to other countries as reported by the Konrad Adenauer Foundation.38

Impact of AI on HRs and Vice-Versa

The extent of the potential impact of AI on HRs has been stressed in most analyzed papers, which is summed-up in Table 3. One could also argue that the respect of basic human rights might impact on the development and use/not use of AI: eg, the respect for the right to safety is an essential condition for the use of AI; the respect for the right to education enables the acquisition of the skills necessary to use AI in an appropriate way; failure to respect the right to information would constitute a barrier to the use of AI; infringements of freedoms of expression, association or assembly would limit the use of AI; and finally the failure to respect the right to work would potentially lead to the lack of income necessary for the acquisition and use of AI. The effects between AI & HRs thus appear as bidirectional and synergistic.

However, these rights cannot simply be conceived from a normative perspective as a set of regulations governing the relationship between the individual and the state or vis-à-vis other states, but rather from a holistic angle which encompasses a strong social dimension. If a social movement is defined as a collective entity constituted by individuals who understand themselves to share some common interest and who also identify with one another, at least to some extent, these characteristics are not sufficient to capture the full gamut of this concept. To be complete, one must consider social movements as chiefly concerned with defending or changing at least some aspects of society and as having a strong reliance on mass mobilization, or the threat of it, as their main political sanction.39 Human rights are therefore not only a movement within the meaning of, for example, the civil rights movement, but also a theory-based social practice influencing it.40–42

These HRs impact AI and, in return, AI impacts HRs. We apprehend and depict this web of relationships through Figure 2. This diagram shows HRs as occupying a central stage and AI as an evolving reality around HRs, a reality whose characteristics and dimensions, depending on AI life stage (creation, production, commercialization, and utilization) are envisioned as having an impact on HRs and are also getting some type of retro-feedback.

Figure 2

Conceptual framework of artificial intelligence and human rights and of their mutual and dynamic linkages.

Challenges and Prospects of a Research Agenda

The field of the AI and HRs is still in its infancy as evidenced by the results of this literature review. It is and will face many challenges that traditionally emerging disciplines have had to overcome, and which can be grouped as follows:

- The epistemological challenges related to the needs to create, assert, and consolidate its identity and unity as a scientific discipline and to clarify its fundamental concepts and delineate its scope of action. To this day, there is no accepted definition of this discipline which remains an important step in the construction of its identity and its unity. In the continuation of previous efforts39,42 in a neighboring field (health and human rights), the discipline of the AI and the HRs can be defined as a set of knowledge and multidisciplinary practices designed to analyze and to intervene in situations involving AI, human rights and social development, with the aim of improving the well-being of individuals and communities, by mobilizing the theoretical approaches and tools of several disciplines, including informatics, law, ethics, sociology, cognitive sciences and other sciences.

- The methodological challenges arising from the double origin of this new area (artificial intelligence science and legal and human rights sciences). This appears as a first obstacle to the construction of a common identity and to the advent of specific methods of the AI and HRs. This dualism has been highlighted by the review of the bulk of the studies we have analyzed; half of the studies being essentially of a legal nature, 25% of the others fall within the realm of humanities and social sciences. There are scant engineering studies that raise human rights issues.

- The challenges related to the institutionalization and professionalization, which are central concerns of stability of the research and training in this area. To day, there is neither a specialized research center in AI and HRs, nor an association or international network of professionals recognizing the links of their activities with this “discipline”. It is essential at this juncture to develop an approach demonstrating both the identity, the object, the methods, the schools of thought and especially the political and social usefulness which can justify the academic recognition of the discipline, the provision of resources and the legitimation of its activities.

- Communication issues arise in terms of organization and operation of pioneering and leading journals specific to the discipline that can contribute to dissemination of produced knowledge, provision of space of exchanges between theorists and practitioners, stimulation of the social discussion relating to the object of the discipline. To this day, journals covering societal debates related to artificial intelligence (eg, AI & Society: Knowledge, Culture and Communication, Frontiers in Artificial Intelligence), or law (European Journal of International Law, Yale Law Journal) and human rights (Human Rights Quarterly, Journal of Human Rights Practice) exist in which research on the AI and HRs may be published. To our knowledge however no scientific journal specifically dedicated to the link between AI/HRS exists.

- The challenge of the globalization of the research and experiences which is derived from the glaring imbalances between countries which are producers of technologies and those which are essentially consumers, and not represented in the countries where most of the research on AI and HRs are conducted. Among the 157 works analyzed in our study, 78 had been done by researchers from the USA whereas in comparison only 4 had been done by South African researchers, 1 by Russian and 1 by Brazilian; and this despite the fact that issues related to AI and HRs arise in those countries in a significant way.

In total, these five types of challenges may constitute strategic axes of a research agenda that can be detailed, developed, and enriched by research teams whose objectives cover the different themes identified in our review and those to come. One such objective would be an in-depth analysis at the legal level.

Conclusion

Our study has shown that this field of research at the crossroad between AI and HRs is not totally a “scientific desert”. It is rather a dynamic field where researchers from several disciplines have already been operating at various degrees around issues arising from the application of AI in society.

Issues related to autonomous lethal weapons, the protection of the private sphere, discriminatory decision-making in the insurance and finance systems, intellectual property or legal personality of robots represent major concerns in a HRs perspective.

The analysis of conditions for the development of this “emerging discipline” has revealed epistemological and methodological challenges, in addition to issues of institutionalization and communication to which suitable answers would need to be found to anchor and consolidate the new “AI and HRs” discipline as a full-fledged member among existing scientific disciplines.

Finally, the serious threats and astonishing opportunities43,44 that those technologies carry, require “sustained attention and a permanent monitoring” of reports between AI and HRs. This includes, but goes beyond mere commercialization of the technology.44 It is our common responsibility.