| Literature DB >> 35464171 |
Emmanouil Papagiannidis1, Ida Merete Enholm1, Chirstian Dremel1, Patrick Mikalef1, John Krogstie1.
Abstract
In recent years artificial intelligence (AI) has been seen as a technology with tremendous potential for enabling companies to gain an operational and competitive advantage. However, despite the use of AI, businesses continue to face challenges and are unable to immediately realize performance gains. Furthermore, firms need to introduce robust AI systems and mitigate AI risks, which emphasizes the importance of creating suitable AI governance practices. This study, explores how AI governance is applied to promote the development of robust AI applications that do not introduce negative effects, based on a comparative case analysis of three firms in the energy sector. The study illustrates which practices are placed to produce knowledge that assists with decision making while at the same time overcoming barriers with recommended actions leading to desired outcomes. The study contributes by exploring the main dimensions relevant to AI's governance in organizations and by uncovering the practices that underpin them.Entities:
Keywords: AI challenges and outcomes; AI data governance; AI governance; Competitive advantage; Performance gains
Year: 2022 PMID: 35464171 PMCID: PMC9018249 DOI: 10.1007/s10796-022-10251-y
Source DB: PubMed Journal: Inf Syst Front ISSN: 1387-3326 Impact factor: 5.261
Overview of companies
| Company A | Company B | Company C | |
|---|---|---|---|
| Country | Norway | Norway | Norway |
| Sector | Energy | Energy | Energy |
| Employees | 200 | 530 | 100 |
| Turnover 2020 | 180 million dollars | 260 million dollars | 23 million dollars |
| AI Vision | Use AI to become one of the top players in the market | Use AI to increase flexibility and business capabilities | Create AI products that are customer oriented and boosts customer value |
| AI Technologies | Both cloud and local ML pipelines combined with intelligence dashboards – Python, Grafana | ML pipelines combined with intelligence dashboards – Python, Grafana, Power BI | ML pipelines combined with intelligence dashboards – Python, Grafana, Tableau |
Responders’ role and length of interviews
| Firm | Respondent | Role | Years in firm | Interview time |
|---|---|---|---|---|
| A | 1 | Chief AI officer | 3 | 90 min |
| 2 | AI Software Developer | 3 | 55 min | |
| 3 | Machine Learning Engineer | 3 | 45 min | |
| 4 | AI Software Developer | 3 | 43 min | |
| 5 | Project Manager | 4 | 49 min | |
| 6 | Machine Learning Engineer | 3 | 35 min | |
| 7 | Machine Learning Engineer | 3 | 45 min | |
| B | 1 | Data Analyst | 9 | 49 min |
| 2 | Head of AI department | 1 | 25 min | |
| 3 | Head of Data Analytics department | 4.5 | 59 min | |
| 4 | Digitalization Engineer | 10 | 55 min | |
| 5 | Head of Digitalization department | 2 | 43 min | |
| C | 1 | Data Scientist | 2 | 65 min |
| 2 | Head of Analytics department | 3 | 60 min | |
| 3 | Operation Manager | 3 | 60 min |
Nodes and possible items under each node
| Dimension | Definition |
|---|---|
| Procedural | Practices associated with data migration, system messages, documentation and processes for expansion, dynamic model selection, pipeline evaluation, human and AI interaction, data quality sources |
| Relational | Practices that deal with employees and communicating goals, domain experts, AI education for employees |
| Structural | Practices associated with IT, optimization and automation, AI automation, ML pipelines, data access |
| AI culture | Understanding of AI capabilities, AI-phobia, Trust issues against AI |
AI architecture Legal regulations Domain challenges Adoption problems Competitive Advantage Flexibility Cost maintenance Scaling up Superior AI results | Development best practices, cloud infrastructure, unified tools GDPR, legal constrains of AI use Data challenges, domain knowledge, external challenges Fear of losing position Developing unique AI strategy, keep AI knowledge in house Cloud services boost flexibility Minimize costs from various operations AI assists in scaling up without needing more resources Internal AI teams can give high value through solutions that are targeted in a specific problem and not generalized |
Nodes and grouped observations (sample) based on the interviews
| Node | Observations | Code |
|---|---|---|
| Procedural | Having a backup [offline] AI model is recommended | Backup offline ML pipelines |
| Use AI platforms mostly for deploying models | Build intelligence on top of external AI services | |
| Correct the source data not the cleaning process | Data quality sources | |
| understand concepts not just data | Data quality sources | |
| Create dashboards for monitoring actions and results | Enable human—AI interaction | |
| Create AI products that do one task | Create weak AI applications | |
| Ensemble models to maximize the output | Dynamic model selection | |
| Relational | Onboard training processes | AI education for employees |
| Operators should understand what the model is (and not) capable of predicting | AI education for employees | |
| Read data from different vendors to increase quality of model | Data vendors | |
| Domain experts take lead of a project to ensure quality of the final product | Domain experts lead projects | |
| Hire external consultants to predict the value of the project or help with specific cloud technologies | AI consultants | |
| Explain to customers AI decisions | Explainable AI | |
| Structural | Automate operations that take place 24–7 | AI Automation |
| Repetitive and boring tasks should be automated | AI Automation | |
| AI solutions that focus on a very specific problem perform much better than generalized AI solutions | Locus of AI strategy | |
| Allocate required resources and create plan for AI development | Locus of AI strategy | |
| Access data through intranet for security reasons | Intranet data access | |
| No clear roles who is responsible for data management | Data ownership responsibilities | |
| Data transformation process has been standardized | ML pipelines |
Challenges, recommended actions and desired outcomes
| Challenges | Recommended actions | Outcomes | |
|---|---|---|---|
| Development | AI cloud is challenging to build | Offline recommendation system Develop intelligence on top of external platforms | Boost flexibility |
| AI development does not follow necessarily traditional software development | Standardized executable components Unify technological tools Create shared libraries | Robustness Reduce amount of workload | |
| Prediction techniques vary based on sector | Allow human interaction in high uncertainty to prevent high AI bias | Robustness | |
| Lack of data | Choose AI algorithms based on data volume and data types Generate data from existing data Read data from different sources Buy data from vendors using APIs | Boost flexibility Robustness | |
| Lack of domain knowledge by AI developers | Allow domain experts to lead | Save money and time Robustness | |
| Employees | Misunderstand of AI capabilities | AI training to understand what the models can do and what cannot do | Better communication between departments Easier adoption of AI |
| Employees do not adopt AI | AI training to understand how to use the new technologies | Better communication between departments Easier adoption of AI | |
| Employee’s fear losing their position because of AI | AI training to explain why their expertise cannot be replaced | Better communication between departments Easier adoption of AI | |
| Different vocabulary for different departments | AI training to be familiar with different terms and processes Create different dashboards for different concepts | Better communication between departments Easier adoption of AI Measure performance | |
| Value | Classical optimization tools are still better than AI models | Automate operations that 1. take place 24–7 2. there is a 1–1 correlation between workload and number of employees 3. are repetitive and boring document code and process | Save money and time Scaling up becomes easier Reduce amount of workload |
| Hard to predict effort and costs | Avoid nice to have features as they will delay the whole process considerable use KPIs to quantify performance | Save money and time Scaling up becomes easier | |
| External environment | Giving out knowledge to external partners | Develop intelligence on top of external platforms instead of using external solutions | Maintain competitive advantage |
| Distance with third parties can affect development | Develop internal AI team to speed up processes considerably | AI Development is focused on your specific problem not to a generic solution maintain competitive advantage | |
| Legal constrains and GDPR | Create clear data management roles | Security |
Fig. 1Proposed model