Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective

Christian Cabrera; Andrei Paleyes; Pierre Thodoroff; Neil D. Lawrence

Back to publications

Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective

Christian Cabrera, Andrei Paleyes, Pierre Thodoroff, Neil D. Lawrence

, 2023.

Abstract

With the upsurge of interest in artificial intelligence machine learning (ML) algorithms, originally developed in academic environments, are now being deployed as parts of real-life systems that deal with large amounts of heterogeneous, dynamic, and high-dimensional data. Deployment of ML methods in real life is prone to challenges across the whole system life-cycle from data management to systems deployment, monitoring, and maintenance. Data-Oriented Architecture (DOA) is an emerging software engineering paradigm that has the potential to mitigate these challenges by proposing a set of principles to create data-driven, loosely coupled, decentralised, and open systems. However DOA as a concept is not widespread yet, and there is no common understanding of how it can be realised in practice. This review addresses that problem by contextualising the principles that underpin the DOA paradigm through the ML system challenges. We explore the extent to which current architectures of ML-based real-world systems have implemented the DOA principles. We also formulate open research challenges and directions for further development of the DOA paradigm.

Links

Cite this Paper

BibTeX


@Misc{publications/real-world-machine-learning-systems-a-survey-from-a-data-oriented-architecture-perspective,
  title = 	 {Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective},
  author = 	 {Cabrera, Christian and Paleyes, Andrei and Thodoroff, Pierre and Lawrence, Neil D.},
  year = 	 {2023},
  url = 	 {/publications/real-world-machine-learning-systems-a-survey-from-a-data-oriented-architecture-perspective.html},
  abstract = 	 {With the upsurge of interest in artificial intelligence machine learning (ML) algorithms, originally developed in academic environments, are now being deployed as parts of real-life systems that deal with large amounts of heterogeneous, dynamic, and high-dimensional data. Deployment of ML methods in real life is prone to challenges across the whole system life-cycle from data management to systems deployment, monitoring, and maintenance. Data-Oriented Architecture (DOA) is an emerging software engineering paradigm that has the potential to mitigate these challenges by proposing a set of principles to create data-driven, loosely coupled, decentralised, and open systems. However DOA as a concept is not widespread yet, and there is no common understanding of how it can be realised in practice. This review addresses that problem by contextualising the principles that underpin the DOA paradigm through the ML system challenges. We explore the extent to which current architectures of ML-based real-world systems have implemented the DOA principles. We also formulate open research challenges and directions for further development of the DOA paradigm.}
}

Endnote

%0 Generic
%T Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective
%A Christian Cabrera
%A Andrei Paleyes
%A Pierre Thodoroff
%A Neil D. Lawrence
%D 2023	
%F publications/real-world-machine-learning-systems-a-survey-from-a-data-oriented-architecture-perspective
%U /publications/real-world-machine-learning-systems-a-survey-from-a-data-oriented-architecture-perspective.html
%X With the upsurge of interest in artificial intelligence machine learning (ML) algorithms, originally developed in academic environments, are now being deployed as parts of real-life systems that deal with large amounts of heterogeneous, dynamic, and high-dimensional data. Deployment of ML methods in real life is prone to challenges across the whole system life-cycle from data management to systems deployment, monitoring, and maintenance. Data-Oriented Architecture (DOA) is an emerging software engineering paradigm that has the potential to mitigate these challenges by proposing a set of principles to create data-driven, loosely coupled, decentralised, and open systems. However DOA as a concept is not widespread yet, and there is no common understanding of how it can be realised in practice. This review addresses that problem by contextualising the principles that underpin the DOA paradigm through the ML system challenges. We explore the extent to which current architectures of ML-based real-world systems have implemented the DOA principles. We also formulate open research challenges and directions for further development of the DOA paradigm.

RIS


TY  - GEN
TI  - Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective
AU  - Christian Cabrera
AU  - Andrei Paleyes
AU  - Pierre Thodoroff
AU  - Neil D. Lawrence
DA  - 2023/02/09	
ID  - publications/real-world-machine-learning-systems-a-survey-from-a-data-oriented-architecture-perspective
UR  - /publications/real-world-machine-learning-systems-a-survey-from-a-data-oriented-architecture-perspective.html
AB  - With the upsurge of interest in artificial intelligence machine learning (ML) algorithms, originally developed in academic environments, are now being deployed as parts of real-life systems that deal with large amounts of heterogeneous, dynamic, and high-dimensional data. Deployment of ML methods in real life is prone to challenges across the whole system life-cycle from data management to systems deployment, monitoring, and maintenance. Data-Oriented Architecture (DOA) is an emerging software engineering paradigm that has the potential to mitigate these challenges by proposing a set of principles to create data-driven, loosely coupled, decentralised, and open systems. However DOA as a concept is not widespread yet, and there is no common understanding of how it can be realised in practice. This review addresses that problem by contextualising the principles that underpin the DOA paradigm through the ML system challenges. We explore the extent to which current architectures of ML-based real-world systems have implemented the DOA principles. We also formulate open research challenges and directions for further development of the DOA paradigm.
ER  -

APA


Cabrera, C., Paleyes, A., Thodoroff, P. & Lawrence, N.D.. (2023). Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective.  Available from /publications/real-world-machine-learning-systems-a-survey-from-a-data-oriented-architecture-perspective.html.