End-to-end trustworthy ML for multidomain operations

Abstract

In this article, we present SFMLOps, a Security Framework for Machine Learning Operations (MLOps), a comprehensive and novel approach to securing MLOps pipelines in multi-domain operations. SFMLOps can be used to benchmark security in mobile cyber-physical systems like quadruped reconnaissance robots, unmanned autonomous vehicles, and wearable brain-computer interfaces. Our framework examines and categorizes potential attack surfaces and threats within MLOps, offering countermeasures and their effectiveness for various aspects such as data storage, communication channels, model training, and model predictions. We provide security engineers practical guidance on developing secure MLOps pipelines. We introduced a secure pipeline design, MLPipeSec, based on a publisher-subscriber model and implemented on the JointForceNet+ Blockchain to ensure end-to-end trustworthiness across the MLOps pipeline. To evaluate the impact of security parameters on a multi-domain computer vision task, we compared several frameworks for their security and performance using the CIFAR-10 dataset. We also investigated Gossip Learning as a federated learning framework in conjunction with Google Cloud Platform and introduced a new federated learning model, VizFedML. Our experimental results demonstrate the efficacy of the SFMLOps framework and the MLPipeSec design in mitigating a range of vulnerabilities and weaknesses associated with MLOps, contributing to the development of more secure and robust machine learning systems.