Towards Using SCTP as a Data Transport Protocol for Data-Intensive Batch Jobs

Abstract

Abstract-In this paper we investigate the usage of the Stream Control Transmission Protocol (SCTP) as a data transport protocol for client-initiated data-intensive computations. The considered environment consists of job schedulers, storage nodes, computational nodes (workers) and clients. The clients submit jobs to the schedulers, which split them into multiple computation units and schedule these computations on the available workers. The data which needs to be processed by the computation units will be transferred from the storage nodes to the computational nodes using SCTP. Experimental evaluations considered images as the data to be processed and simple image processing operations as computations.