A Two-Tier Partition Algorithm for the Optimization of the Large-Scale Simulation of Information Diffusion in Social Networks

Abstract

As online social networks play a more and more important role in public opinion, the large-scale simulation of social networks has been focused on by many scientists from sociology, communication, informatics, and so on. It is a good way to study real information diffusion in a symmetrical simulation world by agent-based modeling and simulation (ABMS), which is considered an effective solution by scholars from computational sociology. However, on the one hand, classical ABMS tools such as NetLogo cannot support the simulation of more than thousands of agents. On the other hand, big data platforms such as Hadoop and Spark used to study big datasets do not provide optimization for the simulation of large-scale social networks. A two-tier partition algorithm for the optimization of large-scale simulation of social networks is proposed in this paper. First, the simulation kernel of ABMS for information diffusion is implemented based on the Spark platform. Both the data structure and the scheduling mechanism are implemented by Resilient Distributed Data (RDD) to simulate the millions of agents. Second, a two-tier partition algorithm is implemented by community detection and graph cut. Community detection is used to find the partition of high interactions in the social network. A graph cut is used to achieve the goal of load balance. Finally, with the support of the dataset recorded from Twitter, a series of experiments are used to testify the performance of the two-tier partition algorithm in both the communication cost and load balance.

User Behavior on Online Social Networks: Relationships among Social Activities and Satisfaction

“…Social networks are part of the everyday lives of people around the world; they are used for a multitude of purposes, considering the typology of the industry, from communication to informatics, and other fields [3]. As mentioned, the primary objective of this study was to assess, by using structural equation modeling, the link between SNS use and the level of satisfaction, in particular among young people.…”

“…Moreover, social networking sites (SNSs) have become extremely popular, not only during critical global situations but also more broadly, due to their general communication features that allow both online interpersonal interactions to occur, as well as providing the opportunity to engage in conversations with people who share the same interests. Many scientists from the fields of sociology, communication, informatics, and so on have been focused on online social network research [3]. In recent years, SNSs have expanded from computer sites to smart-phone applications, beginning to exert an even more profound influence on the social lives and economic activities of many people [4].…”

A Comprehensive Study of Load Balancing Approaches in Real-Time Multi-Core Systems for Mixed Real-Time Tasks

“…Partitioning [14,15,16,17,18] is a load-balancing technique that involves dividing the system's workload into smaller, manageable partitions, each assigned to different processing units (e.g., cores, processors, or nodes). Work done by Gracioli et al [19] discusses the implementation of partitioningbased scheduling algorithms on hard real-time tasks.…”

“…Energy Consumption: Work done by Chen et al [17] utilizes energy consumption as a performance indicator to assess the amount of energy needed by each core to process the job set. The energy consumption of a core can be modeled as…”