Abstract
Random networks are widely used for modeling and analyzing complex processes. Many mathematical models have been proposed to capture diverse real-world networks. One of the most important aspects of these models is degree distribution. Chung–Lu (CL) model is a random network model, which can produce networks with any given arbitrary degree distribution. The complex systems we deal with nowadays are growing larger and more diverse than ever. Generating random networks with any given degree distribution consisting of billions of nodes and edges or more has become a necessity, which requires efficient and parallel algorithms. We present an MPI-based distributed memory parallel algorithm for generating massive random networks using CL model, which takes O(m+nP+P) time with high probability and O(n) space per processor, where n, m, and P are the number of nodes, edges and processors, respectively. The time efficiency is achieved by using a novel load-balancing algorithm. Our algorithms scale very well to a large number of processors and can generate massive power–law networks with one billion nodes and 250 billion edges in one minute using 1024 processors.
Original language | English |
---|---|
Pages (from-to) | 109-127 |
Number of pages | 19 |
Journal | International Journal of Parallel Programming |
Volume | 45 |
Issue number | 1 |
DOIs | |
State | Published - Feb 1 2017 |
Externally published | Yes |
Funding
This work has been partially supported by DTRA Grant HDTRA1-11-1-0016, DTRA CNIMS Contract HDTRA1-11-D-0016-0001, NSF NetSE Grant CNS-1011769, NSF SDCI Grant OCI-1032677, and NSF DIBBs Grant ACI-1443054.
Funders | Funder number |
---|---|
National Science Foundation | ACI-1443054, OCI-1032677, CNS-1011769 |
Keywords
- Massive Networks
- Network Generator
- Parallel Algorithms