Volume 9 Number 7 (Jul. 2014)
Home > Archive > 2014 > Volume 9 Number 7 (Jul. 2014) >
JSW 2014 Vol.9(7): 1876-1885 ISSN: 1796-217X
doi: 10.4304/jsw.9.7.1876-1885

A Parallel Computing Method for Community Structure Detection Based on BSP Model

Yi Sun, Zhen Hua, Li-hui Zou
School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China 100083; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China100083

Abstract—Since the conventional algorithm for community structure detection in a stand-alone environment cannot handle the giant network whose number of nodes is more than 105, and the widely used MapReduce method has a limitation on dealing with excessive I/O operations during the iterative process, an efficient parallel computing method based on BSP (Bulk Synchronous Parallel) model for detecting community structure is proposed in this paper. The Fast Newman method is improved into parallel calculations with multiple steps under the framework of BSP model. It is more efficient to discover community structures in the large scale network. In order to testify the performance of the proposed method, a hama platform was built up on the same cluster of the hadoop platform. And a dataset, at a scale of 106, was also simulated for the experiments. It is approved that the proposed method is not only able to solve the issue of memory overrun in the conventional calculation on a stand-alone computer, but also to improve the performance effectively comparing to the MapReduce model. The proposed method has high practical value in large scale networks.

Index Terms—complex networks, graph clustering, modularity, Fast-Newman algorithm, BSP model

[PDF]

Cite: Yi Sun, Zhen Hua, Li-hui Zou, "A Parallel Computing Method for Community Structure Detection Based on BSP Model," Journal of Software vol. 9, no. 7, pp. 1876-1885, 2014.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Aug 21, 2019 News!

    Papers published in JSW Vol 14, No 1- Vol 14 No 8 have been indexed by DBLP     [Click]

  • Jun 25, 2019 News!

    Vol.13, No.9 has been indexed by EI (Inspec).   [Click]

  • Aug 01, 2018 News!

    [CFP] 2020 the annual meeting of JSW Editorial Board, ICCSM 2020, will be held in Rome, Italy, July 17-19, 2020   [Click]

  • Jul 10, 2019 News!

    Vol 14, No.8 has been published with online version 4 original aritcles from 2 countries are published in this issue.    [Click]

  • Sep 12, 2019 News!

    Vol 14, No 10 has been published with online version 4 original aritcles from 2 countries are published in this issue      [Click]