Volume 9 Number 9 (Sep. 2014)
Home > Archive > 2014 > Volume 9 Number 9 (Sep. 2014) >
JSW 2014 Vol.9(9): 2366-2377 ISSN: 1796-217X
doi: 10.4304/jsw.9.9.2366-2377

High-accuracy Optimization by Parallel Iterative Discrete Approximation and GPU Cluster Computing

Di Zhao
Center for Cognitive and Brain Science, The Ohio State University; College of Medicine, The Ohio State University Columbus, OH 43210

Abstract—High-accuracy optimization is the key component of time-sensitive applications in computer sciences such as machine learning, and we develop single-GPU Iterative Discrete Approximation Monte Carlo Optimization (IDAMCS) and multi-GPU IDA-MCS in our previous research. However, because of the memory capability constrain of GPUs in a workstation, single-GPU IDA-MCS and multi- GPU IDA-MCS may be in low performance or even functionless for optimization problems with complicated shapes such as large number of peaks. In this paper, by the novel idea of parallelizing Iterative Discrete Approximation with CUDA-MPI programming, we develop the GPU cluster version (GPU-cluster) of IDA-MCS with two different parallelization strategies: Domain Decomposition and Local Search, under the style of Single Instruction Multiple Data by CUDA 5.5 and MPICH2, and we exhibit the performance of GPU-cluster IDA-MCS by optimizing complicated cost functions. Computational results show that, by the same number of iterations, for the cost function with millions of peaks, the accuracy of GPU-cluster IDA-MCS is approximately thousands of times higher than that of the conventional method Monte Carlo Search. Computational results also show that, the optimization accuracy from Domain Decomposition IDA-MCS is much higher than that of Local Search IDA-MCS.

Index Terms—GPU Cluster Computing; CUDA-MPI Programming; Iterative Discrete Approximation; Highaccuracy Optimization; Domain Decomposition; Local Search


Cite: Di Zhao, "High-accuracy Optimization by Parallel Iterative Discrete Approximation and GPU Cluster Computing," Journal of Software vol. 9, no. 9, pp. 2366-2377, 2014.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Dec 06, 2019 News!

    Vol 14, No 1- Vol 14, No 4 has been indexed by EI (Inspec)   [Click]

  • Nov 18, 2019 News!

    Papers published in JSW Vol 14, No 1- Vol 14 No 10 have been indexed by DBLP     [Click]

  • Dec 06, 2019 News!

     Vol 13, No 10- Vol 13, No 12 has been indexed by EI (Inspec)   [Click]

  • Aug 01, 2018 News!

    [CFP] 2020 the annual meeting of JSW Editorial Board, ICCSM 2020, will be held in Rome, Italy, July 17-19, 2020   [Click]

  • Jun 25, 2019 News!

    Vol.13, No.9 has been indexed by EI (Inspec).   [Click]