Volume 9 Number 3 (Mar. 2014)
Home > Archive > 2014 > Volume 9 Number 3 (Mar. 2014) >
JSW 2014 Vol.9(3): 634-640
doi: 10.4304/jsw.9.3.634-640

Statistics Based Q-learning Algorithm for Multi-Agent System and Application in RoboCup

Ya Xie , Zhonghua Huang

  • Hunan Institute of Engineering, Xiangtan, China

Abstract

This paper proposes statistic learning basedQ-learning algorithm for Multi-Agent System, theagent can learn other agents’ action policies throughobserving and counting the joint action, a concise butuseful hypothesis is adopted to denote the optimalpolicies of other agents, the full joint probability ofpolicies distribution guarantees the optimal actionchoice to the learning agent. The algorithm can alsoimprove the learning speed because the conventionalQ-learning space is cut from exponential one to linearone. The convergence of the algorithm has been proved;the successful application of this algorithm in theRoboCup shows its good learning performance.

Keywords

  • Q-learning
  • Statistics
  • Multi-agent
  • Rob
jsw0903-15

How to Cite

Copied

Ya Xie and Zhonghua Huang, "Statistics Based Q-learning Algorithm for Multi-Agent System and Application in RoboCup," Journal of Software, vol. 9, no. 3, pp. 634-640, 2014. https://doi.org/ 10.4304/jsw.9.3.634-640

Copyright & License

Copyright © 2014 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Article Metrics in Dimensions

General Information

  • ISSN: 1796-217X (Online)

  • Abbreviated Title: J. Softw.

  • Frequency:  Biannually

  • APC: 500USD

  • DOI: 10.17706/JSW

  • Editor-in-Chief: Prof. Antanas Verikas

  • Executive Editor: Ms. Cecilia Xie

  • Abstracting/ Indexing: DBLP, CNKI, 

  • Google Scholar, ProQuest,
           INSPEC(IET), ULRICH's Periodicals
           Directory, WorldCat, etc

  • E-mail: editor@jsoftware.us

  • Aug 27, 2026 News!

    Vol 21, No 1 has been published with online version

  • Mar 30, 2026 News!

    Vol 20, No 2 has been published with online version   [Click]

  • Apr 01, 2024 News!

    Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec)     [Click]

  • Apr 01, 2024 News!

    Papers published in JSW Vol 18, No 1- Vol 18, No 6 have been indexed by DBLP   [Click]

  • Mar 07, 2025 News!

    JSW had implemented online submission system   [Click]