doi: 10.4304/jsw.8.4.987-994
Object Detection based on Combination of Visible and Thermal Videos using A Joint Sample Consensus Background Model
2Northeastern University at Qinhuangdao, Qinhuangdao, China
Abstract—In uncontrolled video surveillance environments, performing efficient foreground segmentation is very challenging. In order to improve robustness and accuracy of object detection, we take advantage of spectral information of both visible and thermal videos. This paper presents a novel joint background model combining visible and thermal videos for foreground object detection in complex scenarios. Different from traditional methods that first detected moving objects in either domain respectively and then fused the detection results, we provide a joint sample consensus background model with four channels (red, green, blue and thermal) to accomplish the object detection and fusion of complementary information simultaneously, which lowers the computational cost of our method. Raw foreground segmentation is obtained in the thermal domain, making initial foreground more accurate. Meantime this can enhance the efficiency of further steps. Time out map (TOM) is utilized to deal with the problem that a newly exposed background is wrongly marked as foreground for a long time. In the updating phase, unlike most sample-based methods using first-in first-out policy, we intentionally employ a random update policy to reserve some older samples. That is, when a pixel is classified as background, we randomly pick up one of the background samples stored for the corresponding pixel to discard. In this manner, the backgrounds, occluded by slow moving foreground or temporally still foreground, can be recovered promptly when they reappear. Experimental results show that the proposed method can achieve accurate and precise detection results.
Index Terms—Object Detection, joint sample consensus, visible and thermal videos, background model, time out map, random update.
Cite: Guang Han, Xi Cai, Jinkuan Wang, "Object Detection based on Combination of Visible and Thermal Videos using A Joint Sample Consensus Background Model," Journal of Software vol. 8, no. 4, pp. 987-994, 2013.
General Information
ISSN: 1796-217X (Online)
Abbreviated Title: J. Softw.
Frequency: Quarterly
APC: 500USD
DOI: 10.17706/JSW
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Cecilia Xie
Abstracting/ Indexing: DBLP, EBSCO,
CNKI, Google Scholar, ProQuest,
INSPEC(IET), ULRICH's Periodicals
Directory, WorldCat, etcE-mail: jsweditorialoffice@gmail.com
-
Jun 12, 2024 News!
Vol 19, No 2 has been published with online version [Click]
-
Jan 04, 2024 News!
JSW will adopt Article-by-Article Work Flow
-
Apr 01, 2024 News!
Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec) [Click]
-
Apr 01, 2024 News!
Papers published in JSW Vol 18, No 1- Vol 18, No 6 have been indexed by DBLP [Click]
-
Mar 01, 2024 News!
Vol 19, No 1 has been published with online version [Click]