Volume 13 Number 6 (Jun. 2018)
Home > Archive > 2018 > Volume 13 Number 6 (Jun. 2018) >
JSW 2018 Vol.13(6): 335-349 ISSN: 1796-217X
doi: 10.17706/jsw.13.6.335-349

Image Completion Based on Structure Reconstruction and Constraint

Jiexian Zeng, Xiang Fu*, Lu Leng, Liqin Zhan
Institute of Computer Vision, Nanchang Hangkong University, Nanchang, Jiangxi, 330063, China

Abstract—Important structures in a large area of a damaged image cannot be satisfactorily repaired by traditional inpainting algorithms. Here, an image completion algorithm based on structure reconstruction and constraint (SRC) is presented to improve the structural coherence of the damaged image. First, the damaged structure of the target image is detected and located. Then, different missing structures are respectively reconstructed. The edge structures are reconstructed by the Euler spiral, which satisfies energy minimization. The corner structure is reconstructed using the intersection of two extended Euler spirals. Finally, the reconstructed structure is used as a constraint condition to modify the priority of the image completion and to guide the texture propagation within the damaged part. The proposed method thereby resolves the problem of the corner structure being unable to be adequately repaired for current image inpainting methods. In addition to preserving the structural continuity, it also effectively avoids texture inconsistency. Experimental results show that the peak-signal-to-noise-ratio values of images recovered by the proposed method increased 3.43 to 12.85 dB. Moreover, compared to the content-aware fill algorithm and Criminisi algorithm, its mean square values decrease by 42.16% to 94.61%. The structure consistency, neighbor texture information coherence, neighbor and visual effect are better than those of the other algorithms. The presented algorithm is thus suitable to repair minor damage, such as a straight line or curving scratch, as well as large area damage, such as object removal in nature scenes and cultural relic images.

Index Terms—Image completion, structure reconstruction, structural coherence, Euler spiral.

[PDF]

Cite: Jiexian Zeng, Xiang Fu, Lu Leng, Liqin Zhan, "Image Completion Based on Structure Reconstruction and Constraint," Journal of Software vol. 13, no. 6, pp. 页码, 2018.

General Information

ISSN: 1796-217X
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jsw@iap.org
  • Sep 21, 2018 News!

    Papers published in JSW Vol. 13, No. 1- Vol. 13 No. 8 have been indexed by DBLP.    [Click]

  • Aug 24, 2018 News!

    Vol.12, No.8- Vol.13, No.5 has been indexed by EI (Inspec).   [Click]

  • Aug 01, 2018 News!

    [CFP] 2018 the annual meeting of JSW Editorial Board, ICSTE 2018, will be held in Kuala Lumpur, Malaysia, October 27-29, 2018.   [Click]

  • Aug 24, 2018 News!

    The papers published in Vol.13, No. 8 have all received dois from Crossref.

  • Sep 21, 2018 News!

    Vol 13, No. 9 has been published with online version 4 original aritcles from 3 countries are published in this issue.     [Click]