Volume 13 Number 6 (Jun. 2018)
Home > Archive > 2018 > Volume 13 Number 6 (Jun. 2018) >
JSW 2018 Vol.13(6): 335-349 ISSN: 1796-217X
doi: 10.17706/jsw.13.6.335-349

Image Completion Based on Structure Reconstruction and Constraint

Jiexian Zeng, Xiang Fu*, Lu Leng, Liqin Zhan
Institute of Computer Vision, Nanchang Hangkong University, Nanchang, Jiangxi, 330063, China

Abstract—Important structures in a large area of a damaged image cannot be satisfactorily repaired by traditional inpainting algorithms. Here, an image completion algorithm based on structure reconstruction and constraint (SRC) is presented to improve the structural coherence of the damaged image. First, the damaged structure of the target image is detected and located. Then, different missing structures are respectively reconstructed. The edge structures are reconstructed by the Euler spiral, which satisfies energy minimization. The corner structure is reconstructed using the intersection of two extended Euler spirals. Finally, the reconstructed structure is used as a constraint condition to modify the priority of the image completion and to guide the texture propagation within the damaged part. The proposed method thereby resolves the problem of the corner structure being unable to be adequately repaired for current image inpainting methods. In addition to preserving the structural continuity, it also effectively avoids texture inconsistency. Experimental results show that the peak-signal-to-noise-ratio values of images recovered by the proposed method increased 3.43 to 12.85 dB. Moreover, compared to the content-aware fill algorithm and Criminisi algorithm, its mean square values decrease by 42.16% to 94.61%. The structure consistency, neighbor texture information coherence, neighbor and visual effect are better than those of the other algorithms. The presented algorithm is thus suitable to repair minor damage, such as a straight line or curving scratch, as well as large area damage, such as object removal in nature scenes and cultural relic images.

Index Terms—Image completion, structure reconstruction, structural coherence, Euler spiral.


Cite: Jiexian Zeng, Xiang Fu, Lu Leng, Liqin Zhan, "Image Completion Based on Structure Reconstruction and Constraint," Journal of Software vol. 13, no. 6, pp. 页码, 2018.

General Information

ISSN: 1796-217X (Online)
Frequency:  Bimonthly (Since 2020)
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, Google Scholar, ProQuest, INSPEC(IET), ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Apr 26, 2021 News!

    Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec)     [Click]

  • Jun 22, 2020 News!

    Papers published in JSW Vol 14, No 1- Vol 15 No 4 have been indexed by DBLP     [Click]

  • Sep 13, 2021 News!

    The papers published in Vol 16, No 6 have all received dois from Crossref    [Click]

  • Jan 28, 2021 News!

    [CFP] 2021 the annual meeting of JSW Editorial Board, ICCSM 2021, will be held in Rome, Italy, July 21-23, 2021   [Click]

  • Sep 13, 2021 News!

    Vol 16, No 6 has been published with online version     [Click]