Volume 13 Number 6 (Jun. 2018)
Home > Archive > 2018 > Volume 13 Number 6 (Jun. 2018) >
JSW 2018 Vol.13(6): 335-349 ISSN: 1796-217X
doi: 10.17706/jsw.13.6.335-349

Image Completion Based on Structure Reconstruction and Constraint

Jiexian Zeng, Xiang Fu*, Lu Leng, Liqin Zhan

Institute of Computer Vision, Nanchang Hangkong University, Nanchang, Jiangxi, 330063, China

Abstract—Important structures in a large area of a damaged image cannot be satisfactorily repaired by traditional inpainting algorithms. Here, an image completion algorithm based on structure reconstruction and constraint (SRC) is presented to improve the structural coherence of the damaged image. First, the damaged structure of the target image is detected and located. Then, different missing structures are respectively reconstructed. The edge structures are reconstructed by the Euler spiral, which satisfies energy minimization. The corner structure is reconstructed using the intersection of two extended Euler spirals. Finally, the reconstructed structure is used as a constraint condition to modify the priority of the image completion and to guide the texture propagation within the damaged part. The proposed method thereby resolves the problem of the corner structure being unable to be adequately repaired for current image inpainting methods. In addition to preserving the structural continuity, it also effectively avoids texture inconsistency. Experimental results show that the peak-signal-to-noise-ratio values of images recovered by the proposed method increased 3.43 to 12.85 dB. Moreover, compared to the content-aware fill algorithm and Criminisi algorithm, its mean square values decrease by 42.16% to 94.61%. The structure consistency, neighbor texture information coherence, neighbor and visual effect are better than those of the other algorithms. The presented algorithm is thus suitable to repair minor damage, such as a straight line or curving scratch, as well as large area damage, such as object removal in nature scenes and cultural relic images.

Index Terms—Image completion, structure reconstruction, structural coherence, Euler spiral.

[PDF]

Cite: Jiexian Zeng, Xiang Fu, Lu Leng, Liqin Zhan, "Image Completion Based on Structure Reconstruction and Constraint," Journal of Software vol. 13, no. 6, pp. 页码, 2018.

General Information

ISSN: 1796-217X (Online)
Frequency:  Quarterly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, CNKIGoogle Scholar, ProQuest, INSPEC(IET), ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsweditorialoffice@gmail.com
  • Mar 01, 2024 News!

    Vol 19, No 1 has been published with online version    [Click]

  • Apr 26, 2021 News!

    Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec)     [Click]

  • Nov 18, 2021 News!

    Papers published in JSW Vol 16, No 1- Vol 16, No 6 have been indexed by DBLP   [Click]

  • Jan 04, 2024 News!

    JSW will adopt Article-by-Article Work Flow

  • Nov 02, 2023 News!

    Vol 18, No 4 has been published with online version   [Click]