Details

Autor(en) / Beteiligte

• Le, Canyu
• Li, Xin

Titel

JigsawNet: Shredded Image Reassembly Using Convolutional Neural Network and Loop-Based Composition

Ist Teil von

• IEEE transactions on image processing, 2019-08, Vol.28 (8), p.4000-4015

Ort / Verlag

United States: IEEE

Erscheinungsjahr

2019

Link zum Volltext

• Volltext

Quelle

IEEE Xplore / Electronic Library Online (IEL)

Beschreibungen/Notizen

• This paper proposes a novel algorithm to reassemble an arbitrarily shredded image to its original status. Existing reassembly pipelines commonly consist of a local matching stage and a global compositions stage. In the local stage, a key challenge is to reliably compute correct pairwise matching, for which most existing algorithms use handcrafted features, and cannot reliably handle complicated puzzles. We build a deep convolutional neural network (CNN) to detect the compatibility of pairwise stitching, and use it to prune computed pairwise matches. To improve the network efficiency and accuracy, we transfer the calculation of CNN to the stitching region and apply a boost training strategy. In the global composition stage, instead of using the widely adopted greedy edge selection strategies, we propose two new loop closure-based searching algorithms. Extensive experiments show that our algorithm significantly outperforms existing methods on solving various puzzles, especially challenging ones with many fragment pieces.