Details

Autor(en) / Beteiligte

• B., Yogameena
• Jakkamsetti, Geeta
• S., Aishwarya

Titel

SpyGAN sketch: Heterogeneous Face Matching in video for crime investigation

Ist Teil von

• Journal of visual communication and image representation, 2022-01, Vol.82, p.103400, Article 103400

Ort / Verlag

Elsevier Inc

Erscheinungsjahr

2022

Link zum Volltext

Quelle

Alma/SFX Local Collection

Beschreibungen/Notizen

• Automatic retrieval of faces from videos based on query images effectively helps during the investigation. When the suspect’s image is unavailable, a face sketch, drawn based on eyewitness’s memory recollection, is used to search against photos. Present research works primarily focus on Heterogeneous Face Matching (HFM) sketches to mugshot images in databases. This paper proposes a sketch-face matching in a video that includes profile faces, different illumination, and poses, using a new Generative Adversarial Network called SpyGAN. Faces in the video detected using YOLOv3 are converted into realistic sketches by the proposed SpyGAN focusing on key facial regions. The generated sketches are represented using PCA-SIFT descriptors and are matched based on the cosine distance metric. Experimental results show that the proposed methodology has achieved an accuracy of 88.9% on the Chokepoint dataset and 78% on the OWN Short face-video linked dataset and has demonstrated effectiveness over the state-of-the-art methods. [Display omitted] •An end-to-end solution for sketch-face heterogeneous matching.•A novel Spy-GAN is proposed for the Sketch synthesis of faces detected in the video.•A new video dataset (TCE short face-video) and query sketches are created.•Challenges such as low-resolution partial occlusion are handled.