Sie befinden Sich nicht im Netzwerk der Universität Paderborn. Der Zugriff auf elektronische Ressourcen ist gegebenenfalls nur via VPN oder Shibboleth (DFN-AAI) möglich. mehr Informationen...
Improving the Quality of Sound Recovered Using the Visual Microphone with Frame-wise Image Denoising Preprocessing
Ist Teil von
Journal of physics. Conference series, 2020-08, Vol.1627 (1), p.12024
Ort / Verlag
Bristol: IOP Publishing
Erscheinungsjahr
2020
Quelle
EZB Electronic Journals Library
Beschreibungen/Notizen
The visual microphone is a passive remote sound recovery technique by analysing subtle vibrations in a video of an object vibrating due to sound. Multiple research endeavours have been done in improving the quality of the recovered sound, but so far none has been done on investigating the effect of denoising the videos frame by frame prior to the sound recovery using the visual microphone. This work fills in that gap, and evaluates the quality of the recovered sound based on human intelligibility metrics and simple signal-to-noise ratio metrics. Our best results indicated performing image denoising before sound recovery can reduce the noise power by up to 47.16 %, increase the intelligibility by 9.11 % and signal-to-noise ratio by 17.97 %. It is important to perform image denoising before sound recovery when the recorded videos are very noisy.