Abstract:

[Objective] Face recognition, a basic technology in artificial intelligence applications, would be invalid due to the occlusion phenomenon. To improve the face recognition accuracy in the presence of partial occlusions, we propose a method to generate occluded regions of a face image automatically. [Context] The accuracy is the essential factor in face recognition applications. But its performance drastically decreases, and even to zero, when face images are occluded by objects such as helmets, glasses, and masks. [Methods] Taking image attributes into accounts, such as similarity, validity, and consistency, we present an improved generative adversarial network which is composed of one generator and two discriminators. To improve the stability and accuracy of the generator, the occluded part of the face generated by the generator is input to the local discriminator, and together with the original face image without the occluded part serve as the input to the globe discriminator. [Results] The experiments conducted on the LFW dataset show that the Structural Similarity (SSIM) of our method is 67% higher than DCGAN, and the Peak Signal to Noise Ratio (PSNR) is 40% higher. [Conclusions] The results show that prior conditions such as the similarity between pair images can improve the stability and convergence rate of a generator. In future work, a better network architecture that reduces interlayer loss would be proposed to improve the quality of generated images.

Key words: face inpainting, generative adversarial network, image fusion, convolutional neural network, loss function