Search Results - "Mukhopadhyay, Rudrabha"

Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis by Prajwal, K R, Mukhopadhyay, Rudrabha, Namboodiri, Vinay P., Jawahar, C.V.

“…Humans involuntarily tend to infer parts of the conversation from lip movements when the speech is absent or corrupted by external noise. In this work, we…”
Get full text

Audio-Visual Face Reenactment by Agarwal, Madhav, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C V

“…This work proposes a novel method to generate realistic talking head videos using audio and visual streams. We animate a source image by transferring head…”
Get full text

FaceOff: A Video-to-Video Face Swapping System by Agarwal, Aditya, Sen, Bipasha, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C V

“…Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays…”
Get full text

Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale by Agarwal, Aditya, Sen, Bipasha, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C V

“…Many people with some form of hearing loss consider lipreading as their primary mode of day-to-day communication. However, finding resources to learn or…”
Get full text

Towards Generating Ultra-High Resolution Talking-Face Videos with Lip synchronization by Gupta, Anchit, Mukhopadhyay, Rudrabha, Balachandra, Sindhu, Khan, Faizan Farooq, Namboodiri, Vinay P., Jawahar, C. V.

“…Talking-face video generation works have achieved state-of-the-art results in synthesizing videos with lip synchronization. However, most of the previous works…”
Get full text

Visual Speech Enhancement Without A Real Visual Stream by Hegde, Sindhu B, Prajwal, K R, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C.V.

“…In this work, we re-think the task of speech enhancement in unconstrained real-world environments. Current state- of-the-art methods use only the audio stream…”
Get full text

2D-3D CNN Based Architectures for Spectral Reconstruction from RGB Images by Koundinya, Sriharsha, Sharma, Himanshu, Sharma, Manoj, Upadhyay, Avinash, Manekar, Raunak, Mukhopadhyay, Rudrabha, Karmakar, Abhijit, Chaudhury, Santanu

“…Hyperspectral cameras are used to preserve fine spectral details of scenes that are not captured by traditional RGB cameras that comprehensively quantizes…”
Get full text

NTIRE 2018 Challenge on Spectral Reconstruction from RGB Images by Arad, Boaz, Liu, Dong, Wu, Feng, Lanaras, Charis, Galliani, Silvano, Schindler, Konrad, Stiebel, Tarek, Koppers, Simon, Seltsam, Philipp, Zhou, Ruofan, El Helou, Majed, Ben-Shahar, Ohad, Lahoud, Fayez, Shahpaski, Marjan, Zheng, Ke, Gao, Lianru, Zhang, Bing, Cui, Ximin, Yu, Haoyang, Can, Yigit Baran, Alvarez-Gila, Aitor, van de Weijer, Joost, Timofte, Radu, Garrote, Estibaliz, Galdran, Adrian, Sharma, Manoj, Koundinya, Sriharsha, Upadhyay, Avinash, Manekar, Raunak, Mukhopadhyay, Rudrabha, Sharma, Himanshu, Chaudhury, Santanu, Nagasubramanian, Koushik, Van Gool, Luc, Ghosal, Sambuddha, Singh, Asheesh K., Singh, Arti, Ganapathysubramanian, Baskar, Sarkar, Soumik, Zhang, Lei, Yang, Ming-Hsuan, Xiong, Zhiwei, Chen, Chang, Shi, Zhan

“…This paper reviews the first challenge on spectral image reconstruction from RGB images, i.e., the recovery of whole-scene hyperspectral (HS) information from…”
Get full text

Audio-Visual Face Reenactment by Agarwal, Madhav, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C V

“…This work proposes a novel method to generate realistic talking head videos using audio and visual streams. We animate a source image by transferring head…”
Get full text

Towards Accurate Lip-to-Speech Synthesis in-the-Wild by Hegde, Sindhu, Mukhopadhyay, Rudrabha, Jawahar, C. V, Namboodiri, Vinay

“…In Proceedings of the 31st ACM International Conference on Multimedia, 2023 In this paper, we introduce a novel approach to address the task of synthesizing…”
Get full text

Compressing Video Calls using Synthetic Talking Heads by Agarwal, Madhav, Gupta, Anchit, Mukhopadhyay, Rudrabha, Namboodiri, Vinay P, Jawahar, C V

“…We leverage the modern advancements in talking head generation to propose an end-to-end system for talking head video compression. Our algorithm transmits…”
Get full text

FaceOff: A Video-to-Video Face Swapping System by Agarwal, Aditya, Sen, Bipasha, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C. V

“…Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays…”
Get full text

Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale by Agarwal, Aditya, Sen, Bipasha, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C. V

“…Many people with some form of hearing loss consider lipreading as their primary mode of day-to-day communication. However, finding resources to learn or…”
Get full text

Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors by Hegde, Sindhu B, Mukhopadhyay, Rudrabha, Namboodiri, Vinay P, Jawahar, C. V

“…In this paper, we explore an interesting question of what can be obtained from an $8\times8$ pixel video sequence. Surprisingly, it turns out to be quite a…”
Get full text

A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild by Prajwal, K R, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C V

“…In this work, we investigate the problem of lip-syncing a talking face video of an arbitrary identity to match a target speech segment. Current works excel at…”
Get full text

Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis by Prajwal, K R, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C V

“…Humans involuntarily tend to infer parts of the conversation from lip movements when the speech is absent or corrupted by external noise. In this work, we…”
Get full text

Personalized One-Shot Lipreading for an ALS Patient by Sen, Bipasha, Agarwal, Aditya, Mukhopadhyay, Rudrabha, Namboodiri, Vinay, Jawahar, C V

“…BMVC 2021 Lipreading or visually recognizing speech from the mouth movements of a speaker is a challenging and mentally taxing task. Unfortunately, multiple…”
Get full text

Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild by Hegde, Sindhu B, Prajwal, K R, Mukhopadhyay, Rudrabha, Namboodiri, Vinay P, Jawahar, C. V

“…In this work, we address the problem of generating speech from silent lip videos for any speaker in the wild. In stark contrast to previous works, our method…”
Get full text

Towards Automatic Speech to Sign Language Generation by Kapoor, Parul, Mukhopadhyay, Rudrabha, Hegde, Sindhu B, Namboodiri, Vinay, Jawahar, C V

“…We aim to solve the highly challenging task of generating continuous sign language videos solely from speech segments for the first time. Recent efforts in…”
Get full text

NTIRE 2019 Challenge on Video Super-Resolution: Methods and Results by Nah, Seungjun, Timofte, Radu, Gu, Shuhang, Baik, Sungyong, Hong, Seokil, Moon, Gyeongsik, Son, Sanghyun, Lee, Kyoung Mu, Wang, Xintao, Chan, Kelvin C.K., Yu, Ke, Dong, Chao, Loy, Chen Change, Fan, Yuchen, Yu, Jiahui, Liu, Ding, Huang, Thomas S., Liu, Xiao, Li, Chao, He, Dongliang, Ding, Yukang, Wen, Shilei, Porikli, Fatih, Kalarot, Ratheesh, Haris, Muhammad, Shakhnarovich, Greg, Ukita, Norimichi, Yi, Peng, Wang, Zhongyuan, Jiang, Kui, Jiang, Junjun, Ma, Jiayi, Dong, Hang, Zhang, Xinyi, Hu, Zhe, Kim, Kwanyoung, Kang, Dong Un, Chun, Se Young, Purohit, Kuldeep, Rajagopalan, A.N., Tian, Yapeng, Zhang, Yulun, Fu, Yun, Xu, Chenliang, Tekalp, A. Murat, Yilmaz, M. Akin, Korkmaz, Cansu, Sharma, Manoj, Makwana, Megh, Badhwar, Anuj, Singh, Ajay Pratap, Upadhyay, Avinash, Mukhopadhyay, Rudrabha, Shukla, Ankit, Khanna, Dheeraj, Mandal, A. S., Chaudhury, Santanu, Miao, Si, Zhu, Yongxin, Huo, Xiao

“…This paper reviews the first NTIRE challenge on video super-resolution (restoration of rich details in low-resolution video frames) with focus on proposed…”
Get full text