Search Results - "Lele, Nahush"

Surgical Feature-Space Decomposition of LLMs: Why, When and How? by Chavan, Arnav, Lele, Nahush, Gupta, Deepak

“…Low-rank approximations, of the weight and feature space can enhance the performance of deep learning models, whether in terms of improving generalization or…”
Get full text

Rethinking Compression: Reduced Order Modelling of Latent Features in Large Language Models by Chavan, Arnav, Lele, Nahush, Gupta, Deepak

“…Due to the substantial scale of Large Language Models (LLMs), the direct application of conventional compression methodologies proves impractical. The…”
Get full text

RCV2023 Challenges: Benchmarking Model Training and Inference for Resource-Constrained Deep Learning by Tiwari, Rishabh, Chavan, Arnav, Gupta, Deepak, Mago, Gowreesh, Gupta, Animesh, Gupta, Akash, Sharan, Suraj, Yang, Yukun, Zhao, Shanwei, Wang, Shihao, Kwak, Youngjun, Jeong, Seonghun, Lee, Yunseung, Kim, Changick, Kim, Subin, Gankhuyag, Ganzorig, Jung, Ho, Ryu, Junwhan, Kim, HaeMoon, Kim, Byeong H., Vo, Tu, Zaheer, Sheir, Holston, Alexander, Park, Chan, Dixit, Dheemant, Lele, Nahush, Bhushan, Kushagra, Bhowmick, Debjani, Arya, Devanshu, Gulshad, Sadaf, Habibian, Amirhossein, Ghodrati, Amir, Bejnordi, Babak, Gupta, Jai, Liu, Zhuang, Yu, Jiahui, Prasad, Dilip, Shen, Zhiqiang

“…This paper delves into the results of two resource-constrained deep learning challenges, part of the workshop on Resource-Efficient Deep Learning for Computer…”
Get full text