Search Results - "ElNokrashy, Muhammad"

A Context-Contrastive Inference Approach To Partial Diacritization by ElNokrashy, Muhammad, AlKhamissi, Badr

“…Diacritization plays a pivotal role in improving readability and disambiguating the meaning of Arabic texts. Efforts have so far focused on marking every…”
Get full text

Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification by ElNokrashy, Muhammad, AlKhamissi, Badr, Diab, Mona

“…Language Models pretrained on large textual data have been shown to encode different types of knowledge simultaneously. Traditionally, only the features from…”
Get full text

Investigating Cultural Alignment of Large Language Models by AlKhamissi, Badr, ElNokrashy, Muhammad, AlKhamissi, Mai, Diab, Mona

“…The intricate relationship between language and culture has long been a subject of exploration within the realm of linguistic anthropology. Large Language…”
Get full text

Rosetta Stone at KSAA-RD Shared Task: A Hop From Language Modeling To Word--Definition Alignment by ElBakry, Ahmed, Gabr, Mohamed, ElNokrashy, Muhammad, AlKhamissi, Badr

“…A Reverse Dictionary is a tool enabling users to discover a word based on its provided definition, meaning, or description. Such a technique proves valuable in…”
Get full text

Deep Spiking Neural Networks with Resonate-and-Fire Neurons by AlKhamissi, Badr, ElNokrashy, Muhammad, Bernal-Casas, David

“…In this work, we explore a new Spiking Neural Network (SNN) formulation with Resonate-and-Fire (RAF) neurons (Izhikevich, 2001) trained with gradient descent…”
Get full text

The Emergence of Abstract and Episodic Neurons in Episodic Meta-RL by AlKhamissi, Badr, ElNokrashy, Muhammad, Spranger, Michael

“…In this work, we analyze the reinstatement mechanism introduced by Ritter et al. (2018) to reveal two classes of neurons that emerge in the agent's working…”
Get full text

Deep Diacritization: Efficient Hierarchical Recurrence for Improved Arabic Diacritization by AlKhamissi, Badr, ElNokrashy, Muhammad N, Gabr, Mohamed

“…We propose a novel architecture for labelling character sequences that achieves state-of-the-art results on the Tashkeela Arabic diacritization benchmark. The…”
Get full text

Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task by AlKhamissi, Badr, Gabr, Mohamed, ElNokrashy, Muhammad, Essam, Khaled

“…In this paper, we tackle the Nuanced Arabic Dialect Identification (NADI) shared task (Abdul-Mageed et al., 2021) and demonstrate state-of-the-art results on…”
Get full text

Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation by ElNokrashy, Muhammad, Hendy, Amr, Maher, Mohamed, Afify, Mohamed, Awadalla, Hany Hassan

“…This paper proposes a simple yet effective method to improve direct (X-to-Y) translation for both cases: zero-shot and when direct data is available. We modify…”
Get full text

Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions by ElNokrashy, Muhammad N, Hendy, Amr, Abdelghaffar, Mohamed, Afify, Mohamed, Tawfik, Ahmed, Awadalla, Hany Hassan

“…This paper describes our submission to the WMT20 sentence filtering task. We combine scores from (1) a custom LASER built for each source language, (2) a…”
Get full text

The Shared Task on Gender Rewriting by Alhafni, Bashar, Habash, Nizar, Bouamor, Houda, Obeid, Ossama, Alrowili, Sultan, Alzeer, Daliyah, Alshanqiti, Khawlah M, ElBakry, Ahmed, ElNokrashy, Muhammad, Gabr, Mohamed, Issam, Abderrahmane, Qaddoumi, Abdelrahim, Vijay-Shanker, K, Zyate, Mahmoud

“…In this paper, we present the results and findings of the Shared Task on Gender Rewriting, which was organized as part of the Seventh Arabic Natural Language…”
Get full text