Search Results - "Gonen, Hila"

A 4‐week randomized controlled trial evaluating plaque and gingivitis effects of an electric toothbrush in a paediatric population by Davidovich, Esti, Ccahuana‐Vasquez, Renzo A., Grender, Julie, Timm, Hans, Gonen, Hila, Zini, Avi

“…Background Few extended studies have explored oscillating–rotating (O–R) toothbrush efficacy in young children. Aim To compare the efficacy between O–R and…”
Get full text

Automatically Identifying Gender Issues in Machine Translation using Perturbations by Gonen, Hila, Webster, Kellie

“…The successful application of neural methods to machine translation has realized huge quality advances for the community. With these improvements, many have…”
Get full text

MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling by Limisiewicz, Tomasz, Blevins, Terra, Gonen, Hila, Ahia, Orevaoghene, Zettlemoyer, Luke

“…A major consideration in multilingual language modeling is how to best represent languages with diverse vocabularies and scripts. Although contemporary text…”
Get full text

Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation by Ghazvininejad, Marjan, Gonen, Hila, Zettlemoyer, Luke

“…Large language models (LLMs) demonstrate remarkable machine translation (MT) abilities via prompting, even though they were not explicitly trained for this…”
Get full text

Prompting Language Models for Linguistic Structure by Blevins, Terra, Gonen, Hila, Zettlemoyer, Luke

“…Although pretrained language models (PLMs) can be prompted to perform a wide range of language tasks, it remains an open question how much this ability comes…”
Get full text

Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models by Blevins, Terra, Gonen, Hila, Zettlemoyer, Luke

“…The emergent cross-lingual transfer seen in multilingual pretrained models has sparked significant interest in studying their behavior. However, because these…”
Get full text

Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them by Gonen, Hila, Goldberg, Yoav

“…Word embeddings are widely used in NLP for a vast range of tasks. It was shown that word embeddings derived from text corpora reflect gender biases in society…”
Get full text

Analyzing Gender Representation in Multilingual Models by Gonen, Hila, Ravfogel, Shauli, Goldberg, Yoav

“…Multilingual language models were shown to allow for nontrivial transfer across scripts and languages. In this work, we study the structure of the internal…”
Get full text

Language Modeling for Code-Switching: Evaluation, Integration of Monolingual Data, and Discriminative Training by Gonen, Hila, Goldberg, Yoav

“…We focus on the problem of language modeling for code-switched language, in the context of automatic speech recognition (ASR). Language modeling for…”
Get full text

Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models by Gonen, Hila, Blevins, Terra, Liu, Alisa, Zettlemoyer, Luke, Smith, Noah A

“…Despite their wide adoption, the biases and unintended behaviors of language models remain poorly understood. In this paper, we identify and characterize a…”
Get full text

MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based Tokenization by Ahia, Orevaoghene, Kumar, Sachin, Gonen, Hila, Hoffman, Valentin, Limisiewicz, Tomasz, Tsvetkov, Yulia, Smith, Noah A

“…In multilingual settings, non-Latin scripts and low-resource languages are usually disadvantaged in terms of language models' utility, efficiency, and cost…”
Get full text

Pick a Fight or Bite your Tongue: Investigation of Gender Differences in Idiomatic Language Usage by Rabinovich, Ella, Gonen, Hila, Stevenson, Suzanne

“…A large body of research on gender-linked language has established foundations regarding cross-gender differences in lexical, emotional, and topical…”
Get full text

Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models by Blevins, Terra, Limisiewicz, Tomasz, Gururangan, Suchin, Li, Margaret, Gonen, Hila, Smith, Noah A, Zettlemoyer, Luke

“…Despite their popularity in non-English NLP, multilingual language models often underperform monolingual ones due to inter-language competition for model…”
Get full text

That was the last straw, we need more: Are Translation Systems Sensitive to Disambiguating Context? by Lee, Jaechan, Liu, Alisa, Ahia, Orevaoghene, Gonen, Hila, Smith, Noah A

“…The translation of ambiguous text presents a challenge for translation systems, as it requires using the surrounding context to disambiguate the intended…”
Get full text

Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora by Gonen, Hila, Jawahar, Ganesh, Seddah, Djamé, Goldberg, Yoav

“…The problem of comparing two bodies of text and searching for words that differ in their usage between them arises often in digital humanities and…”
Get full text

Voices Unheard: NLP Resources and Models for Yor\`ub\'a Regional Dialects by Ahia, Orevaoghene, Aremu, Anuoluwapo, Abagyan, Diana, Gonen, Hila, Adelani, David Ifeoluwa, Abolade, Daud, Smith, Noah A, Tsvetkov, Yulia

“…Yor\`ub\'a an African language with roughly 47 million speakers encompasses a continuum with several dialects. Recent efforts to develop NLP technologies for…”
Get full text

Semi Supervised Preposition-Sense Disambiguation using Multilingual Data by Gonen, Hila, Goldberg, Yoav

“…Prepositions are very common and very ambiguous, and understanding their sense is critical for understanding the meaning of the sentence. Supervised corpora…”
Get full text

Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models by Ahia, Orevaoghene, Kumar, Sachin, Gonen, Hila, Kasai, Jungo, Mortensen, David R, Smith, Noah A, Tsvetkov, Yulia

“…Language models have graduated from being research prototypes to commercialized products offered as web APIs, and recent works have highlighted the…”
Get full text

How does Grammatical Gender Affect Noun Representations in Gender-Marking Languages? by Gonen, Hila, Kementchedjhieva, Yova, Goldberg, Yoav

“…Many natural languages assign grammatical gender also to inanimate nouns in the language. In such languages, words that relate to the gender-marked nouns are…”
Get full text

XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models by Liang, Davis, Gonen, Hila, Mao, Yuning, Hou, Rui, Goyal, Naman, Ghazvininejad, Marjan, Zettlemoyer, Luke, Khabsa, Madian

“…Large multilingual language models typically rely on a single vocabulary shared across 100+ languages. As these models have increased in parameter count and…”
Get full text