Search Results - "Webson, Albert"

Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models by Strobelt, Hendrik, Webson, Albert, Sanh, Victor, Hoover, Benjamin, Beyer, Johanna, Pfister, Hanspeter, Rush, Alexander M.

“…State-of-the-art neural language models can now be used to solve ad-hoc language tasks through zero-shot prompting without the need for supervised training…”
Get full text

Do Prompt-Based Models Really Understand the Meaning of their Prompts? by Webson, Albert, Pavlick, Ellie

“…Recently, a boom of papers has shown extraordinary progress in zero-shot and few-shot learning with various prompt-based models. It is commonly argued that…”
Get full text

In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax by Mueller, Aaron, Webson, Albert, Petty, Jackson, Linzen, Tal

“…In-context learning (ICL) is now a common method for teaching large language models (LLMs) new tasks: given labeled examples in the input context, the LLM…”
Get full text

Are Language Models Worse than Humans at Following Prompts? It's Complicated by Webson, Albert, Loo, Alyssa Marie, Yu, Qinan, Pavlick, Ellie

“…Prompts have been the center of progress in advancing language models' zero-shot and few-shot performance. However, recent work finds that models can perform…”
Get full text

Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs by Guu, Kelvin, Webson, Albert, Pavlick, Ellie, Dixon, Lucas, Tenney, Ian, Bolukbasi, Tolga

“…Training data attribution (TDA) methods offer to trace a model's prediction on any given example back to specific influential training examples. Existing…”
Get full text

Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models by Strobelt, Hendrik, Webson, Albert, Sanh, Victor, Hoover, Benjamin, Beyer, Johanna, Pfister, Hanspeter, Rush, Alexander M

“…State-of-the-art neural language models can now be used to solve ad-hoc language tasks through zero-shot prompting without the need for supervised training…”
Get full text

Are "Undocumented Workers" the Same as "Illegal Aliens"? Disentangling Denotation and Connotation in Vector Spaces by Webson, Albert, Chen, Zhizhong, Eickhoff, Carsten, Pavlick, Ellie

“…In politics, neologisms are frequently invented for partisan objectives. For example, "undocumented workers" and "illegal aliens" refer to the same group of…”
Get full text

Larger language models do in-context learning differently by Wei, Jerry, Wei, Jason, Tay, Yi, Tran, Dustin, Webson, Albert, Lu, Yifeng, Chen, Xinyun, Liu, Hanxiao, Huang, Da, Zhou, Denny, Ma, Tengyu

“…We study how in-context learning (ICL) in language models is affected by semantic priors versus input-label mappings. We investigate two setups-ICL with…”
Get full text

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning by Longpre, Shayne, Hou, Le, Vu, Tu, Webson, Albert, Chung, Hyung Won, Tay, Yi, Zhou, Denny, Le, Quoc V, Zoph, Barret, Wei, Jason, Roberts, Adam

“…We study the design decisions of publicly available instruction tuning methods, and break down the development of Flan 2022 (Chung et al., 2022). Through…”
Get full text

Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models by Shen, Sheng, Hou, Le, Zhou, Yanqi, Du, Nan, Longpre, Shayne, Wei, Jason, Chung, Hyung Won, Zoph, Barret, Fedus, William, Chen, Xinyun, Vu, Tu, Wu, Yuexin, Chen, Wuyang, Webson, Albert, Li, Yunxuan, Zhao, Vincent, Yu, Hongkun, Keutzer, Kurt, Darrell, Trevor, Zhou, Denny

“…Sparse Mixture-of-Experts (MoE) is a neural architecture design that can be utilized to add learnable parameters to Large Language Models (LLMs) without…”
Get full text

Evaluating Frontier Models for Dangerous Capabilities by Phuong, Mary, Aitchison, Matthew, Catt, Elliot, Cogan, Sarah, Kaskasoli, Alexandre, Krakovna, Victoria, Lindner, David, Rahtz, Matthew, Assael, Yannis, Hodkinson, Sarah, Howard, Heidi, Lieberum, Tom, Kumar, Ramana, Raad, Maria Abi, Webson, Albert, Ho, Lewis, Lin, Sharon, Farquhar, Sebastian, Hutter, Marcus, Deletang, Gregoire, Ruoss, Anian, El-Sayed, Seliem, Brown, Sasha, Dragan, Anca, Shah, Rohin, Dafoe, Allan, Shevlane, Toby

“…To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new…”
Get full text

Towards Conversational Diagnostic AI by Tu, Tao, Palepu, Anil, Schaekermann, Mike, Saab, Khaled, Freyberg, Jan, Tanno, Ryutaro, Wang, Amy, Li, Brenna, Amin, Mohamed, Tomasev, Nenad, Azizi, Shekoofeh, Singhal, Karan, Cheng, Yong, Hou, Le, Webson, Albert, Kulkarni, Kavita, Mahdavi, S Sara, Semturs, Christopher, Gottweis, Juraj, Barral, Joelle, Chou, Katherine, Corrado, Greg S, Matias, Yossi, Karthikesalingam, Alan, Natarajan, Vivek

“…At the heart of medicine lies the physician-patient dialogue, where skillful history-taking paves the way for accurate diagnosis, effective management, and…”
Get full text

Capabilities of Gemini Models in Medicine by Saab, Khaled, Tu, Tao, Weng, Wei-Hung, Tanno, Ryutaro, Stutz, David, Wulczyn, Ellery, Zhang, Fan, Strother, Tim, Park, Chunjong, Vedadi, Elahe, Chaves, Juanma Zambrano, Hu, Szu-Yeu, Schaekermann, Mike, Kamath, Aishwarya, Cheng, Yong, Barrett, David G. T, Cheung, Cathy, Mustafa, Basil, Palepu, Anil, McDuff, Daniel, Hou, Le, Golany, Tomer, Liu, Luyang, Alayrac, Jean-baptiste, Houlsby, Neil, Tomasev, Nenad, Freyberg, Jan, Lau, Charles, Kemp, Jonas, Lai, Jeremy, Azizi, Shekoofeh, Kanada, Kimberly, Man, SiWai, Kulkarni, Kavita, Sun, Ruoxi, Shakeri, Siamak, He, Luheng, Caine, Ben, Webson, Albert, Latysheva, Natasha, Johnson, Melvin, Mansfield, Philip, Lu, Jian, Rivlin, Ehud, Anderson, Jesper, Green, Bradley, Wong, Renee, Krause, Jonathan, Shlens, Jonathon, Dominowska, Ewa, Eslami, S. M. Ali, Chou, Katherine, Cui, Claire, Vinyals, Oriol, Kavukcuoglu, Koray, Manyika, James, Dean, Jeff, Hassabis, Demis, Matias, Yossi, Webster, Dale, Barral, Joelle, Corrado, Greg, Semturs, Christopher, Mahdavi, S. Sara, Gottweis, Juraj, Karthikesalingam, Alan, Natarajan, Vivek

“…Excellence in a wide variety of medical applications poses considerable challenges for AI, requiring advanced reasoning, access to up-to-date medical knowledge…”
Get full text

Crosslingual Generalization through Multitask Finetuning by Muennighoff, Niklas, Wang, Thomas, Sutawika, Lintang, Roberts, Adam, Biderman, Stella, Scao, Teven Le, Bari, M Saiful, Shen, Sheng, Yong, Zheng-Xin, Schoelkopf, Hailey, Tang, Xiangru, Radev, Dragomir, Aji, Alham Fikri, Almubarak, Khalid, Albanie, Samuel, Alyafeai, Zaid, Webson, Albert, Raff, Edward, Raffel, Colin

“…Multitask prompted finetuning (MTF) has been shown to help large language models generalize to new tasks in a zero-shot setting, but so far explorations of MTF…”
Get full text

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context by Daruki, Samira, Gu, Yiming, Mahdieh, Mahdis, Sundararajan, Mukund, Mentzer, Fabian, He, Antoine, Ho, Lewis, Chowdhery, Aakanksha, Petrushkina, Anastasia, Patil, Piyush, Zhao, Jeffrey, Agarwal, Rishabh, Rajwar, Ravi, Batsaikhan, Bat-Orgil, Kar, Arjun, Sang, Ruoxin, Hand, Steven, Jain, Vihan, Sethi, Nikhil, Bolina, Vijay, Levine, Nir, Addanki, Ravi, Lin, Hanzhao, Rutherford, Eliza, Choe, HyunJeong, Rakićević, Nemanja, Huang, Ronny, Chen, Jeremy, Sulsky, Yury, Greer, Jeremy, Chen, Charlie, Chen, Phil, Tobin, Taylor, Thacker, Phoebe, Davoodi, Elnaz, Proleev, Lev, Baddepudi, Anirudh, Nguyen, Duc Dung, Tagliasacchi, Marco, Du, Cosmo, Martins, Danilo, Shah, Premal, Feinberg, Vladimir, Smith, Charlotte, Shakeri, Siamak, Soparkar, Kedar, Barker, David, Houlsby, Neil, Magni, Alberto, Thakoor, Shantanu, Koop, Anna, Zilka, Lukas, Cai, Honglong, Kallakuri, Praveen, Ghemawat, Sanjay, Tao, David, Green, Tim, Zhou, Denny, Farabet, Clement, Broder, Josef, Repina, Alena, Burns, Andrea, Zhang, Lei, Cobo, Luis C, Simon, Jon, Tenney, Ian, Chen, Minmin, Xu, Yaming, Fernando, Nick, Singhal, Achintya, Jia, Johnson, Crocker, Remi, Liu, Tianqi, White, Anais, McCarthy, Sara, McWilliams, Brian, Zhang, Zhishuai, Felt, Nick, Shenoy, Ashish, Elisseeff, Andre, Zeng, William, Choquette-Choo, Christopher A, Manyika, James, Bolukbasi, Tolga, Salama, Khalid, Askham, Harry, Parisi, Aaron, Vijayakumar, Anitha, Carthy, Sara Mc, Kim, Lucy, Larsen, Rasmus, Ijazi, Joana, Zhao, Shubin, Dhillon, Inderjit, Sedghi, Hanie, Jerome, Sammy, Algymr, Anton, Anklin, Valentin, Baeuml, Martin, Petrov, Slav

“…In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of…”
Get full text

Scaling Instruction-Finetuned Language Models by Chung, Hyung Won, Hou, Le, Longpre, Shayne, Zoph, Barret, Tay, Yi, Fedus, William, Li, Yunxuan, Wang, Xuezhi, Dehghani, Mostafa, Brahma, Siddhartha, Webson, Albert, Gu, Shixiang Shane, Dai, Zhuyun, Suzgun, Mirac, Chen, Xinyun, Chowdhery, Aakanksha, Castro-Ros, Alex, Pellat, Marie, Robinson, Kevin, Valter, Dasha, Narang, Sharan, Mishra, Gaurav, Yu, Adams, Zhao, Vincent, Huang, Yanping, Dai, Andrew, Yu, Hongkun, Petrov, Slav, Chi, Ed H, Dean, Jeff, Devlin, Jacob, Roberts, Adam, Zhou, Denny, Le, Quoc V, Wei, Jason

“…Finetuning language models on a collection of datasets phrased as instructions has been shown to improve model performance and generalization to unseen tasks…”
Get full text

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts by Bach, Stephen H, Sanh, Victor, Yong, Zheng-Xin, Webson, Albert, Raffel, Colin, Nayak, Nihal V, Sharma, Abheesht, Kim, Taewoon, Bari, M Saiful, Fevry, Thibault, Alyafeai, Zaid, Dey, Manan, Santilli, Andrea, Sun, Zhiqing, Ben-David, Srulik, Xu, Canwen, Chhablani, Gunjan, Wang, Han, Fries, Jason Alan, Al-shaibani, Maged S, Sharma, Shanya, Thakker, Urmish, Almubarak, Khalid, Tang, Xiangru, Radev, Dragomir, Jiang, Mike Tian-Jian, Rush, Alexander M

“…PromptSource is a system for creating, sharing, and using natural language prompts. Prompts are functions that map an example from a dataset to a natural…”
Get full text

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model by Scao, Teven Le, Fan, Angela, Gallé, Matthias, Webson, Albert, Wang, Thomas, Bekman, Stas, Laurençon, Hugo, Launay, Julien, Raffel, Colin, Simhi, Adi, Alfassy, Amit, Rogers, Anna, Leong, Colin, van Strien, Daniel, Ponferrada, Eduardo González, Levkovizh, Efrat, Benyamina, Hamza, Tran, Hieu, Yu, Ian, Johnson, Isaac, Bhattacharjee, Joydeep, Von Werra, Leandro, Dey, Manan, Jiang, Mike Tian-Jian, Jauhar, Mohammad A, Kassner, Nora, Pyysalo, Sampo, Pai, Suhas, Schick, Timo, Thrush, Tristan, Nikoulina, Vassilina, Laippala, Veronika, Heinzerling, Benjamin, Taşar, Davut Emre, Salesky, Elizabeth, Lee, Wilson Y, Szczechla, Eliza, Chhablani, Gunjan, Wang, Han, Rozen, Jos, Manica, Matteo, Nayak, Nihal, Teehan, Ryan, Albanie, Samuel, Shen, Sheng, Ben-David, Srulik, Kim, Taewoon, Neeraj, Trishala, Roberts, Adam, Tae, Jaesung, Phang, Jason, Press, Ofir, Ryabinin, Max, Peyrounette, Myriam, Patry, Nicolas, Cornette, Pierre, Dettmers, Tim, Ligozat, Anne-Laure, Névéol, Aurélie, Taktasheva, Ekaterina, Kalo, Jan-Christoph, Clive, Jordan, Kim, Najoung, Mirkin, Shachar, Pais, Shani, Pruksachatkun, Yada, Pestana, Amanda, Faranak, Amy, Santos, Ana, HajiHosseini, Azadeh, Ajibade, Benjamin, Saxena, Bharat, Nguyen, Duong A, Rezanejad, Habib, Bhattacharya, Indrani, Nejadgholi, Isar, McKenna, Michael, Burynok, Mykola, Rajani, Nazneen, Samuel, Olanrewaju, Kromann, Rasmus, Shubber, Sarmad, Viguier, Sylvain, Miranda-Escalada, Antonio, Singh, Ayush, Manjavacas, Enrique, Barth, Fabio, Bulchandani, Lokesh, Nezhurina, Marianna, Liu, Minna, Kang, Myungsun, Dahlberg, Nathan, Chandrasekhar, Ramya, Eisenberg, Renata, Canalli, Rodrigo, Schweter, Stefan, Laud, Tanmay, Kainuma, Tomoya, Venkatraman, Yash, Xu, Yingxin

“…Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these…”
Get full text

Multitask Prompted Training Enables Zero-Shot Task Generalization by Sanh, Victor, Webson, Albert, Raffel, Colin, Bach, Stephen H, Sutawika, Lintang, Alyafeai, Zaid, Chaffin, Antoine, Stiegler, Arnaud, Scao, Teven Le, Raja, Arun, Dey, Manan, Bari, M Saiful, Xu, Canwen, Thakker, Urmish, Sharma, Shanya Sharma, Szczechla, Eliza, Kim, Taewoon, Chhablani, Gunjan, Nayak, Nihal, Datta, Debajyoti, Chang, Jonathan, Jiang, Mike Tian-Jian, Wang, Han, Manica, Matteo, Shen, Sheng, Yong, Zheng Xin, Pandey, Harshit, Bawden, Rachel, Wang, Thomas, Neeraj, Trishala, Rozen, Jos, Sharma, Abheesht, Santilli, Andrea, Fevry, Thibault, Fries, Jason Alan, Teehan, Ryan, Bers, Tali, Biderman, Stella, Gao, Leo, Wolf, Thomas, Rush, Alexander M

“…Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been…”
Get full text