Search Results - "Von Werra, Leandro"

Radiometric Characterization of a Water-Based Conical Blackbody Calibration Target for Millimeter-Wave Remote Sensing by Jacob, Karl, Schroder, Arne, von Werra, Leandro, Reinhard, Florian, Raisin, Philippe, Murk, Axel

“…In this paper, we present the design and radiometric characterization of a water-based conical blackbody calibration target to be applied as a precise…”
Get full text

DESIGN AND PERFORMANCE OF TWO ORTHOGONAL EXTRACTION TIME-OF-FLIGHT SECONDARY ION MASS SPECTROMETERS FOR FOCUSED ION BEAM INSTRUMENTS by Alberts, Deborah, von Werra, Leandro, Oestlund, Fredrik, Rohner, Urs, Hohl, Markus, Michler, Johann, Whitby, James A.

“…The design and performance of two orthogonal extraction time-of-flight mass spectrometers are reported that were adapted to existing focused ion beam…”
Get full text

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations by Hägele, Alexander, Bakouch, Elie, Kosson, Atli, Allal, Loubna Ben, Von Werra, Leandro, Jaggi, Martin

“…Scale has become a main ingredient in obtaining strong machine learning models. As a result, understanding a model's scaling properties is key to effectively…”
Get full text

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale by Penedo, Guilherme, Kydlíček, Hynek, allal, Loubna Ben, Lozhkov, Anton, Mitchell, Margaret, Raffel, Colin, Von Werra, Leandro, Wolf, Thomas

“…The performance of a large language model (LLM) depends heavily on the quality and size of its pretraining dataset. However, the pretraining datasets for…”
Get full text

Unsupervised Anomaly Detection for Seasonal Time Series by von Werra, Leandro, Tunstall, Lewis, Hofer, Simon

“…We extend eBay's Atlas algorithm to automatically detect anomalies in unlabeled, seasonal time series data. Named MULDER, the algorithm involves deriving a…”
Get full text

Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models by Zhuo, Terry Yue, Zebaze, Armel, Suppattarachai, Nitchakarn, von Werra, Leandro, de Vries, Harm, Liu, Qian, Muennighoff, Niklas

“…The high cost of full-parameter fine-tuning (FFT) of Large Language Models (LLMs) has led to a series of parameter-efficient fine-tuning (PEFT) methods…”
Get full text

SelfCodeAlign: Self-Alignment for Code Generation by Wei, Yuxiang, Cassano, Federico, Liu, Jiawei, Ding, Yifeng, Jain, Naman, Mueller, Zachary, de Vries, Harm, von Werra, Leandro, Guha, Arjun, Zhang, Lingming

“…Instruction tuning is a supervised fine-tuning approach that significantly improves the ability of large language models (LLMs) to follow human instructions…”
Get full text

The BigCode Project Governance Card by BigCode collaboration, Hughes, Sean, de Vries, Harm, Robinson, Jennifer, Ferrandis, Carlos Muñoz, Allal, Loubna Ben, von Werra, Leandro, Ding, Jennifer, Paquet, Sebastien, Jernite, Yacine

“…This document serves as an overview of the different mechanisms and areas of governance in the BigCode project. It aims to support transparency by providing…”
Get full text

OctoPack: Instruction Tuning Code Large Language Models by Muennighoff, Niklas, Liu, Qian, Zebaze, Armel, Zheng, Qinkai, Hui, Binyuan, Zhuo, Terry Yue, Singh, Swayam, Tang, Xiangru, von Werra, Leandro, Longpre, Shayne

“…Finetuning large language models (LLMs) on instructions leads to vast performance improvements on natural language tasks. We apply instruction tuning using…”
Get full text

Zephyr: Direct Distillation of LM Alignment by Tunstall, Lewis, Beeching, Edward, Lambert, Nathan, Rajani, Nazneen, Rasul, Kashif, Belkada, Younes, Huang, Shengyi, von Werra, Leandro, Fourrier, Clémentine, Habib, Nathan, Sarrazin, Nathan, Sanseviero, Omar, Rush, Alexander M, Wolf, Thomas

“…We aim to produce a smaller language model that is aligned to user intent. Previous research has shown that applying distilled supervised fine-tuning (dSFT) on…”
Get full text

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions by Zhuo, Terry Yue, Vu, Minh Chien, Chim, Jenny, Hu, Han, Yu, Wenhao, Widyasari, Ratnadira, Yusuf, Imam Nur Bani, Zhan, Haolan, He, Junda, Paul, Indraneil, Brunner, Simon, Gong, Chen, Hoang, Thong, Zebaze, Armel Randy, Hong, Xiaoheng, Li, Wen-Ding, Kaddour, Jean, Xu, Ming, Zhang, Zhihan, Yadav, Prateek, Jain, Naman, Gu, Alex, Cheng, Zhoujun, Liu, Jiawei, Liu, Qian, Wang, Zijian, Lo, David, Hui, Binyuan, Muennighoff, Niklas, Fried, Daniel, Du, Xiaoning, de Vries, Harm, Von Werra, Leandro

“…Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software…”
Get full text

The Stack: 3 TB of permissively licensed source code by Kocetkov, Denis, Li, Raymond, Allal, Loubna Ben, Li, Jia, Mou, Chenghao, Ferrandis, Carlos Muñoz, Jernite, Yacine, Mitchell, Margaret, Hughes, Sean, Wolf, Thomas, Bahdanau, Dzmitry, von Werra, Leandro, de Vries, Harm

“…Large Language Models (LLMs) play an ever-increasing role in the field of Artificial Intelligence (AI)--not only for natural language processing but also for…”
Get full text

Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements by von Werra, Leandro, Tunstall, Lewis, Thakur, Abhishek, Luccioni, Alexandra Sasha, Thrush, Tristan, Piktus, Aleksandra, Marty, Felix, Rajani, Nazneen, Mustar, Victor, Ngo, Helen, Sanseviero, Omar, Šaško, Mario, Villanova, Albert, Lhoest, Quentin, Chaumond, Julien, Mitchell, Margaret, Rush, Alexander M, Wolf, Thomas, Kiela, Douwe

“…Evaluation is a key part of machine learning (ML), yet there is a lack of support and tooling to enable its informed and systematic practice. We introduce…”
Get full text

StarCoder 2 and The Stack v2: The Next Generation by Lozhkov, Anton, Li, Raymond, Allal, Loubna Ben, Cassano, Federico, Lamy-Poirier, Joel, Tazi, Nouamane, Tang, Ao, Pykhtar, Dmytro, Liu, Jiawei, Wei, Yuxiang, Liu, Tianyang, Tian, Max, Kocetkov, Denis, Zucker, Arthur, Belkada, Younes, Wang, Zijian, Liu, Qian, Abulkhanov, Dmitry, Paul, Indraneil, Li, Zhuang, Li, Wen-Ding, Risdal, Megan, Li, Jia, Zhu, Jian, Zhuo, Terry Yue, Zheltonozhskii, Evgenii, Dade, Nii Osae Osae, Yu, Wenhao, Krauß, Lucas, Jain, Naman, Su, Yixuan, He, Xuanli, Dey, Manan, Abati, Edoardo, Chai, Yekun, Muennighoff, Niklas, Tang, Xiangru, Oblokulov, Muhtasham, Akiki, Christopher, Marone, Marc, Mou, Chenghao, Mishra, Mayank, Gu, Alex, Hui, Binyuan, Dao, Tri, Zebaze, Armel, Dehaene, Olivier, Patry, Nicolas, Xu, Canwen, McAuley, Julian, Hu, Han, Scholak, Torsten, Paquet, Sebastien, Robinson, Jennifer, Anderson, Carolyn Jane, Chapados, Nicolas, Patwary, Mostofa, Tajbakhsh, Nima, Jernite, Yacine, Ferrandis, Carlos Muñoz, Zhang, Lingming, Hughes, Sean, Wolf, Thomas, Guha, Arjun, von Werra, Leandro, de Vries, Harm

“…The BigCode project, an open-scientific collaboration focused on the responsible development of Large Language Models for Code (Code LLMs), introduces…”
Get full text

SantaCoder: don't reach for the stars by Allal, Loubna Ben, Li, Raymond, Kocetkov, Denis, Mou, Chenghao, Akiki, Christopher, Ferrandis, Carlos Munoz, Muennighoff, Niklas, Mishra, Mayank, Gu, Alex, Dey, Manan, Umapathi, Logesh Kumar, Anderson, Carolyn Jane, Zi, Yangtian, Poirier, Joel Lamy, Schoelkopf, Hailey, Troshin, Sergey, Abulkhanov, Dmitry, Romero, Manuel, Lappert, Michael, De Toni, Francesco, del Río, Bernardo García, Liu, Qian, Bose, Shamik, Bhattacharyya, Urvashi, Zhuo, Terry Yue, Yu, Ian, Villegas, Paulo, Zocca, Marco, Mangrulkar, Sourab, Lansky, David, Nguyen, Huu, Contractor, Danish, Villa, Luis, Li, Jia, Bahdanau, Dzmitry, Jernite, Yacine, Hughes, Sean, Fried, Daniel, Guha, Arjun, de Vries, Harm, von Werra, Leandro

“…The BigCode project is an open-scientific collaboration working on the responsible development of large language models for code. This tech report describes…”
Get full text

StarCoder: may the source be with you by Li, Raymond, Allal, Loubna Ben, Zi, Yangtian, Muennighoff, Niklas, Kocetkov, Denis, Mou, Chenghao, Marone, Marc, Akiki, Christopher, Li, Jia, Chim, Jenny, Liu, Qian, Zheltonozhskii, Evgenii, Zhuo, Terry Yue, Wang, Thomas, Dehaene, Olivier, Davaadorj, Mishig, Lamy-Poirier, Joel, Monteiro, João, Shliazhko, Oleh, Gontier, Nicolas, Meade, Nicholas, Zebaze, Armel, Yee, Ming-Ho, Umapathi, Logesh Kumar, Zhu, Jian, Lipkin, Benjamin, Oblokulov, Muhtasham, Wang, Zhiruo, Murthy, Rudra, Stillerman, Jason, Patel, Siva Sankalp, Abulkhanov, Dmitry, Zocca, Marco, Dey, Manan, Zhang, Zhihan, Fahmy, Nour, Bhattacharyya, Urvashi, Yu, Wenhao, Singh, Swayam, Luccioni, Sasha, Villegas, Paulo, Kunakov, Maxim, Zhdanov, Fedor, Romero, Manuel, Lee, Tony, Timor, Nadav, Ding, Jennifer, Schlesinger, Claire, Schoelkopf, Hailey, Ebert, Jan, Dao, Tri, Mishra, Mayank, Gu, Alex, Robinson, Jennifer, Anderson, Carolyn Jane, Dolan-Gavitt, Brendan, Contractor, Danish, Reddy, Siva, Fried, Daniel, Bahdanau, Dzmitry, Jernite, Yacine, Ferrandis, Carlos Muñoz, Hughes, Sean, Wolf, Thomas, Guha, Arjun, von Werra, Leandro, de Vries, Harm

“…The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces…”
Get full text

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset by Laurençon, Hugo, Saulnier, Lucile, Wang, Thomas, Akiki, Christopher, del Moral, Albert Villanova, Scao, Teven Le, Von Werra, Leandro, Mou, Chenghao, Ponferrada, Eduardo González, Nguyen, Huu, Frohberg, Jörg, Šaško, Mario, Lhoest, Quentin, McMillan-Major, Angelina, Dupont, Gerard, Biderman, Stella, Rogers, Anna, allal, Loubna Ben, De Toni, Francesco, Pistilli, Giada, Nguyen, Olivier, Nikpoor, Somaieh, Masoud, Maraim, Colombo, Pierre, de la Rosa, Javier, Villegas, Paulo, Thrush, Tristan, Longpre, Shayne, Nagel, Sebastian, Weber, Leon, Muñoz, Manuel, Zhu, Jian, Van Strien, Daniel, Alyafeai, Zaid, Almubarak, Khalid, Vu, Minh Chien, Gonzalez-Dios, Itziar, Soroa, Aitor, Lo, Kyle, Dey, Manan, Suarez, Pedro Ortiz, Gokaslan, Aaron, Bose, Shamik, Adelani, David, Phan, Long, Tran, Hieu, Yu, Ian, Pai, Suhas, Chim, Jenny, Lepercq, Violette, Ilic, Suzana, Mitchell, Margaret, Luccioni, Sasha Alexandra, Jernite, Yacine

“…As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The…”
Get full text

A water-based conical blackbody concept for millimeter-wave remote sensing by Schroder, Arne, Murk, Axel, von Werra, Leandro, Reinhard, Florian, Raisin, Philippe, Jacob, Karl

“…We propose a novel concept for water-based black-bodies to be used as calibration sources in microwave remote sensing instruments. In order to obtain a low…”
Get full text