Search Results - "Seddik, Mohamed El Amine"
-
1
Learning More Universal Representations for Transfer-Learning
Published in IEEE transactions on pattern analysis and machine intelligence (01-09-2020)“…A representation is supposed universal if it encodes any element of the visual world (e.g., objects, scenes) in any configuration (e.g., scale, context). While…”
Get full text
Journal Article -
2
Soil Moisture Estimation Using Sentinel-1/-2 Imagery Coupled With CycleGAN for Time-Series Gap Filing
Published in IEEE transactions on geoscience and remote sensing (2022)“…Fast soil moisture content (SMC) mapping is necessary to support water resource management and to understand crop growth, quality, and yield. Therefore, earth…”
Get full text
Journal Article -
3
Kernel Random Matrices of Large Concentrated Data: the Example of GAN-Generated Images
Published in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (01-05-2019)“…Based on recent random matrix advances in the analysis of kernel methods for classification and clustering, this paper proposes the study of large kernel…”
Get full text
Conference Proceeding -
4
Optimization-Based Neural Networks Compression
Published in 2021 IEEE International Conference on Image Processing (ICIP) (19-09-2021)“…This paper presents a method for constructing a size compressed neural network with better or similar accuracy than a given dense neural network, therefore the…”
Get full text
Conference Proceeding -
5
From outage probability to ALOHA MAC layer performance analysis in distributed WSNs
Published in 2018 IEEE Wireless Communications and Networking Conference (WCNC) (01-04-2018)“…In cellular networks, the outage probability is the probability that the signal-to-interference-plus-noise-ratio (SINR) is less than a given threshold. In this…”
Get full text
Conference Proceeding -
6
When random tensors meet random matrices
Published in The Annals of applied probability (01-02-2024)“…Relying on random matrix theory (RMT), this paper studies asymmetric order-d spiked tensor models with Gaussian noise. Using the variational definition of the…”
Get full text
Journal Article -
7
Generative collaborative networks for single image super-resolution
Published in Neurocomputing (Amsterdam) (20-07-2020)“…A common issue of deep neural networks-based methods for the problem of Single Image Super-Resolution (SISR), is the recovery of finer texture details when…”
Get full text
Journal Article -
8
Lightweight Neural Networks From PCA & LDA Based Distilled Dense Neural Networks
Published in 2020 IEEE International Conference on Image Processing (ICIP) (01-10-2020)“…This paper presents two methods for building lightweight neural networks with similar accuracy than heavyweight ones with the advantage to be less greedy in…”
Get full text
Conference Proceeding -
9
High-dimensional Learning with Noisy Labels
Published 22-05-2024“…This paper provides theoretical insights into high-dimensional binary classification with class-conditional noisy labels. Specifically, we study the behavior…”
Get full text
Journal Article -
10
A Nested Matrix-Tensor Model for Noisy Multi-view Clustering
Published 31-05-2023“…In this paper, we propose a nested matrix-tensor model which extends the spiked rank-one tensor model of order three. This model is particularly motivated by a…”
Get full text
Journal Article -
11
Optimizing Orthogonalized Tensor Deflation via Random Tensor Theory
Published 11-02-2023“…This paper tackles the problem of recovering a low-rank signal tensor with possibly correlated components from a random noisy tensor, or so-called spiked…”
Get full text
Journal Article -
12
Maximizing the Potential of Synthetic Data: Insights from Random Matrix Theory
Published 11-10-2024“…Synthetic data has gained attention for training large language models, but poor-quality data can harm performance (see, e.g., Shumailov et al. (2023); Seddik…”
Get full text
Journal Article -
13
Alignment with Preference Optimization Is All You Need for LLM Safety
Published 12-09-2024“…We demonstrate that preference optimization methods can effectively enhance LLM safety. Applying various alignment techniques to the Falcon 11B model using…”
Get full text
Journal Article -
14
On the Accuracy of Hotelling-Type Tensor Deflation: A Random Tensor Analysis
Published 16-11-2022“…Leveraging on recent advances in random tensor theory, we consider in this paper a rank-$r$ asymmetric spiked tensor model of the form $\sum_{i=1}^r \beta_i…”
Get full text
Journal Article -
15
How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse
Published 07-04-2024“…The phenomenon of model collapse, introduced in (Shumailov et al., 2023), refers to the deterioration in performance that occurs when new models are trained on…”
Get full text
Journal Article -
16
Investigating Regularization of Self-Play Language Models
Published 04-04-2024“…This paper explores the effects of various forms of regularization in the context of language model alignment via self-play. While both reinforcement learning…”
Get full text
Journal Article -
17
Performance Gaps in Multi-view Clustering under the Nested Matrix-Tensor Model
Published 16-02-2024“…We study the estimation of a planted signal hidden in a recently introduced nested matrix-tensor model, which is an extension of the classical spiked rank-one…”
Get full text
Journal Article -
18
On the Accuracy of Hotelling-Type Asymmetric Tensor Deflation: A Random Tensor Analysis
Published 28-10-2023“…This work introduces an asymptotic study of Hotelling-type tensor deflation in the presence of noise, in the regime of large tensor dimensions. Specifically,…”
Get full text
Journal Article -
19
When Random Tensors meet Random Matrices
Published 22-12-2021“…Relying on random matrix theory (RMT), this paper studies asymmetric order-$d$ spiked tensor models with Gaussian noise. Using the variational definition of…”
Get full text
Journal Article -
20
Hotelling Deflation on Large Symmetric Spiked Tensors
Published 20-04-2023“…This paper studies the deflation algorithm when applied to estimate a low-rank symmetric spike contained in a large tensor corrupted by additive Gaussian…”
Get full text
Journal Article