Search Results - "Dalibard, Valentin"

  • Showing 1 - 12 results of 12
Refine Results
  1. 1
  2. 2

    Faster Improvement Rate Population Based Training by Dalibard, Valentin, Jaderberg, Max

    Published 28-09-2021
    “…The successful training of neural networks typically involves careful and time consuming hyperparameter tuning. Population Based Training (PBT) has recently…”
    Get full text
    Journal Article
  3. 3

    Discovering Attention-Based Genetic Algorithms via Meta-Black-Box Optimization by Lange, Robert Tjarko, Schaul, Tom, Chen, Yutian, Lu, Chris, Zahavy, Tom, Dalibard, Valentin, Flennerhag, Sebastian

    Published 08-04-2023
    “…Genetic algorithms constitute a family of black-box optimization algorithms, which take inspiration from the principles of biological evolution. While they…”
    Get full text
    Journal Article
  4. 4
  5. 5

    Rapid training of deep neural networks without skip connections or normalization layers using Deep Kernel Shaping by Martens, James, Ballard, Andy, Desjardins, Guillaume, Swirszcz, Grzegorz, Dalibard, Valentin, Sohl-Dickstein, Jascha, Schoenholz, Samuel S

    Published 04-10-2021
    “…Using an extended and formalized version of the Q/C map analysis of Poole et al. (2016), along with Neural Tangent Kernel theory, we identify the main…”
    Get full text
    Journal Article
  6. 6

    Perception-Prediction-Reaction Agents for Deep Reinforcement Learning by Stooke, Adam, Dalibard, Valentin, Jayakumar, Siddhant M, Czarnecki, Wojciech M, Jaderberg, Max

    Published 26-06-2020
    “…We introduce a new recurrent agent architecture and associated auxiliary losses which improve reinforcement learning in partially observable tasks requiring…”
    Get full text
    Journal Article
  7. 7

    Tuning the Scheduling of Distributed Stochastic Gradient Descent with Bayesian Optimization by Dalibard, Valentin, Schaarschmidt, Michael, Yoneki, Eiko

    Published 01-12-2016
    “…We present an optimizer which uses Bayesian optimization to tune the system parameters of distributed stochastic gradient descent (SGD). Given a specific…”
    Get full text
    Journal Article
  8. 8
  9. 9
  10. 10

    Learning Runtime Parameters in Computer Systems with Delayed Experience Injection by Schaarschmidt, Michael, Gessert, Felix, Dalibard, Valentin, Yoneki, Eiko

    Published 31-10-2016
    “…Learning effective configurations in computer systems without hand-crafting models for every parameter is a long-standing problem. This paper investigates the…”
    Get full text
    Journal Article
  11. 11

    A Generalized Framework for Population Based Training by Li, Ang, Spyra, Aleksandra, Perel, Sagi, Dalibard, Valentin, Jaderberg, Max, Gu, Chenjie, Budden, David, Harley, Tim, Gupta, Pramod

    Published 05-02-2019
    “…Population Based Training (PBT) is a recent approach that jointly optimizes neural network weights and hyperparameters which periodically copies weights of the…”
    Get full text
    Journal Article
  12. 12

    Population Based Training of Neural Networks by Jaderberg, Max, Dalibard, Valentin, Osindero, Simon, Czarnecki, Wojciech M, Donahue, Jeff, Razavi, Ali, Vinyals, Oriol, Green, Tim, Dunning, Iain, Simonyan, Karen, Fernando, Chrisantha, Kavukcuoglu, Koray

    Published 27-11-2017
    “…Neural networks dominate the modern machine learning landscape, but their training and success still suffer from sensitivity to empirical choices of…”
    Get full text
    Journal Article