Search Results - "Krotov, Dmitry"

Unsupervised learning by competing hidden units by Krotova, Dmitry, Hopfield, John J.

“…It is widely believed that end-to-end training with the backpropagation algorithm is essential for learning good feature detectors in early layers of…”
Get full text

Morphogenesis at criticality by Krotov, Dmitry, Dubuis, Julien O., Gregor, Thomas, Bialek, William

“…Spatial patterns in the early fruit fly embryo emerge from a network of interactions among transcription factors, the gap genes, driven by maternal inputs…”
Get full text

Modern Hopfield Networks for graph embedding by Liang, Yuchen, Krotov, Dmitry, Zaki, Mohammed J.

“…The network embedding task is to represent a node in a network as a low-dimensional vector while incorporating the topological and structural information. Most…”
Get full text

Dense Associative Memory Is Robust to Adversarial Inputs by Krotov, Dmitry, Hopfield, John

“…Deep neural networks (DNNs) trained in a supervised way suffer from two known problems. First, the minima of the objective function used in learning correspond…”
Get more information

A new frontier for Hopfield networks by Krotov, Dmitry

“…Over the past few years there has been a resurgence of interest in Hopfield networks of associative memory. Dmitry Krotov discusses recent theoretical advances…”
Get full text

Infrared sensitivity of unstable vacua by Krotov, Dmitry, Polyakov, Alexander M.

“…We discover that some unstable vacua have long memory. By that we mean that even in the theories containing only massive particles, there are correllators and…”
Get full text

Building transformers from neurons and astrocytes by Kozachkov, Leo, Kastanenka, Ksenia V, Krotov, Dmitry

“…Glial cells account for between 50% and 90% of all human brain cells, and serve a variety of important developmental, structural, and metabolic functions…”
Get full text

Hierarchical Associative Memory by Krotov, Dmitry

“…Dense Associative Memories or Modern Hopfield Networks have many appealing properties of associative memory. They can do pattern completion, store a large…”
Get full text

Quantum field theory as effective BV theory from Chern–Simons by Krotov, Dmitry, Losev, Andrei

“…The general procedure for obtaining explicit expressions for all cohomologies of Berkovits' operator is suggested. It is demonstrated that calculation of BV…”
Get full text

Strong correlations in gravity and biophysics by Krotov, Dmitry

“…The unifying theme of this dissertation is the use of correlations. In the first part (chapter 2), we investigate correlations in quantum field theories in de…”
Get full text

Neuron-Astrocyte Associative Memory by Kozachkov, Leo, Slotine, Jean-Jacques, Krotov, Dmitry

“…Astrocytes, the most abundant type of glial cell, play a fundamental role in memory. Despite most hippocampal synapses being contacted by an astrocyte, there…”
Get full text

Large Associative Memory Problem in Neurobiology and Machine Learning by Krotov, Dmitry, Hopfield, John

“…Dense Associative Memories or modern Hopfield networks permit storage and reliable retrieval of an exponentially large (in the dimension of feature space)…”
Get full text

Unsupervised Learning by Competing Hidden Units by Krotov, Dmitry, Hopfield, John

“…Proceedings of the National Academy of Sciences of the USA, 116 (16) 7723-7731 (2019) It is widely believed that the backpropagation algorithm is essential for…”
Get full text

Associative Learning for Network Embedding by Liang, Yuchen, Krotov, Dmitry, Zaki, Mohammed J

“…The network embedding task is to represent the node in the network as a low-dimensional vector while incorporating the topological and structural information…”
Get full text

End-to-end Differentiable Clustering with Associative Memories by Saha, Bishwajit, Krotov, Dmitry, Zaki, Mohammed J, Ram, Parikshit

“…Clustering is a widely used unsupervised learning technique involving an intensive discrete optimization problem. Associative Memory models or AMs are…”
Get full text

Sparse Distributed Memory is a Continual Learner by Bricken, Trenton, Davies, Xander, Singh, Deepak, Krotov, Dmitry, Kreiman, Gabriel

“…ICLR 2023 Continual learning is a problem for artificial neural networks that their biological counterparts are adept at solving. Building on work using Sparse…”
Get full text

Dense Associative Memory Through the Lens of Random Features by Hoover, Benjamin, Chau, Duen Horng, Strobelt, Hendrik, Ram, Parikshit, Krotov, Dmitry

“…Dense Associative Memories are high storage capacity variants of the Hopfield networks that are capable of storing a large number of memory patterns in the…”
Get full text

Losing dimensions: Geometric memorization in generative diffusion by Achilli, Beatrice, Ventura, Enrico, Silvestri, Gianluigi, Pham, Bao, Raya, Gabriel, Krotov, Dmitry, Lucibello, Carlo, Ambrogioni, Luca

“…Generative diffusion processes are state-of-the-art machine learning models deeply connected with fundamental concepts in statistical physics. Depending on the…”
Get full text

CAMELoT: Towards Large Language Models with Training-Free Consolidated Associative Memory by He, Zexue, Karlinsky, Leonid, Kim, Donghyun, McAuley, Julian, Krotov, Dmitry, Feris, Rogerio

“…Large Language Models (LLMs) struggle to handle long input sequences due to high memory and runtime costs. Memory-augmented models have emerged as a promising…”
Get full text

Memory in Plain Sight: Surveying the Uncanny Resemblances of Associative Memories and Diffusion Models by Hoover, Benjamin, Strobelt, Hendrik, Krotov, Dmitry, Hoffman, Judy, Kira, Zsolt, Chau, Duen Horng

“…The generative process of Diffusion Models (DMs) has recently set state-of-the-art on many AI generation benchmarks. Though the generative process is…”
Get full text