Search Results - "Pickett, Marc"

CVPR 2020 continual learning in computer vision competition: Approaches, results, current challenges and future directions by Lomonaco, Vincenzo, Pellegrini, Lorenzo, Rodriguez, Pau, Caccia, Massimo, She, Qi, Chen, Yu, Jodelet, Quentin, Wang, Ruiping, Mai, Zheda, Vazquez, David, Parisi, German I., Churamani, Nikhil, Pickett, Marc, Laradji, Issam, Maltoni, Davide

“…In the last few years, we have witnessed a renewed and fast-growing interest in continual learning with deep neural networks with the shared objective of…”
Get full text

Using cortically-inspired algorithms for analogical learning and reasoning by Pickett, Marc, Aha, David W.

“…We consider the neurologically-inspired hypothesis that higher level cognition is built on the same fundamental building blocks as low-level perception. That…”
Get full text

Building high assurance human-centric decision systems by Heitmeyer, Constance L., Pickett, Marc, Leonard, Elizabeth I., Archer, Myla M., Ray, Indrakshi, Aha, David W., Trafton, J. Gregory

“…Many future decision support systems will be human-centric, i.e., require substantial human oversight and control. Because these systems often provide critical…”
Get full text

The Ungrounded Alignment Problem by Pickett, Marc, Nain, Aakash Kumar, Modayil, Joseph, Jones, Llion

“…Modern machine learning systems have demonstrated substantial abilities with methods that either embrace or ignore human-provided knowledge, but combining…”
Get full text

Transformer Layers as Painters by Sun, Qi, Pickett, Marc, Nain, Aakash Kumar, Jones, Llion

“…Despite their nearly universal adoption for large language models, the internal workings of transformers are not well understood. We aim to better understand…”
Get full text

Towards Relational Theory Formation from Undifferentiated Sensor Data by Pickett, Marc

“…Human adults have rich theories in their heads of how the world works. These theories include objects and relations for both concrete and abstract concepts…”
Get full text

Better RAG using Relevant Information Gain by Pickett, Marc, Hartman, Jeremy, Bhowmick, Ayan Kumar, Alam, Raquib-ul, Vempaty, Aditya

“…A common way to extend the memory of large language models (LLMs) is by retrieval augmented generation (RAG), which inserts text retrieved from a larger memory…”
Get full text

A Brief Study of In-Domain Transfer and Learning from Fewer Samples using A Few Simple Priors by Pickett, Marc, Sekhari, Ayush, Davidson, James

“…Domain knowledge can often be encoded in the structure of a network, such as convolutional layers for vision, which has been shown to increase generalization…”
Get full text

Towards Relational Theory Formation from Undifferentiated Sensor Data by Pickett, Marc

“…Human adults have rich theories in their heads of how the world works. These theories include objects and relations for both concrete and abstract concepts…”
Get full text

Spontaneous Analogy by Piggybacking on a Perceptual System by Pickett, Marc, Aha, David W

“…Most computational models of analogy assume they are given a delineated source domain and often a specified target domain. These systems do not address how…”
Get full text

A Growing Long-term Episodic & Semantic Memory by Pickett, Marc, Al-Rfou, Rami, Shao, Louis, Tar, Chris

“…The long-term memory of most connectionist systems lies entirely in the weights of the system. Since the number of weights is typically fixed, this bounds the…”
Get full text

CVPR 2020 Continual Learning in Computer Vision Competition: Approaches, Results, Current Challenges and Future Directions by Lomonaco, Vincenzo, Pellegrini, Lorenzo, Rodriguez, Pau, Caccia, Massimo, She, Qi, Chen, Yu, Jodelet, Quentin, Wang, Ruiping, Mai, Zheda, Vazquez, David, Parisi, German I, Churamani, Nikhil, Pickett, Marc, Laradji, Issam, Maltoni, Davide

“…In the last few years, we have witnessed a renewed and fast-growing interest in continual learning with deep neural networks with the shared objective of…”
Get full text

LaMDA: Language Models for Dialog Applications by Thoppilan, Romal, De Freitas, Daniel, Hall, Jamie, Shazeer, Noam, Kulshreshtha, Apoorv, Cheng, Heng-Tze, Jin, Alicia, Bos, Taylor, Baker, Leslie, Du, Yu, Li, YaGuang, Lee, Hongrae, Zheng, Huaixiu Steven, Ghafouri, Amin, Menegali, Marcelo, Huang, Yanping, Krikun, Maxim, Lepikhin, Dmitry, Qin, James, Chen, Dehao, Xu, Yuanzhong, Chen, Zhifeng, Roberts, Adam, Bosma, Maarten, Zhao, Vincent, Zhou, Yanqi, Chang, Chung-Ching, Krivokon, Igor, Rusch, Will, Pickett, Marc, Srinivasan, Pranesh, Man, Laichee, Meier-Hellstern, Kathleen, Morris, Meredith Ringel, Doshi, Tulsee, Santos, Renelito Delos, Duke, Toju, Soraker, Johnny, Zevenbergen, Ben, Prabhakaran, Vinodkumar, Diaz, Mark, Hutchinson, Ben, Olson, Kristen, Molina, Alejandra, Hoffman-John, Erin, Lee, Josh, Aroyo, Lora, Rajakumar, Ravi, Butryna, Alena, Lamm, Matthew, Kuzmina, Viktoriya, Fenton, Joe, Cohen, Aaron, Bernstein, Rachel, Kurzweil, Ray, Aguera-Arcas, Blaise, Cui, Claire, Croak, Marian, Chi, Ed, Le, Quoc

“…We present LaMDA: Language Models for Dialog Applications. LaMDA is a family of Transformer-based neural language models specialized for dialog, which have up…”
Get full text

Conversational Contextual Cues: The Case of Personalization and History for Response Ranking by Al-Rfou, Rami, Pickett, Marc, Snaider, Javier, Sung, Yun-hsuan, Strope, Brian, Kurzweil, Ray

“…We investigate the task of modeling open-domain, multi-turn, unstructured, multi-participant, conversational dialogue. We specifically study the effect of…”
Get full text

High assurance human-centric decision systems by Heitmeyer, Constance, Pickett, Marc, Breslow, Len, Aha, David, Trafton, J. Greg, Leonard, Elizabeth

“…Many future decision support systems will be human-centric, i.e., require substantial human oversight and control. Because these systems often provide critical…”
Get full text