Search Results - "Radul, Alexey"

Killer Problems by Khovanova, Tanya, Radul, Alexey

“…This is a special collection of problems that were given to select applicants during oral entrance exams to the Department of Mechanics and Mathematics of…”
Get full text

Aronnax: An idealised isopycnal ocean model by W. Doddridge, Edward, Radul, Alexey

Get full text

The Base Measure Problem and its Solution by Radul, Alexey, Alexeev, Boris

“…Probabilistic programming systems generally compute with probability density functions, leaving the base measure of each such function implicit. This mostly…”
Get full text

The Foil: Capture-Avoiding Substitution With No Sharp Edges by Maclaurin, Dougal, Radul, Alexey, Paszke, Adam

“…Correctly manipulating program terms in a compiler is surprisingly difficult because of the need to avoid name capture. The rapier from "Secrets of the Glasgow…”
Get full text

You Only Linearize Once: Tangents Transpose to Gradients by Radul, Alexey, Paszke, Adam, Frostig, Roy, Johnson, Matthew, Maclaurin, Dougal

“…Automatic differentiation (AD) is conventionally understood as a family of distinct algorithms, rooted in two "modes" -- forward and reverse -- which are…”
Get full text

FunMC: A functional API for building Markov Chains by Sountsov, Pavel, Radul, Alexey, Vasudevan, Srinivas

“…Constant-memory algorithms, also loosely called Markov chains, power the vast majority of probabilistic inference and machine learning applications today. A…”
Get full text

Decomposing reverse-mode automatic differentiation by Frostig, Roy, Johnson, Matthew J, Maclaurin, Dougal, Paszke, Adam, Radul, Alexey

“…We decompose reverse-mode automatic differentiation into (forward-mode) linearization followed by transposition. Doing so isolates the essential difference…”
Get full text

Getting to the Point. Index Sets and Parallelism-Preserving Autodiff for Pointful Array Programming by Paszke, Adam, Johnson, Daniel, Duvenaud, David, Vytiniotis, Dimitrios, Radul, Alexey, Johnson, Matthew, Ragan-Kelley, Jonathan, Maclaurin, Dougal

“…We present a novel programming language design that attempts to combine the clarity and safety of high-level functional languages with the efficiency and…”
Get full text

Automatically Batching Control-Intensive Programs for Modern Accelerators by Radul, Alexey, Patton, Brian, Maclaurin, Dougal, Hoffman, Matthew D, Saurous, Rif A

“…We present a general approach to batching arbitrary computations for accelerators such as GPUs. We show orders-of-magnitude speedups using our method on the No…”
Get full text

Confusion of Tagged Perturbations in Forward Automatic Differentiation of Higher-Order Functions by Manzyuk, Oleksandr, Pearlmutter, Barak A, Radul, Alexey Andreyevich, Rush, David R, Siskind, Jeffrey Mark

“…Forward Automatic Differentiation (AD) is a technique for augmenting programs to compute derivatives. The essence of Forward AD is to attach perturbations to…”
Get full text

Jewish Problems by Khovanova, Tanya, Radul, Alexey

“…published as "KIller Problems" in The American Matheamtical Monthly Vol. 119, No. 10 (2012), pp815-82 This is a special collection of problems that were given…”
Get full text

Time Series Structure Discovery via Probabilistic Program Synthesis by Schaechtle, Ulrich, Saad, Feras, Radul, Alexey, Mansinghka, Vikash

“…There is a widespread need for techniques that can discover structure from time series data. Recently introduced techniques such as Automatic Bayesian…”
Get full text

Simple, Distributed, and Accelerated Probabilistic Programming by Tran, Dustin, Hoffman, Matthew, Moore, Dave, Suter, Christopher, Vasudevan, Srinivas, Radul, Alexey, Johnson, Matthew, Saurous, Rif A

“…We describe a simple, low-level approach for embedding probabilistic programming in a deep learning ecosystem. In particular, we distill probabilistic…”
Get full text

Probabilistic programs for inferring the goals of autonomous agents by Cusumano-Towner, Marco F, Radul, Alexey, Wingate, David, Mansinghka, Vikash K

“…Intelligent systems sometimes need to infer the probable goals of people, cars, and robots, based on partial observations of their motion. This paper…”
Get full text

Probabilistic Programming with Gaussian Process Memoization by Schaechtle, Ulrich, Zinberg, Ben, Radul, Alexey, Stathis, Kostas, Mansinghka, Vikash K

“…Gaussian Processes (GPs) are widely used tools in statistics, machine learning, robotics, computer vision, and scientific computation. However, despite their…”
Get full text

Automatic differentiation in machine learning: a survey by Baydin, Atilim Gunes, Pearlmutter, Barak A, Radul, Alexey Andreyevich, Siskind, Jeffrey Mark

“…Atilim Gunes Baydin, Barak A. Pearlmutter, Alexey Andreyevich Radul, Jeffrey Mark Siskind. Automatic differentiation in machine learning: a survey. The Journal…”
Get full text

Baron Munchhausen's Sequence by Khovanova, Tanya, Knop, Konstantin, Radul, Alexey

“…Journal of Integer Sequences, v.13 (2010), Article 10.8.7 We investigate a coin-weighing puzzle that appeared in the all-Russian math Olympiad in 2000. We…”
Get full text

AD in Fortran, Part 2: Implementation via Prepreprocessor by Radul, Alexey, Pearlmutter, Barak A, Siskind, Jeffrey Mark

“…Recent Advances in Algorithmic Differentiation, Springer Lecture Notes in Computational Science and Engineering volume 87, 2012, ISBN 978-3-642-30022-6, pages…”
Get full text

AD in Fortran, Part 1: Design by Radul, Alexey, Pearlmutter, Barak A, Siskind, Jeffrey Mark

“…We propose extensions to Fortran which integrate forward and reverse Automatic Differentiation (AD) directly into the programming model. Irrespective of…”
Get full text