Search Results - "Tatebe, Osamu"

Building the International Lattice Data Grid by Beckett, Mark G., Coddington, Paul, Joó, Bálint, Maynard, Chris M., Pleiter, Dirk, Tatebe, Osamu, Yoshie, Tomoteru

“…We present the International Lattice Data Grid (ILDG), a loosely federated grid-of-grids for sharing data from Lattice Quantum Chromodynamics (LQCD)…”
Get full text

Gfarm/BB — Gfarm File System for Node-Local Burst Buffer by Tatebe, Osamu, Moriwake, Shukuko, Oyama, Yoshihiro

“…Burst buffer has become a major component to meet the I/O performance requirement of HPC bursty traffic. This paper proposes Gfarm/BB that is a file system for…”
Get full text

Scalable Distributed Metadata Server Based on Nonblocking Transactions by Hiraga, Kohei, Tatebe, Osamu, Kawashima, Hideyuki

“…Metadata performance scalability is critically important in high-performance computing when accessing many small files from millions of clients. This paper…”
Get full text

Disk cache-aware task scheduling for data-intensive and many-task workflow by Tanaka, Masahiro, Tatebe, Osamu

“…Workflow scheduling to maximize I/O performance is one of the key issues in data-intensive, many-task computing. In our previous work, we proposed…”
Get full text

RDMA-Based Direct Transfer of File Data to Remote Page Cache by Sasaki, Shin, Takahashi, Kazushi, Oyama, Yoshihiro, Tatebe, Osamu

“…The performance of a distributed file system significantly affects data-intensive applications that frequently execute I/O operations on large amounts of data…”
Get full text

Agile parallel bioinformatics workflow management using Pwrake by Mishima, Hiroyuki, Sasaki, Kensaku, Tanaka, Masahiro, Tatebe, Osamu, Yoshiura, Koh-Ichiro

“…In bioinformatics projects, scientific workflow systems are widely used to manage computational procedures. Full-featured workflow systems have been proposed…”
Get full text

A Science Cloud for Data Intensive Sciences by Murata, Ken T, Watari, Shinichi, Nagatsuma, Tsutomu, Kunitake, Manabu, Watanabe, Hidenobu, Yamamoto, Kazunori, Kubota, Yasufumi, Kato, Hisao, Tsugawa, Takuya, Ukawa, Kentaro, Muranaga, Kazuya, Kimura, Eizen, Tatebe, Osamu, Fukazawa, Keiichiro, Murayama, Yasuhiro

“…It is often discussed that the fourth methodology for science research is "informatics". The first methodology is a theoretic approach, the second one is…”
Get full text

GHOSTZ PW/GF: Distributed Parallel Homology Search System for Large-scale Metagenomic Analysis by Machida, Kenta, Tatebe, Osamu

“…Genomic data, a typical example of big data, is increasing annually owing to the extensive usage and improved performance of next-generation sequencers…”
Get full text

Workflow Scheduling to Minimize Data Movement Using Multi-constraint Graph Partitioning by Tanaka, M., Tatebe, O.

“…Among scheduling algorithms of scientific workflows, the graph partitioning is a technique to minimize data transfer between nodes or clusters. However, when…”
Get full text

FINCHFS: Design of Ad-Hoc File System for I/O Heavy HPC Workloads by Koyama, Sohei, Hiraga, Kohei, Tatebe, Osamu

“…Although the performance improvements in parallel file systems have been significant, the rise of data science and deep learning using Python has introduced…”
Get full text

I/O-Aware Flushing for HPC Caching Filesystem by Tatebe, Osamu, Hiraga, Kohei, Ohtsuji, Hiroki

“…The increasing difference in performance between computing and storage has caused significant problems for HPC systems. To reduce the difference in…”
Get full text

Accelerating I/O in Distributed Data Processing Systems with Apache Arrow CHFS by Koyama, Sohei, Hiraga, Kohei, Tatebe, Osamu

“…In recent years, distributed data-processing frameworks have become popular for processing big data. However, in an HPC, where the computation and storage…”
Get full text

PPMDS: A Distributed Metadata Server Based on Nonblocking Transactions by Hiraga, Kohei, Tatebe, Osamu, Kawashima, Hideyuki

“…There is a critical problem of metadata performance scalability in high-performance computing when accessing many small files from millions of clients. This…”
Get full text

Integration of Parallel Write Ahead Logging and Cicada Concurrency Control Method by Tanabe, Takayuki, Kawashima, Hideyuki, Tatebe, Osamu

“…We proposed the idea of combining the Cicada concurrency control mechanism with P-WAL (parallel write-ahead logging) and experimentally evaluated the proposed…”
Get full text

Skew-Aware Collective Communication for MapReduce Shuffling by Daikoku, Harunobu, Kawashima, Hideyuki, Tatebe, Osamu

“…This paper proposes and examines the three in-memory shuffling methods designed to address problems in MapReduce shuffling caused by skewed data. Coupled…”
Get full text

Three-dimensional spatial join count exploiting CPU optimized STR R-tree by Mitsuhashi, Ryuya, Kawashima, Hideyuki, Nishimichi, Takahiro, Tatebe, Osamu

“…In this study, we attempt to address the issue regarding the spatial join count, where in the number of particles around a halo is counted only once for a…”
Get full text

Gfarm Grid File System by Tatebe, Osamu, Hiraga, Kohei, Soda, Noriyuki

“…Gfarm Grid file system is a global distributed file system to share data and to support distributed data-intensive computing. It federates local file systems…”
Get full text

Data-Aware Task Dispatching for Batch Queuing System by Xieming Li, Tatebe, Osamu

“…This paper describes a scheduling method focusing on exploiting the local access of a nonuniform storage-access file system. In our approach, the file access…”
Get full text

Applying Pwrake Workflow System and Gfarm File System to Telescope Data Processing by Tanaka, Masahiro, Tatebe, Osamu, Kawashima, Hideyuki

“…In this paper, we describe a use case applying a scientific workflow system and a distributed file system to improve the performance of telescope data…”
Get full text

POSTER: Preliminary evaluation of optimized transfer method for cluster-wide RAID-4 by Ohtsuji, Hiroki, Tatebe, Osamu

“…Exa-scale storage systems will require a reliable and high bandwidth I/O mechanism. Replication and erasure coding among storage nodes are often used to…”
Get full text