Search Results - "Gu, Junmin"

ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management by Godoy, William F., Podhorszki, Norbert, Wang, Ruonan, Atkins, Chuck, Eisenhauer, Greg, Gu, Junmin, Davis, Philip, Choi, Jong, Germaschewski, Kai, Huck, Kevin, Huebl, Axel, Kim, Mark, Kress, James, Kurc, Tahsin, Liu, Qing, Logan, Jeremy, Mehta, Kshitij, Ostrouchov, George, Parashar, Manish, Poeschel, Franz, Pugmire, David, Suchyta, Eric, Takahashi, Keichi, Thompson, Nick, Tsutsumi, Seiji, Wan, Lipeng, Wolf, Matthew, Wu, Kesheng, Klasky, Scott

“…We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2 addresses scientific data management needs ranging from scalable I/O…”
Get full text

Performance Analysis, Design Considerations, and Applications of Extreme-Scale In Situ Infrastructures by Ayachit, Utkarsh, Bauer, Andrew, Duque, Earl P. N., Eisenhauer, Greg, Ferrier, Nicola, Junmin Gu, Jansen, Kenneth E., Loring, Burlen, Lukic, Zarija, Menon, Suresh, Morozov, Dmitriy, O'Leary, Patrick, Ranjan, Reetesh, Rasquin, Michel, Stone, Christopher P., Vishwanath, Venkat, Weber, Gunther H., Whitlock, Brad, Wolf, Matthew, Wu, K. John, Bethel, E. Wes

“…A key trend facing extreme-scale computational science is the widening gap between computational and I/O rates, and the challenge that follows is how to best…”
Get full text

Apply Block Index Technique to Scientific Data Analysis and I/O Systems by Wu, Tzuhsien, Chou, Jerry, Podhorszki, Norbert, Gu, Junmin, Tian, Yuan, Klasky, Scott, Wu, Kesheng

“…Scientific discoveries are increasingly relying on analysis of massive amounts of data. The ability to directly access the most relevant data records through…”
Get full text

Improving I/O Performance for Exascale Applications Through Online Data Layout Reorganization by Wan, Lipeng, Huebl, Axel, Gu, Junmin, Poeschel, Franz, Gainaru, Ana, Wang, Ruonan, Chen, Jieyang, Liang, Xin, Ganyushin, Dmitry, Munson, Todd, Foster, Ian, Vay, Jean-Luc, Podhorszki, Norbert, Wu, Kesheng, Klasky, Scott

“…The applications being developed within the U.S. Exascale Computing Project (ECP) to run on imminent Exascale computers will generate scientific results with…”
Get full text

Adaptation and policy-based resource allocation for efficient bulk data transfers in high performance computing environments by Chervenak, Ann L., Sim, Alex, Gu, Junmin, Schuler, Robert E., Hirpathak, Nandan

“…Many science applications increasingly make use of data-intensive methods that require bulk data movement such as staging of large datasets in preparation for…”
Get full text

Visualization and Analysis for Near-Real-Time Decision Making in Distributed Workflows by Pugmire, David, Kress, James, Jong Choi, Klasky, Scott, Kurc, Tahsin, Churchill, Randy Michael, Wolf, Matthew, Eisenhower, Greg, Childs, Hank, Kesheng Wu, Sim, Alexander, Junmin Gu, Low, Jonathan

“…Data driven science is becoming increasingly more common, complex, and is placing tremendous stresses on visualization and analysis frameworks. Data sources…”
Get full text

Improving I/O Performance for Exascale Applications through Online Data Layout Reorganization by Wan, Lipeng, Huebl, Axel, Gu, Junmin, Poeschel, Franz, Gainaru, Ana, Wang, Ruonan, Chen, Jieyang, Liang, Xin, Ganyushin, Dmitry, Munson, Todd, Foster, Ian, Vay, Jean-Luc, Podhorszki, Norbert, Wu, Kesheng, Klasky, Scott

“…The applications being developed within the U.S. Exascale Computing Project (ECP) to run on imminent Exascale computers will generate scientific results with…”
Get full text

Efficient Data Staging Using Performance-Based Adaptation and Policy-Based Resource Allocation by Chervenak, Ann L., Sim, Alex, Junmin Gu, Schuler, Robert, Hirpathak, Nandan

“…Before scientific analyses run on shared infrastructure, such as the Open Science Grid or XSEDE, scientists must often transfer or stage key data sets those…”
Get full text

Resolution dependence of precipitation statistical fidelity in hindcast simulations by O'Brien, Travis A., Collins, William D., Kashinath, Karthik, Rübel, Oliver, Byna, Suren, Gu, Junmin, Krishnan, Hari, Ullrich, Paul A.

“…Numerous studies have shown that atmospheric models with high horizontal resolution better represent the physics and statistics of precipitation in climate…”
Get full text

Adaptive Data Transfers that Utilize Policies for Resource Sharing by Junmin Gu, Smith, David, Chervenak, Ann L., Sim, Alex

“…With scientific data collected at unprecedented volumes and rates, the success of large scientific collaborations requires that they provide distributed data…”
Get full text

StorNet: Co-scheduling of end-to-end bandwidth reservation on storage and network systems for high-performance data transfers by Junmin Gu, Katramatos, Dimitrios, Xin Liu, Natarajan, Vijaya, Shoshani, Arie, Sim, Alex, Dantong Yu, Bradley, Scott, McKee, Shawn

“…Modern scientific data-intensive applications brought about the need for novel data transfer technologies and automated tools capable of effectively utilizing…”
Get full text

Object-extended OLAP querying by Pedersen, Torben Bach, Gu, Junmin, Shoshani, Arie, Jensen, Christian S.

“…On-line analytical processing (OLAP) systems based on a dimensional view of data have found widespread use in business applications and are being used…”
Get full text

DataMover: robust terabyte-scale multi-file replication over wide-area networks by Sim, A., Junmin Gu, Shoshani, A., Natarajan, V.

“…Typically, large scientific datasets (order of terabytes) are generated at large computational centers, and stored on mass storage systems. However, large…”
Get full text

Storage Resource Managers: Recent International Experience on Requirements and Multiple Co-Operating Implementations by Abadie, L., Badino, P., Baud, J.-P., Corso, E., Crawford, M., De Witt, S., Donno, F., Forti, A., Frohner, A., Fuhrmann, P., Grosdidier, G., Junmin Gu, Jensen, J., Koblitz, B., Lemaitre, S., Litmaath, M., Litvinsev, D., Lo Presti, G., Magnoni, L., Mkrtchan, T., Moibenko, A., Mollon, R., Natarajan, V., Oleynik, G., Perelmutov, T., Petravick, D., Shoshani, A., Sim, A., Smith, D., Sponza, M., Tedesco, P., Zappi, R.

“…Storage management is one of the most important enabling technologies for large-scale scientific investigations. Having to deal with multiple heterogeneous…”
Get full text

Unraveling Diffusion in Fusion Plasma: A Case Study of In Situ Processing and Particle Sorting by Gu, Junmin, Lin, Paul, Wu, Kesheng, Ku, Seung-Hoe, Chang, C. S, Churchill, R. Michael, Choi, Jong, Podhorszki, Norbert, Klasky, Scott

“…This work starts an in situ processing capability to study a certain diffusion process in magnetic confinement fusion. This diffusion process involves plasma…”
Get full text

Transitioning from file-based HPC workflows to streaming data pipelines with openPMD and ADIOS2 by Poeschel, Franz, E, Juncheng, Godoy, William F, Podhorszki, Norbert, Klasky, Scott, Eisenhauer, Greg, Davis, Philip E, Wan, Lipeng, Gainaru, Ana, Gu, Junmin, Koller, Fabian, Widera, René, Bussmann, Michael, Huebl, Axel

“…This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the…”
Get full text

Improving I/O Performance for Exascale Applications through Online Data Layout Reorganization by Wan, Lipeng, Huebl, Axel, Gu, Junmin, Poeschel, Franz, Gainaru, Ana, Wang, Ruonan, Chen, Jieyang, Liang, Xin, Ganyushin, Dmitry, Munson, Todd, Foster, Ian, Vay, Jean-Luc, Podhorszki, Norbert, Wu, Kesheng, Klasky, Scott

“…IEEE Transactions on Parallel and Distributed Systems, 2021 The applications being developed within the U.S. Exascale Computing Project (ECP) to run on…”
Get full text

Grid collector: an event catalog with automated file management by Kesheng Wu, Wei-Ming Zlang, Sim, A., Junmin Gu, Shoshani, A.

“…High Energy Nuclear Physics (HENP) experiments such as STAR at BNL and ATLAS at CERN produce large amounts of data that are stored as files on mass storage…”
Get full text