Performance Evaluation of High-Performance and Flexible Protocol on Data Mover Challenge

• Published in: 2020 - 5th International Conference on Information Technology (InCIT) pp. 265 - 269
• Main Authors: Pavarangkoon, Praphan, Murata, Ken T., Yamamoto, Kazunori, Fujita, Naoyuki, Ohkawa, Hirofumi, Mikai, Hidekazu, Ikehata, Yosuke, Muranaga, Kazuya, Mizuhara, Takamichi, Takaki, Ayahiro, Kakizawa, Yasunori
• Format: Conference Proceeding
• Language: English
• Published: IEEE 21-10-2020
• Subjects: Bandwidth; Data transfer; Packet loss; Protocols; Servers; Throughput
• DOI: 10.1109/InCIT50588.2020.9310956

Data mover challenge (DMC) for Supercomputing Asia organized by the National Supercomputing Centre (NSCC), Singapore is a competition for data transfer node (DTN) architecture. This challenge invites experts from academia and industry to test their software and products on advanced 100G research and education networks. The theme for DMC20 is data for science, which focuses on moving the large amounts of data between multiple sites with DTNs and between high performance computing (HPC) centers around the world. In this paper, we present performance evaluation of data transfer protocol, called high-performance and flexible protocol (HpFP), on DMC20. The data transfer tests are done using high-performance copy (HCP), which is an enhanced HpFP-based file transfer tool. The results show that the HpFP outperforms the traditional protocol on scenario with high packet loss. Tuning parameters and problems are discussed to improve the performance of our file transfer tool as well.