BBB: Make Benchmarking Blockchains Configurable and Extensible

• Published in: 2019 IEEE 24th Pacific Rim International Symposium on Dependable Computing (PRDC) pp. 61 - 611
• Main Authors: Duan, Xuheng, Pan, Haochen, Tseng, Lewis, Wu, Yingjian
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-12-2019
• Subjects: BBB; Benchmarking; Blockchain; Evaluation; HyperLedger
• ISSN: 2473-3105
• DOI: 10.1109/PRDC47002.2019.00026

Interest in Blockchain technology gradually developed after Bitcoin was introduced in 2008, and has grown exponentially as Blockchain can be applied in many scenarios that require coordination among parties that do not typically trust each other. Due to its popularity and wide applications, enormous number of Blockchain systems have been proposed in the past few years. One way to understand the performance is to build a benchmarking tool to evaluate different systems under different scenarios. A few research teams have build their benchmarking tools, such as BLOCKBENCH and HFBench. Unfortunately, there are several limitations of these tools. In this paper, we enumerate these limitations and challenges. We then present our tool - Boston Blockchain Benchmarking (BBB), which is more configurable and extensible than prior benchmarking tools. Moreover, BBB allows us to evaluate the impact of some common attacks against Blockchains. Finally, we present some preliminary results using BBB.