Synchro-waveform data compression using multi-stage hybrid coding algorithm

• Published in: Measurement : journal of the International Measurement Confederation Vol. 232; p. 114709
• Main Authors: Qiu, Wei, Yin, He, Wu, Yuru, Chen, Chang, Zhan, Lingwei, Zeng, Chujie, Liu, Yilu
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 15-06-2024
• Subjects: Lossless compression; Multi-stage hybrid coding; Situational awareness; Synchro-waveform measurements; Lossless compression; Synchro-waveform measurements; Situational awareness; Multi-stage hybrid coding
• DOI: 10.1016/j.measurement.2024.114709
• EISSN: 1873-412X
• ISSN: 0263-2241

To augment situational awareness capabilities for high-frequency disturbances, the modern power system necessitates the implementation of high-sampling rates for real-time Synchro-Waveform (SW) measurements. Nevertheless, the nonlinear nature of data collected from SW measurement devices poses significant challenges to the communication and storage capacities of data centers. To effectively tackle this issue, this paper proposes a Multi-stage Hybrid Coding (MHC) method for the lossless compression of SW data. The MHC method utilizes a well-structured two-stage approach to achieve efficient compression. In the first stage, a variable frame-based method is designed to reduce redundant information and achieve initial compression using multiple periodic recursive compression. Subsequently, the dictionary-based method, specifically the Lempel–Ziv–Markov chain algorithm, is seamlessly integrated to further compress the SW data. Experimental and numerical analyses are conducted using both simulated and real-world source data, with real-time performance validation in SW measurement units. The obtained results convincingly demonstrate that the proposed method enables online compression of both event and non-event SW data, achieving an impressive reduction of over 73.4% in data space, while maintaining a data loss ratio lower than 0.4% for high-density SW data.
•Multiple periodic recursive method is proposed to eliminate repetitive information.•A multi-stage hybrid coding method is implemented for the lossless compression.•A series of synchro-waveform events are collected to evaluate the performance.