EVFeX: An efficient vertical federated XGBoost algorithm based on optimized secure matrix multiplication

• Published in: Signal processing Vol. 227; p. 109686
• Main Authors: Zhang, Fangjiao, Wang, Li, Cui, Chang, Meng, Qingshu, Yang, Min
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01-02-2025
• Subjects: QR decomposition; Secure matrix multiplication; Secure multi-party computation; Vertical federated learning; XGBoost; Secure multi-party computation; Vertical federated learning; Secure matrix multiplication; XGBoost; QR decomposition
• ISSN: 0165-1684
• DOI: 10.1016/j.sigpro.2024.109686

Federated Learning is a distributed machine learning paradigm that enables multiple participants to collaboratively train models without compromising the privacy of any party involved. Currently, vertical federated learning based on XGBoost is widely used in the industry due to its interpretability. However, existing vertical federated XGBoost algorithms either lack sufficient security, exhibit low efficiency, or struggle to adapt to large-scale datasets. To address these issues, we propose EVFeX, an efficient vertical federated XGBoost algorithm based on optimized secure matrix multiplication, which eliminates the need for time-consuming homomorphic encryption and achieves a level of security equivalent to encryption. It greatly enhances efficiency and remains unaffected by data volume. The proposed algorithm is compared with three state-of-the-art algorithms on three datasets, demonstrating its superior efficiency and uncompromised accuracy. We also provide theoretical analyses of the algorithm’s privacy and conduct a comparative analysis of privacy, efficiency, and accuracy with related algorithms.
[Display omitted]
•Introducing a customized QR decomposition method tailored to the VFeX scenarios.•Proposing an optimized secure matrix multiplication to reduce memory overhead.•Theoretically analyzing the security, time complexity, and space complexity of EVFeX.•Empirically demonstrating the stable efficiency superiority of EVFeX.