Howard H. Yang (Zhejiang University) – Federated Learning Over the Air: A Tale of Interference
Howard H. Yang (Zhejiang University) – Federated Learning Over the Air: A Tale of Interference
Abstract
This talk aims to present the current research efforts on the development of implementing distributed machine learning algorithms in wireless systems. Specifically, we provide a comprehensive coverage of a distributed learning paradigm based on over-the-air computing, a.k.a. over-the-air federated learning (OTA-FL). We will present an analytical framework that quantifies the convergence rate of OTA-FL. Then, we discuss the system enhancements from an algorithmic perspective, i.e., adopting adaptive optimizations to accelerate the model training. We also introduce model pruning schemes that reduce the computation and communication overheads for OTA-FL. Finally, we will elaborate on the analysis of generalization error of the statistical models trained by OTA-FL, which shows that wireless interference has the positive potential of improving the generalization capability.
Papers:
- H. H. Yang, Z. Chen, T. Q. S. Quek, and H. V. Poor, “Revisiting Analog Over-the-Air Machine Learning: The Blessing and Curse of Interference,” IEEE J. Sel. Topics Signal Process., vol. 16, no. 3, pp. 406–419, Apr. 2022.
- Z. Chen, H. H. Yang, and T. Q. S. Quek, “Edge Intelligence Over the Air: Two Faces of Interference in Distributed Learning,” IEEE Commun. Mag., vol. 61, no. 12, pp. 62–68, Dec. 2023.
- H. H. Yang, Z. Chen, and T. Q. S. Quek, “Unleashing Edgeless Federated Learning with Analog Transmissions,” IEEE Trans. Signal Process., vol. 72, pp. 774–791, Jan. 2024.
- C. Wang, Z. Chen, N. Pappas, H. H. Yang, T. Q. S. Quek, and H. V. Poor, “Adaptive Federated Learning Over the Air,” IEEE J. Sel. Areas Commun., submitted.
- Z. Xiao, Z. Chen, S. Liu, H. Wang, Y. Feng, J. Hao, J. T. Zhou, J. Wu, H. H. Yang, and Z. Liu, “Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancer,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), Dec. 2023.
About the Speaker
Howard H. Yang received his Ph.D. degree in Electrical Engineering from the Singapore University of Technology and Design (SUTD). Currently, he is an assistant professor at the ZJU-UIUC Institute, Zhejiang University, China. He is also an adjunct assistant professor with the Department of Electrical and Computer Engineering at the University of Illinois Urbana-Champaign, IL, USA.
Dr. Yang serves as an editor for the IEEE Transactions on Wireless Communications. He received the IEEE ComSoc Asia-Pacific Outstanding Young Researcher Award in 2023, the IEEE Signal Processing Society Best Paper Award in 2022, and the IEEE WCSP 10-Year Anniversary Excellent Paper Award in 2019. He was recognized as the “6G Rising Star” Young Scholar by the Global 6G Conference in 2024.
For more information about the ESD Seminar, please email esd_invite@sutd.edu.sg