Federated-Learning on Bingjie's Blog https://blog.bj-yan.top/en/tags/federated-learning/ Recent content in Federated-Learning on Bingjie's Blog https://blog.bj-yan.top/favicon.png https://blog.bj-yan.top/favicon.png Hugo -- gohugo.io en-US Tue, 22 Aug 2023 17:58:41 +0800 The Dirichlet Distribution in Federated Learning: From Probability Vectors to Non-IID Data Partitioning https://blog.bj-yan.top/en/p/blog-dirichlet-distribution-in-federated-learning/ Tue, 22 Aug 2023 17:58:41 +0800 https://blog.bj-yan.top/en/p/blog-dirichlet-distribution-in-federated-learning/ Introduces the definition, concentration parameters, and statistical properties of the Dirichlet distribution, distinguishes between two directions of federated data partitioning, and provides a reproducible, complete NumPy implementation along with methods for experimental verification. Convergence Analysis in Federated Learning (Part 5) https://blog.bj-yan.top/en/p/blog-convergence-analysis-in-deep-learning-part-5/ Tue, 08 Aug 2023 15:04:00 +0800 https://blog.bj-yan.top/en/p/blog-convergence-analysis-in-deep-learning-part-5/ Deriving non-convex stationary point bounds and strongly convex error bounds under full participation from FedAvg's local updates, distinguishing gradient noise, client drift, and sampling error, while discussing partial participation and heterogeneity corrections. Accelerating Federated Learning Simulation with MPI https://blog.bj-yan.top/en/p/blog-accelerating-federated-learning-simulation-using-mpi/ Tue, 21 Mar 2023 12:41:13 +0800 https://blog.bj-yan.top/en/p/blog-accelerating-federated-learning-simulation-using-mpi/ Building a federated learning simulator using mpi4py and PyTorch, covering server-client architecture, MPI execution flow, multi-process execution, and experimental performance.