https://blog.bj-yan.top/en/tags/efficiency/ Recent content in Efficiency on Bingjie's Blog https://blog.bj-yan.top/favicon.png https://blog.bj-yan.top/favicon.png Hugo -- gohugo.io en-US Wed, 09 Aug 2023 00:54:19 +0800 https://blog.bj-yan.top/en/p/blog-efficiency-analysis-of-distributed-machine-learning/ Wed, 09 Aug 2023 00:54:19 +0800 https://blog.bj-yan.top/en/p/blog-efficiency-analysis-of-distributed-machine-learning/ Analyzing the stochastic runtime of synchronous, asynchronous, and K-worker SGD, and discussing the time to reach target accuracy and parallel speedup limits in conjunction with convergence bounds.