The essence of the world is mathematics.
Since ‘Yuan Gui’ landed in Hainan, it has weakened considerably; the outside world is no longer experiencing crazy, fierce gales. It should have passed its most intense phase by now.
A few days ago, I went to the library and found that, as expected, they had purchased many new books. I wonder if it was because of my suggestion 233 (I seem to have filled out this feedback when the library previously asked for input).
Recently, I’ve also read some books on optimization and happened to re-review SGD. Previously, I just skimmed the books and it was simple to get through, but when I tried to derive it by hand, I realized I still didn’t fully understand it. The reason is that I never systematically studied matrix calculus; in many cases, I couldn’t grasp the derivation process and merely applied formulas by rote. Therefore, I recently planned to read Matrix Cookbook1!
