SignSGD Isn't Just a Hack — It's Provably Faster Than SGD by a Factor of d, If You Measure in the Right Norm

SignSGD Isn't Just a Hack — It's Provably Faster Than SGD by a Factor of d, If You Measure in the Right Norm | BedrockNews