Problems caused by dead ReLU

https://zhuanlan.zhihu.com/p/67054518zhuanlan.zhihu.com

One of the TOSummarize list article.

PreviousDeep Learning DebugNextLoss jumps to 87.3365

Last updated