Lottery Tickets are Misleading! Use Escape Dimensions to Explain the Success of Overparameterization
PAPER 📝 We challenge the lottery ticket metaphor for understanding overparameterization. We propose Escape Dimensions Theory as a new mental picture based on loss landscape theory. Check out the full article in the blog page.