ReLU Playground: how complex are the dynamics of one neuron learning another one?

⚠️This page is under construction⚠️

But in the meantime you can play with the relus by moving them around with the mouse, or type in some values. Press play to start learning!

Can you find which initialisations can converge to the teacher? How do other solutions look like? By looking at the different phase spaces, can you get an intuitive understanding of the learning dynamics?