Dropout can create a privileged basis in the ReLU output model

Posted on April 28, 2023

You can find this post on lesswrong here

I wrote this post on lesswrong because the ‘problem set’ I got it from was originally posted there, and so it seemed like a more appropriate venue. Also, at the time, the only version of my website was still hosted on the uni servers, and I didn’t have access to it.

Now I’ve got the website back up, I decided to collect it with my other posts.