Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
TuringsSolutions 
posted an update 1 day ago
Post
1083
Neural Network Chaos Monkey: Randomly shuts off parts of the neural network during training. The Chaos Monkey is super present at Epoch 1, is gone by the final Epoch. My hypothesis was that this would either increase the robustness of the model, or it would make the outputs totally worse. You can 100% reproduce my results, chaos wins again.

https://youtu.be/bWA9unotJ7k
takeraparterer

this already exists, it's called dropout

·
TuringsSolutions
•
edited about 22 hours ago

@takeraparterer I am aware that dropout exists or I probably could not build this in the first place. This is dropout on steroids. I love random commenters!

In this post