However, it is unclear to me what metric to compute on the validation test set to find when to stop. I want to use the validation set to find when to stop training before I will use the test set for finding the generalisation performance. I have split my data into the following 3 sets: Furthermore, I have only been able to find information on ANNs with a single hidden layer (such as ), whereas my CNN has 4 convolutional layers and a few other layers, which may likely need a different early stopping criteria.
When looking into the literature I haven't been able to find any information on using early stopping for optimizing training time rather than generalization performance. The early stopping criteria would also help avoid overfitting, but that is just a by-product as my CNN doesn't really overfit that much due to dropout etc. I therefore want to set a quite high limit on the number of iterations while using an early stopping criteria to avoid spending time training after the performance has converged. The main reason is that I want to test my CNN using various parameter settings and some of these may require more iterations than others to train. I want to implement early stopping for my convolutional neural network.
0 kommentar(er)
