How is it possible to use a validation set with a LSTM?
32 visualizzazioni (ultimi 30 giorni)
Mostra commenti meno recenti
When I try to use the Validation set with a LSTM layer, it shows the following error:
options = trainingOptions('adam', ...
'ExecutionEnvironment','gpu', ...
'GradientThreshold',1, ...
'MaxEpochs',maxEpochs, ...
'ValidationData',{XTest,YTest},...
'MiniBatchSize',miniBatchSize, ...
'LearnRateSchedule','piecewise', ...
'SequenceLength','longest', ...
'Shuffle','never', ...
'Verbose',0, ...
'Plots','training-progress');
net = trainNetwork(XTrain,categorical(YTrain),layers,options);
Error:
Training with validation data is not supported for networks with LSTM layers.
Is there another way to use the Validation set during the training of the network?
1 Commento
Kenta
il 14 Mar 2020
Now that, the use of validation data with LSTM network is available.
The example follows:
Risposta accettata
Joss Knight
il 29 Apr 2018
It's ugly, but if you use Checkpoints, then you can use an OutputFcn to (once per epoch) load the network from a checkpoint and run it against your validation data. It isn't very efficient, but it's okay if you're only doing it once per epoch. You won't get it on the training plot of course.
10 Commenti
Joss Knight
il 6 Ott 2020
Hey M J, you should probably ask a new question and provide a bit more detail and code. Thanks.
M J
il 8 Ott 2020
Modificato: M J
il 8 Ott 2020
Hi, thank you for your answer. I did ask a new question (see link below) :
I do not have a code for this, as I am really not sure where to even start. Also, I am not sure if it is okay to post a link to the question here, but if not, please let me know. Thank you.
Più risposte (2)
Mads Bergholt
il 17 Mag 2018
Dear Joss, will this be part of Matlab 2018b? This is an aspect of LSTM that is very important for validating these algorithms.
Best regards Mads
3 Commenti
XIANFENG XU
il 7 Nov 2018
I am sorry to say that this is still not included in Matlab 2018b. Sigh. Maybe we have to turn to Tensorflow for deep learning.
Joss Knight
il 13 Nov 2018
ValidationData is indeed supported for Sequence Networks in R2018b: https://www.mathworks.com/help/deeplearning/ref/trainingoptions.html#bu59f0q_sep_mw_4d4d5e80-6684-47de-986c-f9f8258b7c6d
There are some restrictions on the format of the data.
Vedere anche
Categorie
Scopri di più su Sequence and Numeric Feature Data Workflows in Help Center e File Exchange
Prodotti
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!