How to do incremental training using 2 batches of dataset, where the tool is anything except neural network
1 visualizzazione (ultimi 30 giorni)
Mostra commenti meno recenti
debasmita bhoumik
il 17 Gen 2018
Commentato: Greg Heath
il 21 Gen 2018
I am a novice in this field. I have two training datasets. 1st I want to train the machine with Dataset X (from fisherirish) which has 150 entries, After that I want to train the already trained model with a new dataset T2 , which has also 50 entries. Using FITCNB what i did was
X=meas
Y=specieserrorcopy
Mdl = fitcnb(X,Y)
label = predict(Mdl,X)
L = loss(Mdl,X,Y)
accERR=1-L
Please help me how to use this Mdl to train again using T2.
0 Commenti
Risposta accettata
Greg Heath
il 17 Gen 2018
The new training will override the old.
Therefore you have to either
a. Add the old training set to the new one
or
b. Add representative examples of the new dataset to the old one.
Then retrain to obtain new coefficients.
Decades ago, the Army asked me to design a set of classifiers that would identify the different products resulting from a missile deployment (e.g., missile, decoys, & deployment hardware). New test flight data was delivered periodically.
I found the best approach was to use a radial basis function classifier. When new data was run through the classifier and misclassified, new clusters were added to the data base. Then new and old coefficients were updated to minimize error rates.
Hope this helps.
Thank you for formally accepting my answer
Greg
2 Commenti
Greg Heath
il 21 Gen 2018
Ideally, you should know the SS (i.e., summary statistics, e.g, means, standard deviations and cross correlations) of all original and new training, validation and testing data.
For valid results the SS of all should be similar.
Otherwise, satisfactory performance cannot be guaranteed.
Hope this helps.
Greg
Più risposte (1)
debasmita bhoumik
il 17 Gen 2018
1 Commento
Greg Heath
il 21 Gen 2018
See my above comment.
I was thinking of NNs, however, if you think about it, it has to be valid in general.
Hope this helps.
Greg
Vedere anche
Categorie
Scopri di più su Image Data Workflows in Help Center e File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!