Validation Accuracy is changing when the same classifier is trained on the same data

1 visualizzazione (ultimi 30 giorni)
Hello. I am using ensemble classifiers in the Matlab Classification Learner. The problem is that I am getting different accuracies when training the same classifier (Bagged Trees) on the same data.

Risposta accettata

Walter Roberson
Walter Roberson il 19 Gen 2017
Most of the classifiers include random initialization. To repeat the same accuracy with the same classifier on the same data, set the random number seed each time, using rng()
  2 Commenti
Mortada Haidar
Mortada Haidar il 19 Gen 2017
Ok I see. But then how can I assess the performance of my model? Validation accuracy is changing drastically when changing the seed..
Walter Roberson
Walter Roberson il 19 Gen 2017
In such a case you have to assume that there is a lot of over-fitting. Reduce the size of your training set and increase the size of your test set.

Accedi per commentare.

Più risposte (0)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by