How to tune the regularization parameter in extreme learning machine?

2 visualizzazioni (ultimi 30 giorni)
I train ELM on my dataset and gives test accuracy of 92.13. I wonder how to tune parameters to gain more test accuracy?
  1 Commento
BERGHOUT Tarek
BERGHOUT Tarek il 3 Feb 2019
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.

Accedi per commentare.

Risposta accettata

BERGHOUT Tarek
BERGHOUT Tarek il 4 Feb 2019
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.

Più risposte (0)

Categorie

Scopri di più su Genomics and Next Generation Sequencing in Help Center e File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by