File size of saved reinforcement learning agents

Hello everyone!

I am training an rlSACAgent with a Simscape model, and to later visualize the progress, i set the SaveAgentCriteria to EpisodeRewards and a very low value, such that every agent is saved. After training overnight, I noticed that the filesizes of the agents were steadily increasing from 124 KB at episode 0 to 273 MB at episode 2215. When I last saved an agent manually after the finished training, its size was only 788 KB, so do you now where the 273 MB come from? Is Simulink storing all the agents up to the current episode in one file?

Cheers and thanks a lot!

Answer 1

[Emmanouil Tzorakoleftherakis]

Hello,

Is this parameter set to true? If yes, then it makes sense that mat files are growing in size as the buffer is being populated.

If that's not the case, I would recommend creating a technical support case so that the deveopers can take a look.