After more digging, the problem is that Matlab resets the datastore/minibatchqueue after reloading from a checkpoint rather than continuing from the checkpoint.
Is this a bug or an (undocumented) feature?
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!