JPEG Image Deblocking Do Not Converge

I use Matlab Example: JPEG Image Deblocking Using Deep Learning

to do a transfer learning . I use 24 samples with same format . But the training loss diagram show regularly oscillating and I Cannot figure out what happened.