digit detect method video

hi i have algorithm which can recognize digits in image, the issue is that i have video of the images and each time there is light on some digits so only part of digits can be seen int other frame this digits seen, what i need to do to combine detections from different frames. i have some rectangle around digits but its not stable , i was thinking about some registration. since i want to detect digit and location order. or maybe use video stabilization or optical flow