Do not decode non reference pictures while prerolling.
It improves seek performance when decoding with ffmpeg.