We don´t want to discard decoded data if seeking during prefoll then
the timestamps restart from lower values.