Don't use the var_SetTime hack anymore and don't flush the fifo when
it's not necessary.
Fix #5967 and #2855
Signed-off-by: Jean-Baptiste Kempf <jb@videolan.org>