Can't use granule 0 as it means there's still no valid first sample
after processing packet.
Fix start gap on opus webradios.