Allow audio pts fluctuate within drift limits as we calculate the drift
related to master sync time anyway.