It doesn't make any sense for audio decoders and only leads to
extra log warnings.
Signed-off-by: Martin Storsjö <martin@martin.st>