The decoder downstream is not allowed to return smaller pictures than
requested. Only alignment can still potentially be an issue.