For usec delays use udelay instead of scheduling, this should
allow reclocking to happen faster.
Signed-off-by: Dave Airlie <airlied@redhat.com>