This reverts commit ecec3b3e.

The mcbsp in DSP memory area need handling for phys_base.
Signed-off-by: Tony Lindgren <tony@atomide.com>