This reverts commit af82f9a8.

Otherwise at least 24xx framebuffer breaks.
Signed-off-by: Tony Lindgren <tony@atomide.com>