The OMAP5910 datasheet says that the lb clock needs enabled for USB
to work, so it seems reasonable that this is required.