I forgot to mention, that with the mini breakout board, I have found that there are some limitations on USB host mode, in particular if you do something like a soft reboot with USB devices attached, the system will not properly detect the devices. lsusb will return a -1 type error. However it did work properly for me, if I
a) Attach the first device after the processor has booted up.
b) Do it from a cold power up. i.e. - you can have the USB devices installed and then apply power to the Edison and it works.
So I do think there is an issue that I hope someone will figure out for the next firmware release. But I don't think this is your issue as you have shown lsusb output.
This has been discussed in other threads, including: USB Host mode from boot