This is the simple explanation.
When you convert from one power source to another you compare power, power = watts.
Watts = amps x volts.
You have a USB port that will only give you 150mA without a negotiated output. This means that you can only have 150mA without having a microprocessor talk to the USB port and request more current. If more current is available it will then give it to you.
You are talking about using a simple DC to DC converter that has no ability to communicate with the USB port, so you will only get 150mA.
150mA (milli amp) = .15A
Watts = amps x volts
.15A x 5v = .75 Watts
You have a 12v fan that needs .08A current.
.08A x 12v = .96 Watts, you are short .96W - .75W = .21 Watts, and this is assuming 100% conversion efficiency. The cheap junk on Ebay may be as low as 70%.