Choosing the right power regulator for Battery powered designs

I've come across this problem a number of times in my hobby projects, but I am sick of making an educated guess.

I often do microcontroller projects and often want them to be powered by a 3.7V Lipo cell charged by a standard microusb cable. This means input voltage can range from 3.0V to 5.0V and I want an output voltage of 3.3V. With thousands of voltage regulators that can fit those requirements, how do you choose?

I can ask about each specific project to get the right regulators, but I would rather have the knowledge I need to find the right regulators on my own. I'll add edits as I find more answers.

Edit1:

Switching Regulator - This is the only choice if you need to boost voltage. They are the most efficient and produce less heat than LDO's, but produce noise not usable with RF applications including bluetooth and wifi and are generally more expensive. If you want to use this with RF then you will need proper filtering.

LDO - LDO's are cheap and are preferred for RF applications because LDO's produce no EMI interference. They generally have poor efficiency but the efficiency depends on the ratio of the input to output voltage. The closer the two are, the more efficient the output will be. In high current applications they can produce a lot of heat so proper cooling may be required.

Charge-pump - A subset of switching regulators that don't require an external inductor. They generally have worse efficiency than inductor-based switching regulators but are better than LDO's. They can also only output relatively small amounts of current. These should be used when you need better efficiency than an LDO but are constrained on board space.

Hybrid - There are a few companies who make hybrid Switching/ldo regulators. These provide the efficiency of a switching regulator with the noiseless output of an LDO. The downside is there are very view of them and they don't have high output current in most cases. These still produce heat like an LDO.

Quiescent Current - In battery powered applications you need to be concerned about the amount of current the regulator uses to function. The more power it uses, the less battery power is left for your device. LDO's generally have much smaller quiescent current than switching regulators, but since switching regulators have the ability to boost voltage when input voltage drops below desired output voltage, which to use depends on your devices voltage requirements.