When you have any loads such as servos that draw high current, the safest way is to separate servo power from receiver power. Just use any small capacity battery (the current drain is very low) to power only the receiver and then power the servos with a separate bus. Now, even if you get a momentary voltage drop on the servo bus, the receiver keeps on chirping happily along and you will never suffer a brown out.