If you use a windows based overclocking utility it is a lot safer than going in to your BIOS. You should avoid changing any voltage settings unless you have water cooling and you should keep an eye on your temps after overclocking to make sure they are safe.

If you are interested in trying, let me know what cpu/MB you have. Also some cpu's do not allow overclocking.