Samsung NOTE 3 wont turn on without plugging in!

Hello Please,

My Tmobile Samsung Note 3 wont turn on without plugging in!

If on it works very well, if powered of and powered on, no problem. BUT if i ever remove battery from it and re-insert, it will not power on unless i plug in charger, wait for the Batter Charging display, the remove the charger, only then will it turn on!

Even if battery is 100%, if ever removed from the phone and re-inserted, it will noy power on. I will have to look for power to plug it in and let the battery charge for a 1 or 2 sec, then remove charger, then it will power on.