Most people have difficulty with Karakura Castle because they have to consistently fight multiple enemies. As a result, you need to build up your stamina. Get some Fresh Soldier Pills and that should give you a decent boost to your damage.