Getting rid of a co-director in a limited company

I own a leasehold flat in a block of three. In the summer, along with the other two owners of the flats, I set up a freehold company in which the freehold and the right to manage is vested. The middle flat owner and I have paid in our ground rent and various other money for expenses but, despite many promises over the past few months, the ground floor flat owner has paid nothing (and in fact has caused extra expense in various ways). I have now had to sub the freehold company several hundred pounds to pay the latest round of expenses and middle flat owner and I are wondering if we can boot out the third director as we are fed up of his non-payment and his constant stalling.

Is there a simple way of doing this? He has been nothing but a pain and we want to have some sort of leverage over him (such as removing his right to share the freehold).