No. All you can “lose” is the 1 ARK voting fee. All other ARK tokens will stay in your wallet and you have full control over them. Please do not send tokens to any of the delegates! That will not count as a vote and you might lose your tokens.