Votekick will usually mean a short 10 minute ban for the one kicked to calm down.
Voteban should be something like 48 hours, imho. You could give trusted players slightly greater voting power for kick and ban votes to make up for griefers.