At least 20 people drowned after smugglers forced their passengers overboard off the coast of Yemen, the United Nations refugee agency said on Tuesday.