Florida-based clothing firm Perry Ellis International Inc is being sued by a union representing around 100 of its workers amid claims the company is improperly withholding its shareholders list.