Specialty apparel retailer The Wet Seal swung to a "disappointing" loss during the first quarter, after "disruptive" weather and soft traffic dampened sales.