Apparel maker Kellwood Company has swung to a third quarter loss as it was hit by lower women's sportswear sales and steep restructuring costs as it tries to refocus on its higher-end lifestyle brands.