Women's wear retailer AnnTaylor Stores has swung to a fourth quarter loss on hefty costs related to its restructuring programme and lower traffic at its namesake shops.