Ascena Retail Group, owner of the Ann Taylor, Loft and Lane Bryant chains, has swung to a fourth-quarter net loss amid a 4.6% drop in revenue and restructuring costs.