Hong Kong-listed fashion brand Esprit swung to a loss during what it described as an "exceptionally challenging" year, weighed down by currency headwinds and China woes, but says it is now entering the "growth" phase of its turnaround plan.