Oxford Industries, the owner of the Tommy Bahama brand, has moved to a loss in its third-quarter but offered a positive outlook for the remainder of the year despite the "difficult environment".