Unseasonably mild weather at the start of the year hit clothing retailers in 2013, according to new figures.