Fashion label Ted Baker says it is cautious about trading in the rest of its financial year after a big drop in wholesale sales slowed its third quarter revenue growth.