Oxford Industries has suffered a fall in first quarter net sales and earnings per share as the company suffered from weakening consumer demand.