Clothing manufacturer Oxford Industries remains optimistic despite posting a slight decline in first-quarter net profits.