Activewear manufacturer Delta Apparel has swung to a first quarter loss, blaming tough comparisons with a shareholder payment of $0.7m in the prior year period and textile restructuring costs.