Clothing producer Delta Apparel reported a 73% slump in second-quarter profit but reaffirmed its expectations for the full year.