Second quarter net income at big and tall men's apparel retailer Casual Male Retail Group Inc dropped 26% as warm weather and a shift in the back-to-school period dampened sales at its stores.