Casual Male Retail Group saw second quarter profits edge down slightly as comparable store sales held steady with a 0.3% increase.