Casual Male Retail Group Inc, which operates the Casual Male Big & Tall stores is to buy Rochester Big & Tall Inc for $15 million, along with the assumption of bank and subordinated debt of approximately £5m.