Casual Male Retail Group Inc, which sells apparel for big and tall men, says its first quarter profit was flat with the same period last year after "adverse" weather in some regions weighed on sales.