First quarter profit at Casual Male Retail Group has fallen 12.7% to US$96,000, from $1.1m in the prior year, including a loss of $0.4m from the Jared M discontinued operations.