Men's wear business Moss Bros Group reported a full-year profit rise but said current trading conditions were "challenging".