Casual apparel company Actif Group has reported full-year losses, as trading was affected by challenging high-street conditions.