Sourcing giant Li & Fung has warned of tough times still to come, after seeing its net profit fall in what it described as a "challenging" year.