Colourful American Apparel founder Dov Charney has been ousted by the company's board of directors as investigations into misconduct allegations continue.