Icelandic retail investor Baugur Group is to file for bankruptcy after a court in Reykjavik refused to give it more time to sort out its affairs.