Foreign Minister Sushma Swaraj left for US on Saturday to attend the celebration of International Yoga Day, even as the controversy of her helping former IPL chief, Lalit Modi, who is wanted by officials in a graft case, refused to die down.