Several prominent foundations have withdrawn from the national dialogue citing poor planning and questionable spending