We can’t let a few rob us of what Mandela and others fought for. Our future depends on taking action together