Some Chagos Islands-born protesters said the deal jeopardizes the limited the rights they have to visit the islands, including to tend the graves of relatives.