The Grammy winner acknowledged that he loved "reading criticism" of the controversial show — even if "some of it didn't feel ...