"If you’re liberal and you think not voting is going to somehow help when he appoints multiple Supreme Court justices next term, I don’t know how that helps any of your interests," the congressman said.