"You didn't see Republicans when we had control of the Senate try to rig the game. You didn't see us try to pack the court."