The Pennsylvania senator also agreed that his party is "toxic" and had a hard time connecting with voters in swing states like his home state.