He's been watching special election after special election where districts he won by double-digits just a few months ago are being flipped red to blue.