Turns out I just have alot of bad microcontrollers.  My programmers all work, I did brick my last attiny13 though.  Working on putting code onto a work attiny2313.  Theres no adc, but keeping the potientometers as my paddles so they work the same way.  Will also keep code under 1k so it could in theory work on an attiny13 in the future.  Almost done with a point system, updates to come in the next few days.