Could it really be the starter if it starts when I jump it? Also how expensive will a starting switch, starter solenoid, or a blown fuse cost me if that is the problem?
So it cant be the plug?
No, it can't be the spark plug. The bike wouldn't run well on a jump start if it were the plug. It's also unlikely that it's the starter switch, solenoid, or starter, since apparently they work when there is sufficient voltage and amps.
If you have or can borrow a multimeter, put it in the DC Volts mode. Put the wires on the battery terminals. Red positive, you know the deal. If it shows less than 12vdc, the battery is not getting a charge. Push start, or if you must, jumpstart the bike (BTW, do NOT jump the bike with a car battery when the car is running; it will burn the regulator. Only jump from another bike or with the car turned off). When the bike is running, put the multi meter on the battery again. You must see no less than 13 volts, 14.5 would be more like it as the revs go up. If you don't, the stator (like a generator/alternator) and/or regulator are broken, they have a bad connection or possibly fuses are out. I'd put $20 on a burned regulator, probably the previous owner was jumping the bike with a car when the original battery died and fried it with too many amps.
"Throwing parts" at the problem can add up fast. If you're not familiar with troubleshooting electrical systems, it's better to get help. Ask around for a reasonable shop to go to. Push start the bike, ride it in, and get a mechanic to look at it. A decent mech will find the problem in less than 30 minutes. Even at $60-$80 an hour, that's cheap compared to a few hundred for the wrong parts. If you need the stator changed out, it's probably not a job you want to do anyway. Most regulators are easy to get to, maybe you can do that one yourself. But, you're going to buying the parts anyway, so a little extra for labor to get it right is money well spent. Few things suck more than having to get your date to push start your bike in high heels.