Most (all?) solid state amps have a "line in" or "aux" input where you would run the jack from your PC 'speaker out' into it. Then, once you plug your headphones into the amp you would hear both the instructions from the lesson and the noise you where making with your guitar.

It's the only way my wife allows me to play.