You can get feedback through your pickups too.
Especially on less expensive guitars with stock pickups.
If that isn't the cause, then the only thing I can think is that you might be overdriving the PC input somehow.
Ideally, you'd be best using a mixer before the PC so you can adjust the output before it reaches the computer.