It's just practice man. In all your exercises make sure you use one finger per fret. Your pinky will need more work, but after a little while you should find it gets easier.

Just make sure you keep using it, and you'll get there. You might also consider a gripmaster / giro ball or whatever to build strength in general, but it will come...