Its good your doing it this slow to simply get your left hand fingers used to sweeping patterns; from one string to another one note at a time.

Although since your doing it that slow, theres a good chance your not actually sweeping the strings with the right hand. At that speed, its easy to end up picking the strings individually when you may be trying to sweep. To actually sweep, you pretty much have to do it at a relatively fast speed.