I like E Phryggian as well. I also really enjoy Dorian, because of the major 6th in the minor context, it's awesome. I would say I am also a big fan of Lydian and Aeolian. Also, you can't go wrong with major! :) Learn them all and develop your voice in all of them! It's well worth the time.
The other day my friend who is a great jazz guitarist played something in mixolydian to me and it sounded like the Simpsons, it was absolutely amazing and I loved it. Now I want to go get good at Mixolydian so that I can make jazzy Simpsons-esque riffs!