Struggling with chord switches vent.

Just wanted to vent about how frustrating the learning curve is with chord changing. I see why some people give up. I'm struggling with just switching from E minor to A minor. Going form A minor to E minor is pretty easy, but the reverse is what's getting me. My fingers never seem to land in the right place and i've been practicing for days now. At this point, I can't even imagine switching between G major (which I find intimidating since it's quite the stretch) and other chords or actually playing a whole song of different chords. What gives me hope is how badly I used to struggle with switching between the simple chords, but it's second nature now so hopefully I get to that point with the more advanced ones. I just can't believe how long it's taking. Anyone else relate?