I play it just because it's fun so I won't give up yet 
I'm not suggesting you give it up, merely that you lay the proper foundations for it. That way you'll actually get to play it sooner.
As a general principle, if you have difficulties with a particular aspect, it is best to isolate that aspect and work on it in a piece or two which otherwise is straightforward. That way you can focus on just that thing. The problem with trying to learn a piece that has several such aspects going on at once is that the learning process is lowed exponentially.
There is also the risk that you will learn just to do the piece - not the generalised form of the technique - so next time you encounter it, rather than it being straightforward, you'll have to almost learn it from scratch again.