This sounds like the kind of frustration I have felt many times (maybe not quite as intense). I started lessons 3 years ago and it took me back to the kind of frustration I had trying to learn quantum mechanics many, many years ago. Here are a couple of things that make it hard for me. First, I am so conditioned to having things go from A on the top to Z on the bottom, that the lettering of the staff is absolutely backwards. I know logically why it is lettered the way it is, but in my head I still do not "see" it and have to slowly calculate the letters. Have not found a way to do this. Second thing is that the left hand fingering is also backwards. It goes from finger one on the right to finger 5 on the left. This one I have been able to overcome. Simply label the left hand fingers with a minus sign. Then it all makes sense and as a bonus, it removes the ambiguity of the numbering system.
Here is what keeps me going. I tell myself that no one else cares about my frustration. Wining is of no use. I want to learn and month by month I am learning. By the way, it takes me three to four weeks to learn to play anything. What I mean is it seems to take that long for the brain to rewire. Therefore, it is not surprising that after 2 lessons you see no progress, even on something that would appear to be very simple. If you really want to learn to play, I know you can, you just have to find a way to ignore the frustration.
Good luck on your choice. As you can tell, mine was to keep going and I have no regrets.