Yeah, exactly. I'm not trying to call you out or anything, btw. I just wanted to state some generalities that came to mind from your posts. I know because I went through pretty much everything you're going through. If you stick to it enough, you'll get to your end goal, but it's going to be years and years. It's a long commitment, and most don't make it past the first year or so. You'll hit these walls in your learning process, and it'll take a bit to overcome them. Just stick with it and keep chugging along. While it might not make a ton of sense right now, or you might keep forgetting certain things, keep practicing. It'll all come together eventually. I'm actually really big into proper English grammar, and that's helped me quite a bit when it came to certain aspects of Japanese grammar. Ironically, the better I got at Japanese, the harder it was for me to explain certain things to people because the meanings can be quite a bit deeper than what basic English can convey, and without proper understanding of the Japanese language, it can be a huge pain.
Also, very cool that you do have some teachers. I had to do everything on my own, and it sucked, lol. I can read novels, play video games, have detailed conversations and watch TV without any issues, so I think I've pretty much reached my end goal. I've gone through JLPT2 and JLPT1 workbooks without many issues, too. I still study every day, though. Then again, I still review English grammar points, but that's probably because I have no life.