It sounds a bit like you’re passively hearing it, not actively listening to it. If so, you could be doing that until the cows come home without much improvement. If you’re not understanding much of it, it’s likely too far over your head.
Jungleboy made a good suggestion with NIS, it’s a free podcast and has beginner, intermediate and advanced levels. TBH, even the advanced level is a little bit slow (for advanced), but depending on what you can understand, it’s unlikely to be too easy at this stage. It’s based on natural conversations from a couple who live in Spain, the guy is English but the woman is from Madrid. The English guy, Ben, speaks very good Spanish, although his pronunciation is a little off, but that’s OK IMO as he’s easier to understand and he kind of acts as a bridge making it easier to understand his wife, Maria.
You probably want to skip the beginner series as there’s a lot of English between the rather short Spanish conversations and it’s really, really slowly spoken Spanish, aimed at absolute beginners. Start with the intermediate pods. I’ll just say, the early one’s are a little bit faster than the later intermediate episodes, I guess they got feedback during the series suggesting they slowed down a touch, so if you find the first few too tough (I suspect you won’t), work backwards through the series.
As Jungleboy has said, they offer transcripts for like £40, or something like that, which usually covers something like 30-40 episodes each consisting of 10 minute (approx) conversations on various topics like living, eating, and working in Spain, cultural differences with England, politics, famous Spanish people, as well as discussing various books and studies they’ve found. If you want to purchase the transcripts, I’d wait until Easter as they often have a sale on during the holidays where you can probably get them half price, or a third off, something like that. There’s also one episode here on Lingq about the mafia in Spain, it’s one of their free sample episodes, you should be able to find it under early intermediate/beginner level on here. It’s one of the more slowly spoken intermediate episodes. Give that a try first and see what you think.
If they’re not for you, then you could perhaps try LIghtspeed Spanish who are basically a clone of NIS, same setup, English guy, Spanish wife from Madrid. They have a YouTube channel with lots of videos, including the videos they also made into a podcast. I find it quite a bit more basic than NIS in that they talk much more slowly and the topics aren’t very highbrow, let’s say, but they’re very funny, and I’ve laughed out loud many times listening to them. Go straight to the upper intermediate and advanced speaker levels as the earlier two levels are too basic, with too many explanations of grammar in English, of which there is none in the higher levels.
Both those podcasts are nice introductions to understanding the spoken language without feeling too overwhelmed, and they’re fun to listen to, at least for me they were. One last thing I’d suggest is to dedicate some time to listening where you don’t have other distractions going on, don’t just press play at the gym hoping you’ll eventually understand them if you’re not able to follow them right now. Do some studying as you listen (with the transcripts, if you get them), really try hard to understand, repeatedly listen if you have to, when you feel you can understand enough to follow along, then play them whilst you’re at the gym or whatever, otherwise it’s a waste of time IMO.
Good luck.