This reminded me of when I started listening to a new podcast and also tried a new podcast app at the same time. The podcaster had this unusual editing style where he'd cut all the pauses out of his podcast and I really grew to love it. It was only when I tried a different podcast that did the same thing that I realised I had set the app to cut out all of the silences.
After that I've been unable to go back to normal speed podcasts - I just don't have the time or patience.
Podcast Addict [0] has that feature but only runs on Android devices. I use that as well as speeding up podcasts to 2x speed which makes things better for me.
That's not the whole story though, some edited podcasts I find hard to listen to _because_ they're (heavily?) edited. Some people-having-a-chat-podcasts work well for me.
I guess I can't stand too much 'energy' in the audio, be it from editing into something fast paced, or overly enthusiastic and dramatic voice (acting). I'm looking for something where content speaks for itself, rather than the voices.