Same here. But with eBooks too. Sometimes my brain drifts for a while and I reread the same paragraph 5 times. So what I do is “double-dip”. I listen to and read the ebook at the same time. This way my brain has no chance of escaping. This has also helped me with my English; oh, so that’s how you pronounce albeit?
It works great for me. Not for my wife though, who is textbook ADHD. She reads slow, and if she matches the speed for the audiobook to her reading speed, it gets boring :) the wonders of neurodiversity :)