My reading speed is too fast to let voices finish (or, sometimes, even properly start ), so this happens in almost every VN to me. I don't mind it.
Of course, in particularly tense scenes in good VNs I'll let the voice finish (and sometimes, listen to it again, when there's an option to)... But that's not common.
I don't particularly see it as a problem. Can't you just wait for the voice to finish before clicking anyway? Or are you at auto-read?
It's been a long time since I read Quarttet, and it was unremarkable, so I don't remember specifics.