Although I'm completely noob and everyone else probably already knows just in case I'll post my answer, turns out it's super easy. Just turning on limit sound instances and setting it to 1 for an actor-mixer with all the voice over clips solves the problem.