How to manage transitions between multiple voices

Question

Hi, I'm creating a bed ambience in quad.

The game is in first person. If the player moves from one area to another (e.g. forest, village) there will be a transition between the two bed ambiences. So far so good. But if during the transition the evening came and therefore there was another day/night transition (or even two if it also started to rain) I would have a lot of voices that crossfade between them. I wanted to limit this by creating a priority system perhaps but I notice that the voices are interrupted abruptly and therefore the crossfade does not come out as it should. I would like to play a maximum of 8 voices but make the transitions smooth. Does anyone know how to manage something like this?

Thanks