When the b format file is using At9 conversion settings, and the sound is set to 3D in Wwise. It sounds like the ambisonic sound field is summing to mono and playing from the emitter position.
When I use PCM the ambisonic sound field plays back correctly, with the sound field rotating based on the relative orientation of the listener and emitter.
Are you using At9 for compressing b format files?