Poised is designed to only listen to you and not others. One way to diagnose that your settings may not be set correctly is if in the meeting details you see that the Talk time is 100%.

In case of Mac, make sure that your speaker is set to "Poised Speaker" in your video conferencing platform settings and you're good to go!