Windows 11 can show a Bluetooth headset or speaker as connected and still play no sound. You may see the volume slider move, ...
I am assuming here that both the devices are paired. You can confirm that by going to Settings > Devices > Bluetooth. You can then follow the tips mentioned below if the Bluetooth speaker is connected ...