When you use Bluetooth, the link between your phone and headset is encrypted so that other people cannot listen in.

Although it is not impossible to break the encryption, it is very difficult and unlikely to happen.