Does the car’s Bluetooth system grab the phone when it’s off? Most systems don’t, so it’s a matter of turning off the radio when you get out.
Alternatively, when answering the call, you should be able to select if you want the audio to be on the phone, speaker, or which Bluetooth connection.
