Go to Bluetooth & other devices in Windows settings (e.g. by pressing the Win key + X, selecting Settings and then Devices).
Click on More Bluetooth options:
Select the COM Ports tab, then select the ports and Remove them:
How to remove Bluetooth COM ports (SPP)