Listen to Android phone's music from desktop headphone

How to listen to [Android phone's music] from [a headphone that is connected to a Windows 10 desktop] without internet connection?
I have an Android phone (Pixel 3a) with YouTube Music installed on it.

When I don't have internet connection, I want to be able to wear my headphone, which is connected to my desktop (Windows 10) and listen to both my desktop's audio (for example, game sound) and the music playing on my phone (for example, music that is available only on the phone's YouTube Music offline downloaded folder).

How can I achieve this?

Note:

• I searched on the internet and it seems like Windows 10 doesn't have bluetooth support by default that support audio streaming from phone to PC. People seems to be able to install a different bluetooth driver and get it to work, but I can't get it to work. (if you can get it to work please list the exact step)
  
  
• This source says Pixel 3a has A2DP.
  This is my motherboard: TUF GAMING X570-PLUS (WI-FI) Driver & Tools | Motherboards | ASUS Global