You can also just click View > Music details to view your music library. To view your music library, you can visit the “Library” tab in Steam, click the label at the right side of your search box, and select “Music” to view your music library instead of your game library. You can also choose whether you want to see a notification when the track changes.
For example, you can have Steam automatically pause music when you start an application, and control whether it’s automatically paused while you’re voice chatting within Steam. You can adjust other options from this window, too.