I've only used pulse and pipewire recently, but in ubuntu used some alsa...

I think steam looked up for pulse or pipe by default and might mix them up in some games...
Try setting environment variable or running steam with SDL_AUDIODRIVER=alsa or STEAM_RUNTIME=0

There is the files with pulseaudio settings for alsa... if those exist.

/usr/share/alsa/alsa.conf.d/50-pulseaudio.conf
/usr/share/alsa/alsa.conf.d/51-pulseaudio-probe.conf

Hope it helps.