Did you try real time privileges as mentioned in the wiki?
Strongly recommended for Pipewire. This mitigates a lot of the common issues such as audio glitching or cutting out in certain scenarios.
Install the following package: sudo pacman -S realtime-privileges
Run the following command: sudo gpasswd -a $USER realtime
Reboot your system.