As soon as I switched to Windows 11, I realized that the standard taskbar wasn't for me. It lacked a lot of the features I'd already used to, and I ended up dropping it in favor of more useful alternatives for me.
One of these alternatives is montab, a small utility that does not require installation. Immediately after launching it, a panel with previews of all open windows will appear on the right, and the previews themselves will be updated in real time.
The list of applications depends on the currently active monitor, so you will not see unnecessary information among the previews.