I met an issue that there were always some players I cannot connect to. I googled the problem and tried many ways but can't fix it. Now I found the cause of the issue. My Windows uses the IP v6 as the preferred protocol to communicate, which doesn't work well with ICE. So I disabled the IP v6 and use IP v4 and it works. Here is the way:
https://kb.firedaemon.com/support/solutions/articles/4000160803-prioritising-ipv4-over-ipv6-on-windows-10-and-11