I've used many Linux Distros in past and now settled in Debian. Mainly because in my opinion that is the only available stable user friendly Desktop Linux distributions available. All other distros are trying to ship the latest and cutting edge software and along with that lot of bugs or made for server installation. With the latest Debian 12, I am getting the application versions those I can cope with.
Another advantage for me is the release cycle. Debian does not have a short release cycle. That might be disadvantage for some. But it works well for me.
In past I liked switching distros frequently. I enjoyed the pain of backing-up and formatting hardrives and spending hours to install and configure new OS. But now I am getting old and doesn't want to take all those hard work.
My opinion is is to take a stable enterprise grade Distro and polish it for your need and keep sticking with it. On the way you might face some hurdles, solve them and make it perfect.
1. RHEL - That's the true enterprise grade distro available (Not user friendly as a desktop OS). But it is mainly a commercial distro, so you might need to find work-around for many things to get it working without redhat custom tools.
2. RHEL spins - a. CentOS - Now they made it rolling lease and a test base for stable RHEL, But should be better than many distros.
b. Alma, Rocky - Redhat stopped providing source, but they might find alternative way to keep going.
3. Fedora - Fedora is mainly a testing ground for Redhat Linux. They provide cutting edge software and release new version every 6 month. - I don't like it as my daily drive. I want something stable and with a longer release cycle, so that I don't have to take the pain of upgrading OS every 6 month or so. ( But I install it in a VM to get hands on latest trends in Linux software )
4. Debian - RHEL and its spins are primarily designed as server/headless OS, so you might not find rpm packages for all desktop apps for them. Outside RHEL family, I think Debian is the most stable distro. It is run by community, so no need to worry about some company making it paid one day. Its the mother of many popular desktop distros including ubuntu and its spins.
I once tried LFS (Linux from scratch), its a good way to learn all Linux building blocks for your hardware. It is not a practical distro. But good way to learn all the layers in a Linux distro. That will help troubleshoot issues with your main Linux distro installation.
Note: Switching Linux distro might not solve the specific issue you are facing. End of the day all distros has component from same vendors. Check if the Linux kernel version, driver version etc has any bug causing slow USB speed.