Disable things like "High Performance Devices" which migrates devices to 5GHZ automatically. I find that some devices don't handle it well.
Also, disable Optimise IoT WIFI, Legacy Support, BSS Transition. In fact the only wifi Advanced setting I have enabled is "Fast Roaming" and I have no issues at all.
A colleague had similar issues to you and changed his settings to the same as mine and has a rock solid wifi network ever since.