Yes MSW inverters can anger UPS devices. They’re trying to determine whether the grid power is stable before they switch off battery and the square wave doesn’t look “right” to it.
The reason I was looking for continuous power is for running Starlink. Every time the power is interrupted it goes through a startup sequence which draws a lot more amps. If it can stay running the amp draw stays lower. This can make a difference when switching from generator to house battery… especially if the house battery isn’t full. We could watch TV and charge a phone on the inverter, but Starlink would hit the battery harder for the startup sequence and the inverter would shut off due to low battery.
I was testing one of these with my solar battery bank, and it had the same behavior. I suspect it has something to do with my inverter not being a pure sine wave inverter. There are a few things that don’t seem to like my cheap inverter, for instance I have a aa/AAA battery charger that charges up to 8 batteries on a USB cable. No matter what USB wall charger I use, it flashes on and off and won’t charge, but if I plug it into the USB port on the inverter or the solar charge controller, it works.
Mine works well.
The relay sound likely occurs when it goes into boost mode for low voltage, or goes into battery mode for low voltage/frequency correction.
I have two of these: APC BR1500MS2
the problem is that your generator is not producing a clean sine wave 120 VAC power. you can replace the generator with a more expensive inverter type generator to make clean sine wave power, or you can use a UPS that will operate properly with low quality AC power. an APC BX1500M or BR1500MS2, for example has high, medium and low generator sensitivity settings. i used to have your problem with my whole house generator. when the generators was running, the UPS’s would stay on battery power, or switch back and forth. setting them to low sensitivity solved the problem.
You need a higher quality UPS. There are models available that you can set to a lower sensitivity to the incoming power.


