Unfortunately, it sounds like you have a power quality issue. No swapping of components can likely fix this unless you choose to regenerate the AC sine wave, which gets really expensive. If you live in a rental, the path toward fixing it has extra hurdles.
A very good electrician can diagnose the problem fully. Here’s how Fluke describes possible diagnostics.
I used an industrial example here because those electricians tend to be more familiar with power quality issues than strictly residential electricians. The problems have more expensive ramifications in industrial settings.
Understanding how power quality issues affect the plant, how to detect them, and how to make them go away.
www.fluke.com