Bad lag spikes on RX 5500 XT

Hello, I am having an issue to where my AMD RX 5500 XT has really bad lag spikes and only sees 40-80% utilization, while my CPU stays at 60% utilization. Does anyone have any ideas?

 

Looks to me like your CPU might be a bottleneck.

 

So, it turns out I had to do a factory reset of my AMD drivers, I cant believe I did not try this before hand.

 

I had some issues on my system with a 5500. Arma 3, Halo Reach, Half Life Black Mesa (New Edition) all ran fine. I first encountered the problem with Battlefield 2 online play. It would run great then all of a sudden my frames would just get wrecked for like 20 seconds and then go back to normal. It didn't seem to have anything to do with amount of things on the screen. Offline play was just fine. Now on Flight Sim 2020 it's doing the same thing. I just updated my graphics card driver today so we'll see what happens. I have an i9 so I don't think that's holding me back. 16 GB ram.