How are you able to generate images so quickly? When I tried to run Stable Diffusion on my nominally comparable GPU (RX6800M, similar to 6700XT, 12GB VRAM), it took over a minute to get halfway to generating a medium sized image before my entire computer crashed.
Yes, which is why a delicate mixture of both is best because they spend their efforts fighting each other rather than fighting your freedom.