Unload everything that you don’t need for the particular sound. More info → YouTube.
Like Matt Vanacoro said - Make it lean and mean!
Example: check your Poly settings on the Arturia synth plugins. LINK