How big is your gig file?
Last month, we did find out about long loading time under Windows which come from parsing big gig files. This has nothing to do with the VST performance itself, but is only shown at gig loading time. Is this the behavior you are seeing?