Performance problems like this are usually complex dumb things. Like calculating a thing a million times when it only needs to be done once, doing one thing and context switching instead of batching, dumb locking that leaves threads spending most of their time waiting, creating and destroying a thing millions of times when it should be reused, etc etc.

It will just be lots of these things that need to be found and corrected.