It is probably best to have a Netweaver expert from sap to take a look.
What is the FCAServerThreadCount setting? This is the amount of threads the ICM/http? dispatcher can use. The ICM passes requests back and forth beetween the back end java and the clients. So you can have a lot of back end threads but an insuficient number at the ICM causing a bottleneck.