The esc didn't mank any difference to any of my cars speed so far. Which esc is it? Are you using Tamiya motors? It may be the battery unable to power the motor properly, but I'm far from knowledgeable on electrics.
Have you fitted ballrace bearings to your car, and have you lubricated the gearbox?