On the street I have not been able to tell much difference from a standing start. Also, for general street driving (even on winding roads) you really are not going to tell much difference in normal vs. comp modes. When you really push the car the normal mode nannies kick in much sooner than during comp mode.
Yes, each time the car is shut off, it will return to normal mode. You have to select comp mode each time.