I drove to Southampton and back yesterday with the a/c on and did not have any issue with my auto IS300.
I have noticed in other cars I have driven, that on hot and humid days the cars lose their edge, simple as engine run better on cold air.
I would check your air filter.