I've had my 05 GS300 for nearly a year now.
It is a heavy NA car and on the test drive, I too thought the car was sluggish at low speed.
Until I enabled ECT-PWR!! It transformed the car for me. The gearbox was much more eager to kick down in this mode. But make no mistake, a 450H would crush a 300 for speed/power.
Another unintentional bonus was having some much needed engine assisted braking, which I am sure is extending the life of my disks/pads.
In my first year of ownership, thus far I've put on some winter tyres, replaced the PCV valve, 2 tyre pressure sensors and had a full stainless steel exhaust system fitted.
NOTE: If you replace the PCV valve, get a genuine Lexus part. I foolishly bought a cheap 3rd party one thinking it'd do the job. How wrong I was. All it did was burn oil at a frightening rate. Like almost a litre in a single 270 mile trip frightening! Ordered the Lexus part and after the return trip, the oil level on the dipstick hadn't gone down.
I love my GS300, will keep it until one of us dies!