hello my name is steve.
I have the same issue and after a while i noticed that the air intake button on the dash always defaults to recirculate,i have found when you select the air from outside this cures the problem,i have asked lexus about this and they say the air intake button always defaults to recirculate,hope this cures you issue?