My old Avensis was a very smooth and quiet ride. Though it is written off now, not my fault. But for the record it can take a hit even though it was knocked by almost 180 degrees - definitely a safe car.
Though my Yaris is a little louder car, but not harsh but more fun. This may sound a little stupid but I do like how things look in Yaris rear mirror.