it happen to my pervious car (toyota supra) before - same situation and i took it down to Toyota garage which they charge £1600 for repair, but they only replace upper arm, lower arm, suspension (not sure) and need to do GEO on the car.
Take the wheel off and you might see what it need to replace...