Basically suspension height (20 mm lower) better handling, 18" alloy wheels and different front grill plus rear spoiler - the sport whether dealer modified or the July 2003 model should have much tighter handling and a harder ride than the GS430 SE.
GS430 sport cars between 2001 - June 2003 do handle differently from the July 2003 ones (as owned both), the July 2003 ones have (in my opinion) slightly sharper handling but the 2001 onwards GS430 sport cars still handle much better than the standard car. The 2001 - July 2003 cars were dealer modified I believe and look externally identical to the post July 2003 cars, but Lexus officially launched the GS430 sport (and relaunched the GS300 sport with smaller lip spoiler) in July 2003 in the UK. Looking at the attached press release they added some additional interior features as well.
Suggest you test drive one as the ride is much stiffer than the standard SE car and may not to be everyone's taste as unlike modern cars, there is no air suspension to tune (or go wrong!). Attached the official Lexus press release from July 2003 which might help.
the-new-lexus-gs300-and-gs430-sport.pdf