It's not that you shouldn't leave him alone as much as you shouldn't single him out.
The "So are many others, but they haven't broken one of the best records of baseball." is kind of retarded. You're basically implying that only the best players should be held accountable for the rampant cheating that's gone on in baseball. The fact of the matter is, everyone who cheated, and everyone who knew about it (cheaters and otherwise) are responsible for baseball's current state.
The average players who cheated and became above average players put the natural above average players at a disadvantage. And then the above average players start juicing to keep up, because they know that everyon'e turning a blind eye and they want to get paid too. And then you have the above average players competing with the true blue superstars and then they start juicing too. I'm sure that that's not exactly what happened in all cases but I can guarantee it's what happened in many. If you've read Game of Shadows, it becomes abundtantly clear that that's where Bonds is coming from. He watched mediocre all-stars like Sosa and McGwire destroying the ball. He saw all the accolades they were receiving when it was ABUNDANTLY clear that they were juicing.