That doesn't really make sense. A 10lb dagger is very heavy, and while getting smacked around with it would hurt more than by a pocket knife, it hardly invokes the same power as fucking some poor gnome with a 40lb polearm.

A heavy dagger isn't heavy, its just heavy for a dagger. The point of the legacy is that you're wielding heavy weapons and therefore suffer the mechanics penalties of doing such.