While not a bad idea, I'd rather the swatch history wasn't tool-specific. There are many ways to select/use a colour that don't involve the eyedropper tool.

My 2p.

-C