To get better performance, you can set the color-interpolation-filters attribute to "sRGB" on the filter property:
<filter id="greyscale" color-interpolation-filters="sRGB">
<feColorMatrix type="saturate" values="0"/>
</filter>
color-interpolation-filters is not supported in Safari however, to the best of my knowledge