Impact of not changing damaged headset bearings

I have a Canyon Ultimate CF SL [2014], which has the Acros Ai70 headset. These now need replacing, as turning the handlebars you can feel that it is rough and grinding.
Replacement bearings are £55, plus they are press-fit, which I don't have the tools for.

So my question is whether just leaving the bearings as they are would damage the forks or frame?
It is my winter / commuting bike so I can live with how the steering feels, but if it will wreck the bike then I would have to change them.

Thanks

Comments