Up to you. if the car keep running, then why not. My car kept going , with nothing worse that slight noisy tappet, and had been given numerous engine 'tune-ups' by he previous owner. I was fooled into buying it, thinking nothing worse than tappets needed adjusting. (I was used to a noisy A series engine).Cam wear was such that 2 or 3 lobes had no significant lift, but the car kept going, and seemed to run well.
I cannot see that you will be doing your engine any more harm by not changing the cam, but I am sure that someone will disagree.
Do you want perfection? Are you prepared to pay for it?