I think the key is that you said you were feeling worse and worse about it, so like most everyone else said, DO WHAT MAKES YOU FEEL GOOD
(didn't mean to shout
)
I've never put any color in my hair and at 49 I'm just getting grey at the temples and a few on top that stick straight up, whereas my sister, just one year older has colored her hair for years because she greyed very early and just in the last few months decided not to do it. Whatever she decides to do, is her decision, just like you.
Even if you want to just try it, then you can decide to continue to not.