Welcome to my world! I studied for 10 years as a youth, and stopped halfway through college. Well, as in your situation, life gets in the way. I took my first lesson in 30 years last August. It's been great. After a few months of daily work, the fingers get limber again (I remember them aching, like muscles I haven't used in years!), and the old music comes back from secret places in your memory.
To regain what I had without hours and hours of practice?
Nyah, ain't gonna happen.
It's like the old joke about the guy who's lost in New York.
"Can you tell me how to get to Carnegie Hall?"
"Practice, son. Practice."
It will take hours and hours. If you're serious, that's not a problem. Even with kids, career, and other obligations, I find I'm able to put in at least an hour a day. Perhaps it's not all in one block (in fact there are theories that you learn better in short 15-20 minute intervals than one long block).
Go for it, enjoy. Remember, this is for you!
Great luck and best regards,
George