Welcome to the forums Miranda

It's great to have you here!
You do bring a unique background to the table - I'm certain with a little brainstorming you'll pinpoint your ideal set of services (and clients).
As Lily mentioned, there are plenty of virtual assistants who are working full-time or part-time (or did so while starting up their practices). It's a unique set of challenges and definitely means a real focus on time management in the beginning, but it can be done. Some of the most successful VAs I know were contending with 40+ hours a week outside the home during their startup phase. Don't let that stop you from staying driven and excited about running your own business!
Looking forward to reading your posts and chatting more on the forums!