There are plenty of people who have learned to fly after 50. Anybody in reasonable helath can get a medical, and therefore can become a pilot with a little work. You should probably just go and try taking a lesson. If you have put in a lot of time in the right seat then you know flying isn't all that hard. The only way to find out is to go and give it a try!
Mike