I suspect you are too late to become a conductor of a large and famous orchestra.
You didn't meet some vastly important mentor at summer camp, the way Bernstein met Copeland. In conducting the famous or major, IMHO it is not what you know, it is who you know. And you (and I) are from nowheresville when it comes to the famous and influential. You have to be from metropolis, and run in the right crowd in that elite group. The only counter argument I can think of is Dudemel, who came in from starring from a prestigious program in Latin America to conduct the orchestra of the most Latin of US cities, LA. Now he has moved on to fame in Italy or Germany, where he is racking up headlines but maybe not a lot of money, I suspect.
We've got a new guy conducting the symphony in our 3rd string city, Teddy Abrams, that studied with Michael Tilson Thomas at some point in his youth. The conductor of SF Symphony. You didn't I imagine.
My band director, with a master's in music from Cowtown U, got to conduct a vastly talented amateur group in my high school for three years. The "symphonic" band. Then he went on to become a school counselor, because that paid a whole lot more. This man could conduct whole scores by memory without looking at the paper. But those people with master's degress in music from Cowtown University (where he & I graduated), however talented, don't go on to conduct the city orchestra, even in the same city.
Stick with the physics and math. You could be programming computers or production robots or logistics systems or doing big data analysis in a few years for real money. There are a lot more of those gigs, than conductor jobs of orchestras with recording contracts. I did all right financially as a physicist, even though my career was interrupted at a key point by a call back to military service.
There is one elevator to the top - writing talent. George Gershwin was from Metropolis, but the wrong neighborhood. He jumped up from song plugger in Tin Pan Alley, to headliner at Carnegie Hall, by writing the music for a lot of hit Broadway shows. Then Rhapsody In Blue for Paul Whiteman (Radio & concert star) made his name forever. He could conduct when he wasn't playing the piano.
Henry Mancini started writing for televion shows, which was a nothing gig in 1955. But his TV riff grabbed the ear, sold a lot of records, and pretty soon he was writing for top of marquee movies. Then he could guest star as conductor with any orchestra once a year. Plus the record company would hire him a studio orchestra to conduct and make record after record, which sold like hotcakes.
Pure writing talent is a rocket to the top. I don't have it. Do you? I knew a girl who wrote lyrics & book to a musical in 7th grade. Why isn't she famous? Oh well. She was from Cowtown, too. BTW, my alma mater university was built in 1946 on the grounds of the demolished stockyards by the railroad yard, in our top 10 city.
On the counterpoint, Benny & Bjorn made Stockholm famous, not vice versa. So if you can write like they could, there is still hope. Find a backup group at a summer camp, as they did, and enter Eurovision contest or something.
As for conducting, I led the church choir down the road last Advent. No pay, no glory. But the music was beautiful I got a few nice thank yous and an offer of a ride anytime I was in a jam from a retired baritone. There are all sorts of amateur opportunities for the talented musician, for no money. Money in the music business goes to people who are famous already. I'm not. Sounds like you haven't won any international contests before age 15, either.
Best of luck in your endeavors.