Power
The conductor has the power of the people—well, the power to bring people to the orchestra. If he or she has a stellar reputation, the seats will be packed. If nobody's heard of him or her, chances are the place will be quiet as a church mouse.
Keep in mind that classical music is not typically the hottest ticket in town. There will likely be a loyal following of subscribers and classical music enthusiasts, but the orchestra can't compete with the arena-filling power of pop acts, rappers, and rock stars.
There are also opportunities to be powerful within the job. If a conductor can bring something fresh and exciting to music as old as time, he or she can single-handedly keep a music program alive. They have the power to shape a piece of music from something good to something spectacular.
You're also leading a group of musicians—so at the very least you'll hopefully have some power there, right?