Disclaimer - the opinions that follow come from someone that worked over 25 years in the insurance industry - both on the agency/brokerage (both small and large) side as an account manager and on the company side as a commercial underwriter. Admittedly, my views are biased...but they're usually right.
Each facet of the industry has it's issues. As an underwriter, you'll have agents wanting you to cut the price, provide coverages that you otherwise normally wouldn't, hounding you, etc. As an account manager on the brokerage side, you've got account exec's making unreasonable demands (and you usually know more about the insured and coverages than they do).
After 25+ years in the industry, I made a break to the "client side" and work in risk management. It's a lot more enjoyable and fulfilling than working on the industry side. You might also consider looking into public adjusting - where you're working for the client and can take a more impartial view.