I'd say it depends on your stance. If you're leaning into it, go narrower. If you're riding upright, go wider just as @Rás Cnoic said.
Padding is important, be it on you or on the seat should make no difference despite the wild claims to the contrary, though the point many have made about...