It ruins my fun when my hands and feet get cold.
We hit a cold spell in NM of low-mid 20s in the morning (that is cold for us). I got a pair of the Bar Mitts neoprene handlebar mittens, Amazon, $55, and they really work very well at keeping my hands warm at 18-22 mph for my 25-30 min commute at 5:30 am. My heavy duty padded Pearl Izumi winter gloves would leave my finger tips almost numb because of the cold on the same ride. When I use the Mitts, I ended up just using my summer half-fingered padded gloves instead of my med temp full fingered and heavy duty Izumi bike gloves. I remove the mitts for the ride home and just use the full fingered gloves (usually +40 degrees by then). There is more than enough room to toss in a hand warmer in the pouch for really cold mornings or longer rides. I also find it easier to feel the control by touch with the half fingered gloves.
They look goofy; but, keep your hands very comfortable (easy to take on/off in minutes).