I would agree that switching from smoother tread to the Smart Sams does increase rolling resistance, but it wasn't what I would call "a lot". There was a bit of extra noise when on pavement, which is lost energy slowing you down. On the downhill from my house my unassisted peak speed dropped from ~34mph to ~32mph. I didn't notice a drop in range, though there must have been a few miles lost.
I ended up going with a Smart Sam on the front tire for added control on gravel and dirt and with a smoother tread on the rear. This is the OEM
Specialized Trigger Sport for now. I ride with them both at ~50psi. Seems to be a good combination of low-ish rolling resistence and good steering control. If the great majority of your riding is on pavement this setup probably isn't for you, but it's working well for me.