Don't see it as 'slacking off' though. See it as establishing a mature work/life balance.

The problem is that as a startup founder/CTO type the way you work sets the pace and culture for your entire company. And not everyone will be cool with that approach. You could miss out on experienced, senior people who just want to work normal hours and not feel like they're letting the side down.