This is exactly what I do as well, and it works quite well. It's also one of my favorite parts about running a small company, and I think I'd like to make it a policy that programmers should interact directly with the customers at least sometimes.