I hear you. The upcoming Nexus 6 is simply too big. Don't get mad at me, I happen to agree with you. I don't think of it as an issue of hand-size, it's a matter of pocket space. Fitted pants and giant phones just don't mix.
So what's a Nexus lover to do? Pick up a Nexus 5. They're going for less and less these days. Today you can get one on eBay for $315 that will ship to nearly anywhere in the world.