@malkavian, I understand your concern, but as far as I've read the Whatsapp implementation, it doesn't "upload" your phonebook to Whatsapp servers.
So far contact synchronization is not implemented so Yappari is showing all your contacts even though they are not Whatsapp users (and I think it's bad like that).