This demonstrates issue #22. For this to expose the problem, you have to reconfigure your local sshd to listen only on a IPv4 socket. I had to add the following line to /etc/ssh/sshd_config
(on a Debian system):
ListenAddress 0.0.0.0
With that change, paramiko can not connect to localhost anymore: