Restrict podman-remote access to podman with ssh certficates.
On the local machine, create a certificate CA.
$ ssh-keygen -f my_ssh_cert_authority
$ cat my_ssh_cert_authority.pub
ssh-rsa AAAAB3NzaC1yc…
Login to the remote machine and add the CA to .ssh/authorized_keys