Public-key infrastructure (PKI) is an umbrella term for everything that has to do with keys and certificates.
This is a quick overview of the important stuff.
Public-key cryptography involves a key pair: a public key and a private key. Each entity has their own. The public key can be shared around, the private key is secret.