WinRM (Windows Remote Management) lets us manage a Windows box remotely. The WinRM service is already installed and running on Windows Server 2008+.
However, no WinRM listener is configured (see Microsoft's article on WinRM configuration).
On the box over Remote Desktop (sadly), open a cmd prompt/powershell and run
winrm quickconfig