Dell Optiplex 7010 USFF I got on NewEgg for about $110
8GB ram and an i5
Needed a display port emulator to convince the BIOS there is a monitor attached. Another $8.
Grabbed the latest 18.04 LTS. Installed it using the normal installation routine.
Configured SSH right out of the gate.