Please go to My Site → Customize → CSS (or Additional CSS), then add all of the following code to the bottom of that window.
/* Hides Follow button */
#actionbar { display: none; }
Tip: keep the /*
comment */
in the code to later know what this code does.