As part of my study of Analytics, I realize that SEO and SEM are relevant topics. This blog captures some of the learning.
What I learned from here:
- Organic Traffic: When search engines route traffic to your website without you spending any money.
- Paid Traffic: When search engines route traffic to your website when you spend some money to do so.
- Search Engine Optimization/SEO: Describes a set of practices to apply on your website for organic traffic.
- Search Engine Marketing/SEM or Pay Per Click/PPC: Describes a set of practices to apply on your website for paid traffic.
- Search Engine Result List/SERL: Self explanatory.
/robot.txt
file: Search engine bots look for this file on every website. This file holds instruction on which pages to list with the search engine.
Discussed here at length.
REP defines a set of rules for your website to help the crawlers to figure which pages to show/not show.
- Crawler Directive: Through
/robot.txt
(most common) and also/sitemap.xml
, you can define which paths to include/exclude and which user agents (read bots) to allow/disallow, etc. - REL tags: You can use certain HTML attribute in tags to tell crawlers to not include a page. As mentioned here, just add
rel='nofollow'
on anchors.