Serve robots.txt inline in Nginx

robots.txt nginx

Serve robots.txt inline in Nginx
06/18/2015 nginx  3 Comments
To quickly serve a robots.txt from Nginx without actually having access to the physical file you can define the content of the robots.txt file in the Nginx .conf file.

Allow access to all User-agents:

  location /robots.txt {return 200 "User-agent: *\nDisallow:\n";}

Disallow access to every User-agent:

  location /robots.txt {return 200 "User-agent: *\nDisallow: /\n";}

Typo on line 7: Change Disallow to Allow

Also can be done on multiple lines:

    location /robots.txt {
        allow all;
        access_log off;
        log_not_found off;
    }