Change this:
location / {
try_files $uri $uri/ =404;
}
To this:
location / {
try_files $uri.html $uri $uri/ =404;
}
If for example you wanted to do the same for php, use the following:
location / {
try_files $uri.php $uri.html $uri $uri/ =404;
}