HSTS or Strict Transport Security is a basic specified in RFC 6797, by which a web server can state to a customer that it need to just be accessed through HTTPS. The web server or spider will then make all future demands over HTTPS. This will hold true even if following a link to an HTTP URL. From here the SEO Spider reveals a Status Code of 307 and a Status of HSTS Policy and a Redirect Type of HSTS Policy.
This redirect is an internal representation in the SEO Spider and the web browser. This varies from a 301 or a 302 as it isn’t sent out by the web server as its reversed internally. When a webserver states it ought to be gotten in touch with through HTTPS an expiration on this – this 307 reaction is perfect as it indicates short-lived re-direct.
The HSTS procedure is based upon the server sending out a single header. This is called a Strict-Transport-Security and is just sent out through HTTPS as if sent out through HTTP it is ignored. The header needs 2 associated instructions max-age and includeSubDomains.
Max-age is compulsory and lets the server understand the variety of seconds in which it can just be gotten in touch with by HTTPS. IncludeSubDomains is an optional field which if set, signals that HSTS Policy uses to any sub-domains.
There are numerous advantages to utilizing HTTP – > HTTPS Redirect. It lowers the interaction over non-secure procedures, lowers load on the internet server in addition to enhancing the efficiency as a big salami is prevented when the HTTP link is come across.
A site-wide HTTP->HTTPS redirect is still required due to the Strict-Transport-Security header disregarding this unless it is sent out over the HTTPS. If the very first check out to your website is not through HTTPS, you still require that preliminary redirect to HTTPS to provide the Strict-Transport-Security header. Considering this, you might not anticipate to see a 307 in the SEO Spider, however makes an HTTP ask for the robots.txt file, gets a 301 to the HTTPS variation of the website, then gets the Strict-Transport-Security header, so will then report 307 for the very first URL crawled. If robots.txt is handicapped inspecting the SEO spider will report a 301.
How to disable HSTS
This can be quickly done by unticking: ‘Respect HSTS Policy’ setup under ‘Configuration > Spider > Advanced’ in the SEO Spider.
The SEO Spider will neglect HSTS entirely and report upon the underlying redirects and status codes.