HTTP deep check

Run a full HTTP audit: headers, security posture, cookies, cache policy, compression, protocol, and special paths like robots.txt and sitemap.xml.