Test whether a URL is allowed or blocked by robots.txt, see the winning rule, and list the sitemaps it declares.