.Google confines robots.txt assistance to four areas, clarifying its standpoint on in need of support directives.Google.com merely assists four particular robots.txt industries.In need of support ordinances in robots.txt are going to be neglected.Look at bookkeeping your robots.txt documents due to this upgrade.