Webmasters

Appendix: References

RFCs and existing standards

Previous robots.txt documents

Shared robots.txt extensions

Tools

Other implementations

Other references

Authentication required

You need to be signed in with Google+ to do that.

Signing you in...

Google Developers needs your permission to do that.