Closed to the wildcard group

This page is disallowed in this site's robots.txt under User-agent: * only. Every crawler that has its own named group in robots.txt may read it; a crawler that relies on the wildcard group may not. It exists to record crawlers that ignore the wildcard rule while obeying rules that name them. There is nothing else here.

Back to the lab index