# # This file is used by most robots (web crawlers) to determine what they # may or may not look at. We allow them to crawl all over our site, with # the exception of the Admin and pending directories. # User-agent: * Disallow: /Admin/ Disallow: /pending/ Disallow: /test/ Disallow: /pitt/