# robots.txt for http://www.edexcellence.net/ User-agent: Twiceler Disallow: / User-agent: psbot Disallow: / User-agent: * Crawl-delay: 20 User-agent: * Disallow: /admin/ Disallow: /archive/ Disallow: /CGI-BIN/ Disallow: /chart/ Disallow: /chester/ Disallow: /database/ Disallow: /dayton/ Disallow: /designs/ Disallow: /doc/ Disallow: /een/ Disallow: /employment/ Disallow: /evolution/ Disallow: /fordham/ Disallow: /fordhamprizes/ Disallow: /foundation/ Disallow: /gadfly/ Disallow: /gif/ Disallow: /home/ Disallow: /hottopic/ Disallow: /issuespl/ Disallow: /library/ Disallow: /log/ Disallow: /logs/ Disallow: /manifesto/ Disallow: /NCLBconference/ Disallow: /netnotes/ Disallow: /newgif/ Disallow: /philanthropy/ Disallow: /possible links/ Disallow: /publicat/ Disallow: /queries/ Disallow: /scripts/ Disallow: /sept11/ Disallow: /signup/ Disallow: /socialstudies/ Disallow: /SR2/ Disallow: /standards/ Disallow: /stotsky/ Disallow: /styles/ Disallow: /surfing/ Disallow: /tbfinstitute/ Disallow: /template/ Disallow: /Templates/ Disallow: /topics/ Disallow: /W3SVC29/ Disallow: /whatsnew/ Disallow: /www/