# This file tells the search engine robots which files they may spider. For a complete # description, see http://www.searchengineworld.com/robots/robots_tutorial.htm. # All search engines User-agent: * Disallow: / Disallow: /*/bbclone/ Disallow: /internal/