User-agent: * Disallow: /gbrowse/ Disallow: /cgi-bin/ Disallow /blast Disallow /andrew Disallow /BEDfiles # Disallow /HBVRegDB/