We can update our robots.txt and lower the crawl interval if that becomes a problem.