Total posts : 45366
A lot of googlebot connections come in all the time for my streaming servers, so I searched “googlebot” at Wikipedia and the information might be useful to anyone interested.
For example, here is one thing it says:
A problem which webmasters have often noted with the Googlebot is that it takes up an enormous amount of bandwidth. This can cause websites to exceed their bandwidth limit and be taken down temporarily. This is especially troublesome for mirror sites which host many gigabytes of data. Google provides “Webmaster Tools” that allow website owners to throttle the crawl rate.