Compressed HTML Support

Webinator 6 supports HTTP/1.1 compression, which can improve crawl speed and decrease network bandwidth usage.