March 2010 - Archive



As various states are providing appliance rebate programs to encourage consumers to switch to new energy efficient appliances we thought it only appropriate to offer our federal government GSA pricing (a savings of up to 32% over list prices) to all state and local governments to help with their budget constraints this spring.

Call our sales office today at 216-820-2200 to find out how switching to a Thunderstone Search Appliance can save you money today.


"I'm impressed with vortex. You have so much functionality already put in to your language that I had to do by hand in perl." -- Gwen Zanin, Sr. Database Designer, The Chronicle of Higher Education


Once you've completed your first walk, you have a choice of how further walks should be performed. It's a choice between thoroughness and speed.

"New" crawls are started from scratch, just like the initial crawl. It takes your initial URLs, forgets everything else, and finds all the content again. The advantage is that you can be sure that every URL is checked on every walk, but the downside is it takes just as long as your initial walk. If your initial walk wasn't excessively long, this could be a feasible walking strategy.

If your initial walk took a week to finish, you might not want to do a New walk every time, though. Our "Refresh" walk schedules pages based on how often they change. The idea is that if a page hasn't changed in 6 months, we don't need to check it EVERY night. Only a subset of pages are checked on a refresh walk, with the more frequently changing pages checked more often than rarely changing ones.

The advantage of refresh walks is they can complete much faster than New walks, allowing your changing content to be updated much more frequently. The disadvantage is if a rarely-changing page DOES change, it might be a while before the refresh crawl checks it to notice the change.

Which type of walk is appropriate depends on your situation, the size of your content, and how quickly things need updated.

Feedback, suggestions and questions are welcome. Send your email to .

Copyright © 2020 Thunderstone Software LLC. All rights reserved.