Blue Crab

Commercial; $25

Current Version: 4.9.38 (June 18, 2010) / 1.0.5 "Lite" (July 20, 2010)

Limit Point Software produces Blue Crab, a "high-performance crawler for intranets and the Internet" that allows you to index Web content in a manner similar to the way the big search engines do it.

Version 4.9.38 includes the following enhancements:

• Batch downloader: A new imaging format has been added called "Web Archive." Select this option in the Preferences window "Behavior" panel for batch downloading. When selected URLs which are "archivable" will be downloaded into webarchives (file extension "webarchive").

A Lite version of the software (part of Limit Point's all-in-one utility pack) is also available. This is essentially a stripped down version of Blue Crab that you use to download websites. It was created for those who don't need all the bells and whistles of Blue Crab, derived from its "Quick Grabber" feature.

Version 1.0.5 "Lite" includes the following enhancements:

• Extended the functionality by adding a search facility that can search the textual contents of files. Search results are displayed in a hierarchical list matching the directory path location of each found file. The search query is placed on the "Find" clipboard so that you can easily search for the string once the file is opened up in its creator application (provided that the application supports "find" strings, such as TextEdit, TextWrangler or Xcode.) Access search via the "Grab & Search" menu, or typing "Command-S"
• Bug fix: the program would hang during a crawl if the option for logging was deselected.