So you have been crawled by "SquiggleBot" If you are accessing this page you no doubt are wondering what the hell a SquiggleBot is. So we would like to explain. SquiggleBot is the crawler for The Cyber Web Inc's new entry into the lucritive search market. We hope to have some of the highly specialized searches launched later in 2005. How will squigglebot
help you? SquiggleBot will crawl websites 24-7 compiling complete updated databases quickly and efficiently. The results will be distributed into smaller searches that have very specific themes. For example, FishingBee.com will only return results relavent to fishing. This will make the database small and easy to update while returning highly relevent results. Additionally by crawling all sites from a centralized bot, we can tweak and build the best possible indexing tools rather than tweaking each and every smaller bot. One unique feature of Squigglebot is that it thumbnails the website and includes it with the search results. Although we have seen many attempts at thumbnailing results, we have not seen anyone with great success. Here is an example of what you will see:
Hey! There is no guarantee that it will work. But what do you have to loose? We are the ones doing all the work and you will reap the rewards (if there are any). Just don't complain if you do not get traffic. We plan to remain small and will never be able to drive traffic to you Google style. However, in time we may become very popular, if we do our job tweaking the index. If you wish to exclude your site from our index, check out the home page for details. Once your website is added to our "do not crawl" list, it can only be included by an administrative override. So do not exclude our bot unless you are absolutely sure you want out of this cool project. Browse the links below to find out more about SquiggleBot and the entire project. [ Home ] [ Help ] [ More About The
Bot ] [ The
Cyber Web Inc ] [ Search Engine News ] [ Building The Search ] [ Project Progress ] [ Page Ranking ] |
