Clean tables Features

Clean tables Features

Clean Keywords

This feature cleans any keywords that are not associated with links currently in the database. With large databases that have links re-indexed or removed this is a feature that helps keeps table size down and helps speed up search results.

Clean Links

This feature removes any links that is not associated with any website. If a website is removed from the admin control delete site feature that with automatically remove the site and any associated links. Although this feature is not required we have included it as a percussion.

Clear temp tables

When indexing runs temps tables are automatically cleared. If indexing has been interrupted or stopped these tables will not have been emptied. With this feature you can clear the temp tables from previous uses of Sphider Pro Bot

Clear Search Log

Each time a search is preformed these are stored in the search log. The users IP address, the search query, results and time taken are all stored. Over time this can produce a large log file and you may want this to be cleared. Say after initial installation and testing.

Remove Blocked url's

When indexing completes Sphider Pro will run through a series of checks. One of these is to check the against the blocked url's table and make sure that now websites url's have been indexed that are on the blocked list. If indexing was interrupted or stopped these checks would not have completed. This feature allows you to quickly ran a check against the database and check for any blocked urls and remove them.

Remove Blocked images

When indexing completes Sphider Pro will run through a series of checks. One of these is to check the against the blocked images table and make sure that now websites images have been indexed that are on the blocked list. If indexing was interrupted or stopped these checks would not have completed. This feature allows you to quickly ran a check against the database and check for any blocked images and remove them.

Remove 404 url's

This is something that we have all come across. When searching we have clicked a link that has returned a 404 not found message. This happens as people change their website structure. When indexing Sphider Pro will just see that the page is present and that it has some text. This feature allows you to clean your database and remove these urls from your search feature.

Clear Empty Searches

Even when a user clicks the search button and no search term has been entered Sphider Pro still records this data. To combat this we have added the clear empty searches function. This will remove these from the search log and keep only relevant results in the log.