
SUPER SPIDER URL SPIDER AND DOMAIN EXTRACTOR SCRIPT
You are going to love this script! A simple, yet powerful cgi script with mysql database interface that will allow you to spider the internet and collect unique urls and domain names at the speed of light! 5 minutes to configure, set your starting url and the spider will start probing the internet from the starting url collecting every single link and unique domain name it finds along the way. A great way to construct targeted marketing databases or start your own search engine. Script allows you to select spidering depth or just leave it until your hard drive explodes with data. This script is a masterpiece.
This is an example of the hundreds of pieces of software and/or problems we've worked to fix
|
|
 |
 |