Skip to Content






Web Fetching (Subscribe)

Links

> >|

Extreme URL Spider

http://www.totheextreme.net/dotnet/go.cgi?go=es-url&theme=dotcom&a=

The Extreme URL Spider allows you to quickly and easily accumulate urls, titles, descriptions, and keywords of sites. It spiders pages quickly, then spiders the urls it gathers. If you have any questions please press the contact link on the menu.
Price: $59.95

Review It Rate It Bookmark It

LinkXtor

http://themechat.com/LinkXtor.html

Get links from any page on the World Wide Web automatically! Just type the URL of the page you want to extract links from and LinkXtor will get the links for you! Choose the links you want to keep and they will automatically be saved to a fully customizable links page. Or, if you have SSI, you can use the SSI command to put the links into any page on your site.
Price: Freeware

Review It Rate It Bookmark It

Macurious Spider

http://www.macurious.com/spider/

This search engine software is an essential tool for webmasters who are looking for an automated crawler to build a search engine on their web site. This CGI script will crawls and extract data from your local web directory as well as remote sites.
Price: $250.00

Review It Rate It Bookmark It

Madengine

http://www.network-design.net/madengine.html

Madengine reads a list of admin-configureable URLs, gets these urls via the web into temp files, and removes most html tags, then adds the info to a database file for that page. When madengine is queried, it returns a list of LINES from those pages that match the query string, along with a linked url for the page that match is from. This gives the user of madengine a better idea how their query string is used in context, rather than just a raw match. Madengine DOES NOT follow or index URLS contained within the preconfigured list...they must be added by the administrator.
Price: Freeware

Review It Rate It Bookmark It

Morning Paper

http://www.boutell.com/morning/

Morning Paper summarizes the new content on your favorite web pages, and presents it all to you in a single convenient "newspaper." Keep track of hundreds of pages without the need to visit them yourself.
Price: $10.00

Review It Rate It Bookmark It

RSS Fetcher

http://www.mimanet.com/scripts/rss_fetcher.html

This script will fetch My Netscape type RSS files from a remote site, format them as HTML and store the HTML in a file on your site. You can use this to display headlines from other sites. Many sites use this file format and it is a great way to exchange headlines between sites. Some places where you can go to look for sites with RSS files you can use are Userland, xmlTree, and in the My Netscape network.
Price: Freeware

Review It Rate It Bookmark It

URL Ripper

http://www.cgiconnection.com/cgi-bin/cgi-con/system.cgi?area=scripts&docs=2100

10 out of 10 stars (1 vote)

URL Ripper will extract all links and e-mail addresses found on any given web site URL you specify and even get the links and e-mail addresses from other URL's on the site automatically.
Price: $99.95/Free for Members

Review It Rate It Bookmark It

URLSpider

http://perlcoders.com/main/scripts.html?script=URLSpider

This is a simple spider you can aim at any site and have it grab every link on the page and spider them as well, building a list of links that can be used in numerous ways.
Price: Free for Members/$100

Review It Rate It Bookmark It

Web Extractor

http://www.cgiconnection.com/cgi-bin/cgi-con/system.cgi?area=scripts&docs=4900

Search any web site URL or search engine, Extracts all e-mail addresses from links, Specify maximum number of links and e-mails to search for, Automatic removal of duplicate links and e-mails, Download links and e-mails as they are being searched, Realtime processing ensures you get new links and e-mails every time you use Web Extractor, Add or remove your own search engines, directories, or any othe URL.
Price: $399.95/Free for Members

Review It Rate It Bookmark It

Web Thief

http://www.utilmind.com/scripts/webthief.html

WebThief is an extremely easy to use script intended for grabbing files and pages from World Wide Web via HTTP protocol. The WebThief works with httpget.lib library, which supplyed with this package. To receive data from the web, you should specify just usual url address of file or web page.
Price: $25/$69

Review It Rate It Bookmark It

> >|